Reinforcement learning of normative monitoring intensities

Li, Jiaqi; Meneguzzi, Felipe; Fagundes, Moser; Logan, Brian

Abstract

Choosing actions within norm-regulated environments involves balancing achieving one’s goals and coping with any penalties for non-compliant behaviour. This choice becomes more complicated in environments where there is uncertainty. In this paper, we address the question of choosing actions in environments where there is uncertainty regarding both the outcomes of agent actions and the intensity of monitoring for norm violations. Our technique assumes no prior knowledge of probabilities over action outcomes or the likelihood of norm violations being detected by employing reinforcement learning to discover both the dynamics of the environment and the effectiveness of the enforcer. Results indicate agents become aware of greater rewards for violations when enforcement is lax, which gradually become less attractive as the enforcement is increased.

Citation

Li, J., Meneguzzi, F., Fagundes, M., & Logan, B. (2016). Reinforcement learning of normative monitoring intensities. Lecture Notes in Artificial Intelligence, 9628, 209-223. https://doi.org/10.1007/978-3-319-42691-4_12

• Journal Article Type: Article
• Acceptance Date: Jun 26, 2016
• Publication Date: Jul 13, 2016
• Deposit Date: Oct 4, 2017
• Publicly Available Date: Oct 4, 2017
• Journal: Lecture Notes in Computer Science
• Electronic ISSN: 0302-9743
• Publisher: Springer Verlag
• Peer Reviewed: Peer Reviewed
• Volume: 9628
• Pages: 209-223
• Book Title: Coordination, Organizations, Institutions, and Norms in Agent Systems XI
• DOI: https://doi.org/10.1007/978-3-319-42691-4_12
• Public URL: https://nottingham-repository.worktribe.com/output/801172
• Publisher URL: https://link.springer.com/chapter/10.1007/978-3-319-42691-4_12
• Additional Information: Part of: International Workshop on Coordination, Organizations, Institutions, and Norms in Agent Systems. COIN 2015: Coordination, Organizations, Institutions, and Norms in Agent Systems XI