Publication Type
Conference Proceeding Article
Publication Date
6-2013
Abstract
The execution of an agent's complex activities, comprising sequences of simpler actions, sometimes leads to the clash of conflicting functions that must be optimized. These functions represent satisfaction, short-term as well as long-term objectives, costs and individual preferences. The way that these functions are weighted is usually unknown even to the decision maker. But if we were able to understand the individual motivations and compare such motivations among individuals, then we would be able to actively change the environment so as to increase satisfaction and/or improve performance. In this work, we approach the problem of providing highlevel and intelligible descriptions of the motivations of an agent, based on observations of such an agent during the fulfillment of a series of complex activities (called sequential decisions in our work). A novel algorithm for the analysis of observational records is proposed. We also present a methodology that allows researchers to converge towards a summary description of an agent's behaviors, through the minimization of an error measure between the current description and the observed behaviors. This work was validated using not only a synthetic dataset representing the motivations of a passenger in a public transportation network, but also real taxi drivers' behaviors from their trips in an urban network. Our results show that our method is not only useful, but also performs much better than the previous methods, in terms of accuracy, efficiency and scalability.
Discipline
Artificial Intelligence and Robotics | Theory and Algorithms
Publication
Mobile Data Management (MDM), 2013 IEEE 14th International Conference on
ISBN
978-0-7695-4973-6
Identifier
10.1109/MDM.2013.28
Publisher
IEEE
Citation
LIU, Siyuan; ARAUJO, Miguel; BRUNSKILL, Emma; ROSSETTI, Rosaldo; BARROS, Joao; and KRISHNAN, Ramayya.
Understanding Sequential Decisions via Inverse Reinforcement Learning. (2013). Mobile Data Management (MDM), 2013 IEEE 14th International Conference on. Research Collection School Of Information Systems.
Available at: http://ink.library.smu.edu.sg/sis_research/3474
Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.