Conference Proceeding Article
We consider the problem of trajectory prediction, where a trajectory is an ordered sequence of location visits and corresponding timestamps. The problem arises when an agent makes sequential decisions to visit a set of spatial locations of interest. Each location bears a stochastic utility and the agent has a limited budget to spend. Given the agent's observed partial trajectory, our goal is to predict the agent's remaining trajectory. We propose a solution framework to the problem that incorporates both the stochastic utility of each location and the budget constraint. We first cluster the agents into groups of homogeneous behaviors called "agent types". Depending on its type, each agent's trajectory is then transformed into a discrete-state sequence representation. Based on such representations, we use reinforcement learning (RL) to model the underlying decision processes and inverse RL to learn the utility distributions of the spatial locations. We finally propose two decision models to make predictions: one is based on long-term optimal planning of RL and another uses myopic heuristics. We apply the framework to predict real-world human trajectories collected in a large theme park and are able to explain the underlying processes of the observed actions.
Artificial Intelligence and Robotics | Computer Sciences | Numerical Analysis and Scientific Computing
Intelligent Systems and Optimization
ECAI 2016: 22nd European Conference on Artificial Intelligence, 29 August-2 September, The Hague
City or Country
LE, Truc Viet; LIU, Siyuan; and LAU, Hoong Chuin.
A reinforcement learning framework for trajectory prediction under uncertainty and budget constraint. (2016). ECAI 2016: 22nd European Conference on Artificial Intelligence, 29 August-2 September, The Hague. 285, 347-354. Research Collection School Of Information Systems.
Available at: http://ink.library.smu.edu.sg/sis_research/3364
Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.