Publication Type
Conference Proceeding Article
Version
publishedVersion
Publication Date
5-2017
Abstract
Recent work in decentralized stochastic planning for cooperative agents has focussed on exploiting omogeneity of agents and anonymity in interactions to solve problems with large numbers of agents. Due to a linear optimization formulation that computes joint policy and an objective that indirectly approximates joint expected reward with reward for expected number of agents in all state, action pairs, these approaches have ensured improved scalability. Such an objective closely approximates joint expected reward when there are many agents, due to law of large numbers. However, the performance deteriorates in problems with fewer agents. In this paper, we improve on the previous line of work by providing a linear optimization formulation that employs a more direct approximation of joint expected reward. The new approximation is based on offline computation of binomial distributions. Our new technique is not only able to improve quality performance on problems with large numbers of agents, but is able to perform on par with existing best approaches on problems with fewer agents. This is achieved without sacrificing on scalability/run-time performance of previous work.
Discipline
Theory and Algorithms
Research Areas
Intelligent Systems and Optimization
Publication
16th International Conference on Autonomous Agents and Multiagent Systems, AAMAS
First Page
732
Last Page
740
Publisher
International Foundation for Autonomous Agents and Multiagent Systems
City or Country
Sao Paolo, Brazil
Citation
RANJAN KUMAR, Rajiv and VARAKANTHAM, Pradeep.
Exploiting anonymity and homogeneity in factored Dec-MDPs through pre-computed binomial distributions. (2017). 16th International Conference on Autonomous Agents and Multiagent Systems, AAMAS. 732-740.
Available at: https://ink.library.smu.edu.sg/sis_research/3936
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
http://www.ifaamas.org/Proceedings/aamas2017/pdfs/p732.pdf