Networked Distributed POMDPs: A Synthesis of Distributed Constraint Optimization and POMDPs

Publication Type

Conference Proceeding Article

Publication Date

2005

Abstract

In many real-world multiagent applications such as distributed sensor nets, a network of agents is formed based on each agent's limited interactions with a small number of neighbors. While distributed POMDPs capture the real-world uncertainty in multiagent domains, they fail to exploit such locality of interaction. Distributed constraint optimization (DCOP) captures the locality of interaction but fails to capture planning under uncertainty. This paper present a new model synthesized from distributed POMDPs and DCOPs, called Networked Distributed POMDPs (ND-POMDPs). Exploiting network structure enables us to present two novel algorithms for ND-POMDPs: a distributed policy generation algorithm that performs local search and a systematic policy search that is guaranteed to reach the global optimal.

Discipline

Artificial Intelligence and Robotics | Business | Operations Research, Systems Engineering and Industrial Engineering

Publication

Proceedings of the Twentieth National Conference on Artificial Intelligence, AAAI

First Page

133

Last Page

139

ISBN

9781577352365

Additional URL

http://portal.acm.org/citation.cfm?id=1619356

Link to Full Text

Share

COinS