Publications

| Sorted by Date | Classified by Publication Type | Classified by Research Category |

Approximate Solutions for Factored Dec-POMDPs with Many Agents

Frans A. Oliehoek, Shimon Whiteson, and Matthijs T. J. Spaan. Approximate Solutions for Factored Dec-POMDPs with Many Agents. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 563–570, 2013.

Download

pdf [588.8kB]  

Abstract

Dec-POMDPs are a powerful framework for planning in multiagent systems, but are provably intractable to solve. Despite recent work on scaling to more agents by exploiting weak couplings in factored models, scalability for unrestricted subclasses remains limited. This paper proposes a factored forward-sweep policy computation method that tackles the stages of the problem one by one, exploiting weakly coupled structure at each of these stages. To enable the method to scale to many agents, we propose a set of approximations: approximation of stages using a sparse interaction structure, bootstrapping off smaller tasks to compute heuristic payoff functions, and employing approximate inference to estimate required probabilities at each stage and to compute the best decision rules. An empirical evaluation shows that the loss in solution quality due to these approximations is small and that the proposed method achieves unprecedented scalability, solving Dec-POMDPs with hundreds of agents.

BibTeX Entry

@InProceedings{Oliehoek13aamas,
  author =       {Frans A. Oliehoek and Shimon Whiteson and Matthijs
                  T. J. Spaan},
  title =        {Approximate Solutions for Factored {Dec-POMDPs} with
                  Many Agents},
  booktitle =    {Proc. of Int. Conference on Autonomous Agents and
                  Multi Agent Systems},
  year =         2013,
  pages =        {563--570}
}

Note: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Generated by bib2html.pl (written by Patrick Riley) on Thu Feb 29, 2024 16:15:45 UTC