Publications

| Sorted by Date | Classified by Publication Type | Classified by Research Category |

Solving Multi-agent MDPs Optimally with Conditional Return Graphs

Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T. J. Spaan, and Mathijs M. de Weerdt. Solving Multi-agent MDPs Optimally with Conditional Return Graphs. In Multi-agent Sequential Decision Making under Uncertainty, 2015. Workshop at AAMAS15.

Download

(unavailable)

Abstract

In cooperative multi-agent sequential decision making under uncertainty, agents must coordinate in order find an optimal joint policy that maximises joint value. Typical solution algorithms exploit additive structure in the value function, but in the fully-observable multi-agent MDP setting (MMDP) such structure is not present. We propose a new optimal solver for so-called TI-MMDPs, where agents can only affect their local state, while their value may depend on the state of others. We decompose the returns into local returns per agent that we represent compactly in a conditional return graph (CRG). Using CRGs the value of a joint policy as well as bounds on the value of partially specified joint policies can be efficiently computed. We propose CoRe, a novel branch-and-bound policy search algorithm building on CRGs. CoRe typically requires less runtime than the available alternatives and is able to find solutions to problems previously considered unsolvable.

BibTeX Entry

@InProceedings{Scharpff15msdm,
  author =       {Joris Scharpff and Diederik M. Roijers and Frans
                  A. Oliehoek and Matthijs T. J. Spaan and Mathijs
                  M. de Weerdt},
  title =        {Solving Multi-agent MDPs Optimally with Conditional
                  Return Graphs},
  booktitle =    {Multi-agent Sequential Decision Making under
                  Uncertainty},
  year =         2015,
  note =         {Workshop at AAMAS15.}
}

Note: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Generated by bib2html.pl (written by Patrick Riley) on Thu Feb 29, 2024 16:15:45 UTC