Publications

Asynchronous Execution in Multiagent POMDPs: Reasoning Over Partially-Observable Events

João V. Messias, Matthijs T. J. Spaan, and Pedro U. Lima. Asynchronous Execution in Multiagent POMDPs: Reasoning Over Partially-Observable Events. In Multi-agent Sequential Decision Making under Uncertainty, 2013. Workshop at AAMAS13.

Download

pdf [459.2kB]  

Abstract

This paper proposes a novel modeling approach to problems of multiagent decision-making under partial observability, building on the framework of Multiagent Partial Observable Markov Decision Processes (MPOMDPs). Unfortunately, the size of MPOMDP models (and their solutions) grows exponentially in the number of agents, and agents are required to act in synchrony. In the present work, we show how these problems can be mitigated through an event-driven, asynchronous formulation of the MPOMDP dynamics. We introduce the necessary extensions to the dynamics and solution algorithms of standard MPOMDPs. In particular, we prove that the optimal value function in our Event-Driven Multiagent POMDP framework is piecewise linear and convex, allowing us to extend a standard point-based solver to the event-driven setting. Finally, we present simulation results, showing the computational savings of our modeling approach.

BibTeX Entry

@InProceedings{Messias13msdm,
  author =       {Jo{\~a}o V. Messias and Matthijs T. J. Spaan and
                  Pedro U. Lima},
  title =        {Asynchronous Execution in Multiagent {POMDPs}:
                  Reasoning Over Partially-Observable Events},
  booktitle =    {Multi-agent Sequential Decision Making under Uncertainty},
  year =         2013,
  note =         {Workshop at AAMAS13.}
}

Note: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Generated by bib2html.pl (written by Patrick Riley) on Thu Feb 29, 2024 16:15:45 UTC