Publications

Improving Value Function Approximation in Factored POMDPs by Exploiting Model Structure

Tiago S. Veiga, Matthijs T. J. Spaan, and Pedro U. Lima. Improving Value Function Approximation in Factored POMDPs by Exploiting Model Structure. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1872–1873, 2015. Extended abstract.

Download

(unavailable)

Abstract

Linear value function approximation in Markov decision processes (MDPs) has been studied extensively, but there are several challenges when applying such techniques to partially observable MDPs (POMDPs). Furthermore, the system designer often has to choose a set of basis functions. We propose an automatic method to derive a suitable set of basis functions by exploiting the structure of factored models. We experimentally show that our approximation can reduce the solution size by several orders of magnitude in large problems.

BibTeX Entry

@InProceedings{Veiga15aamas,
  author =       {Tiago S. Veiga and Matthijs T. J. Spaan and Pedro
                  U. Lima},
  title =        {Improving Value Function Approximation in Factored
                  {POMDPs} by Exploiting Model Structure},
  booktitle =    {Proc. of Int. Conference on Autonomous Agents and
                  Multi Agent Systems},
  year =         2015,
  note =         {Extended abstract.},
  pages =        {1872--1873}
}

Note: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Generated by bib2html.pl (written by Patrick Riley) on Thu Feb 29, 2024 16:15:45 UTC