Publications

Speeding up Deep Reinforcement Learning through Influence-Augmented Local Simulators

Miguel Suau, Jinke He, Matthijs T. J. Spaan, and Frans A. Oliehoek. Speeding up Deep Reinforcement Learning through Influence-Augmented Local Simulators. In Proc. of Int. Conference on Autonomous Agents and Multi Agent Systems, pp. 1735–1737, 2022.

Download

pdf 

Abstract

Learning effective policies for real-world problems is still an open challenge for the field of reinforcement learning (RL). The main limitation being the amount of data needed and the pace at which that data can be obtained. In this paper, we study how to build lightweight simulators of complicated systems that can run sufficiently fast for deep RL to be applicable. We focus on domains where agents interact with a reduced portion of a larger environment while still being affected by the global dynamics. Our method combines the use of local simulators with learned models that mimic the influence of the global system. The experiments reveal that incorporating this idea into the deep RL workflow can considerably accelerate the training process and presents several opportunities for the future.

BibTeX Entry

@InProceedings{Suau22aamas,
  author =       {Miguel Suau and Jinke He and Matthijs T. J. Spaan
                  and Frans A. Oliehoek},
  title =        {Speeding up Deep Reinforcement Learning through
                  Influence-Augmented Local Simulators},
  booktitle =    {Proc. of Int. Conference on Autonomous Agents and
                  Multi Agent Systems},
  pages =        {1735--1737},
  year =         2022
}

Note: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Generated by bib2html.pl (written by Patrick Riley) on Thu Feb 29, 2024 16:15:45 UTC