The IRMA Community
Newsletters
Research IRM
Click a keyword to search titles using our InfoSci-OnDemand powered search:
|
Particle Swarm Optimization for Model Predictive Control in Reinforcement Learning Environments
|
|
Author(s): Daniel Hein (Technische Universität München, Germany), Alexander Hentschel (AxiomZen, Canada), Thomas A. Runkler (Siemens AG, Germany)and Steffen Udluft (Siemens AG, Germany)
Copyright: 2018
Pages: 27
Source title:
Critical Developments and Applications of Swarm Intelligence
Source Author(s)/Editor(s): Yuhui Shi (Southern University of Science and Technology, China)
DOI: 10.4018/978-1-5225-5134-8.ch016
Purchase
|
Abstract
This chapter introduces a model-based reinforcement learning (RL) approach for continuous state and action spaces. While most RL methods try to find closed-form policies, the approach taken here employs numerical online optimization of control action sequences following the strategy of nonlinear model predictive control. First, a general method for reformulating RL problems as optimization tasks is provided. Subsequently, particle swarm optimization (PSO) is applied to search for optimal solutions. This PSO policy (PSO-P) is effective for high dimensional state spaces and does not require a priori assumptions about adequate policy representations. Furthermore, by translating RL problems into optimization tasks, the rich collection of real-world-inspired RL benchmarks is made available for benchmarking numerical optimization techniques. The effectiveness of PSO-P is demonstrated on two standard benchmarks mountain car and cart-pole swing-up and a new industry-inspired benchmark, the so-called industrial benchmark.
Related Content
|
P. Chitra, A. Saleem Raja, V. Sivakumar.
© 2024.
24 pages.
|
|
K. Ezhilarasan, K. Somasundaram, T. Kalaiselvi, Praveenkumar Somasundaram, S. Karthigai Selvi, A. Jeevarekha.
© 2024.
36 pages.
|
|
Kande Archana, V. Kamakshi Prasad, M. Ashok.
© 2024.
17 pages.
|
|
Ritesh Kumar Jain, Kamal Kant Hiran.
© 2024.
23 pages.
|
|
U. Vignesh, R. Elakya.
© 2024.
13 pages.
|
|
S. Karthigai Selvi, R. Siva Shankar, K. Ezhilarasan.
© 2024.
16 pages.
|
|
Vemasani Varshini, Maheswari Raja, Sharath Kumar Jagannathan.
© 2024.
20 pages.
|
|
|