Optimized Multi-Agent Formation Control Based on an Identifier-Actor--Critic Reinforcement Learning Algorithm

Wen, G., Chen, C. L. P., Feng, J. & Zhou, N., Oct-2018, In : Ieee transactions on fuzzy systems. 26, 5, p. 2719-2731 13 p.

Research output: Contribution to journalArticleAcademicpeer-review

Copy link to clipboard


  • Optimized Multi-Agent Formation Control Based on an Identifier–Actor–Critic Reinforcement Learning Algorithm

    Final publisher's version, 985 KB, PDF document

    Request copy


  • Guoxing Wen
  • C. L. Philip Chen
  • Jun Feng
  • Ning Zhou

The paper proposes an optimized leader-follow er formation control for the multi-agent systems with unknown nonlinear dynamics. Usually, optimal control is designed based on the solution of the Hamilton-Jacobi-Bellman equation, but it is very difficult to solve the equation because of the unknown dynamic and inherent nonlinearity. Specifically, to multi-agent systems, it will become more complicated owing to the state coupling problem in control design. In order to achieve the optimized control, the reinforcement learning algorithm of the identifier-actor-critic architecture is implemented based on fuzzy logic system (FLS) approximators. The identifier is designed for estimating the unknown multi-agent dynamics; the actor and critic FLSs are constructed for executing control behavior and evaluating control performance, respectively. According to Lyapunov stability theory, it is proven that the desired optimizing performance can be arrived. Finally, a simulation example is carried out to further demonstrate the effectiveness of the proposed control approach.

Original languageEnglish
Pages (from-to)2719-2731
Number of pages13
JournalIeee transactions on fuzzy systems
Issue number5
Publication statusPublished - Oct-2018


  • Fuzzy logic systems (FLSs), identifier-actor-critic architecture, multi-agent formation, optimized formation control, reinforcement learning (RL), FUZZY CONTROL-SYSTEMS, STABILITY ANALYSIS, MOBILE ROBOTS, CONSTRAINTS

ID: 77513161