A Study of Collaborative and Distributed Multi-agent Path-planning using Reinforcement Learning (강화학습 기반의 분산 다중 에이전트 협업 경로 탐색에 관한 연구)

Kim, Min-suk (김민석)

doi:10.9708/jksci.2021.26.03.009

A Study of Collaborative and Distributed Multi-agent Path-planning using Reinforcement Learning

Journal of The Korea Society of Computer and Information
Abbr : JKSCI
2021, 26(3), pp.9-17
DOI : 10.9708/jksci.2021.26.03.009
Publisher : The Korean Society Of Computer And Information
Research Area : Engineering > Computer Science
Received : February 10, 2021
Accepted : March 11, 2021
Published : March 31, 2021

Kim, Min-suk ¹

¹상명대학교

Accredited

ABSTRACT

In this paper, an autonomous multi-agent path planning using reinforcement learning for monitoring of infrastructures and resources in a computationally distributed system was proposed. Reinforcement-learning-based multi-agent exploratory system in a distributed node enable to evaluate a cumulative reward every action and to provide the optimized knowledge for next available action repeatedly by learning process according to a learning policy. Here, the proposed methods were presented by (a) approach of dynamics-based motion constraints multi-agent path-planning to reduce smaller agent steps toward the given destination(goal), where these agents are able to geographically explore on the environment with initial random-trials versus optimal-trials, (b) approach using agent sub-goal selection to provide more efficient agent exploration(path-planning) to reach the final destination(goal), and (c) approach of reinforcement learning schemes by using the proposed autonomous and asynchronous triggering of agent exploratory phases.

KEYWORDS

Reinforcement Learning, Multi-agent, Sub-goal, Sharing Information, Collaborative

Citation status

* References for papers published after 2023 are currently being built.

[confproc] D. B. Megherbi / 2011 / Multi-Agent Distributed Dynamic Scheduling for Large Distributed Critical Key Infrastructures and Resources(CKIR)Surveillance and Monitoring / Proceeding of IEEE International Conference on Technology for Homeland Security(HST)

[confproc] K. Zhang / 2018 / Networked Multi-Agent Reinforcement Learning in Continuous Spaces / Proceeding of 2018 IEEE Conference on Decision and Control (CDC)

[confproc] D. B. Megherbi / 2009 / A Distributed Multi-Agent Tracking, awareness, and communication System Architecture for Synchronized Real-Time Situational Understanding, Surveillance, Decision-Making, and Control / Proceeding of IEEE International Conference on Technology for Homeland Security(HST)

[confproc] D. B. Megherbi / 2009 / An Intelligent Multi-agent Distributed Battlefield via Multi-Token Message Passing / Proceeding of IEEE International Conference on Computational Intelligence for Measurement Systems and Applications

[book] J. Soler / 2002 / Towards a Real-Time Multi-Agent System Architecture / Universidad Politécnica de Valencia

[report] B. Horling / 2002 / The Soft Real Time Agent Control Architecture / UMASS Department of Computer Science

[book] Stuart Russell / 2003 / Artificial Intelligence / Prentice Hall

[confproc] Xue Jinlin / 2010 / Reinforcement Learning for Engine Idle Speed Control / Proceeding of 2010International Conference on Measuring Technology and Mechatronics Automation (ICMTMA)

[confproc] D. B. Megherbi / 2010 / A hybrid P2P and master-slave architecture for intelligent multi-agent reinforcement learning in a distributed computing environment: A case study / Proceeding of IEEE International Conference, Computational Intelligence for Measurement Systems and Applications (CIMSA)

[confproc] M. Madera / 2012 / An Interconnected Dynamical System Composed of Dynamics-based Reinforcement Learning Agents in a Distributed Environment: A Case Study / Proceeding of IEEE International Conference on Computational Intelligence for Measurement Systems and Applications

[confproc] W. M. Zuberek / 2009 / Performance Limitations of Block-Multithread ed Distributed-Memory System / Proceeding of the Winter Simulation Conference(WSC)

[confproc] M. R Shaker / 2009 / Vision-based reinforcement learning using approximate policy iteration / Proceeding of 2009 International Conference

[journal] J. JIANG / 2008 / Multi-task Coalition Parallel Formation Strategy Based on Reinforcement Learning / Acta Automatica Sinica 34(3) : 349~352

[confproc] D. B. Megherbi / 2015 / A Collaborative Distributed Multi-Agent Reinforcement Learning Technique for Dynamic Agent Shortest Path Planning via Selected Sub-goals in Complex Cluttered Environments / Proceeding of IEEE Conference, CogSIMA

[journal] D. B. Megherbi / 2012 / A Hybrid Cognitive/Reactive Intelligent Agent Autonomous Path Planning Technique in a Networked-Distributed Unstructured Environment for Reinforcement Learning / The Journal of Supercomputing 59(3) : 1188~1217

[confproc] C. Picus / 2008 / Boltzmann Machine Topology Learning for Distributed Sensor Networks Using Loopy Belief Propagation Inference. Machine Learning and Applications / Proceeding of 2008th Seventh International Conference, ICMLA

[confproc] D. B. Megherbi / 2013 / A Study of Collaborative Distributed Multi-Goal and Multi-agent based Systems for Large Critical Key Infrastructures and Resources (CKIR) Dynamic Monitoring and Surveillance / Proceeding of IEEE International Conference on Technologies for Homeland Security

[journal] J. Kim / 2019 / Imitation Reinforcement Learning-Based Remote Rotary Inverted Pendulum Control in OpenFlow Network / IEEE Access 7

[other] A. Sharma / 2020 / DADS:Unsupervised Reinforcement Learning for Skill Discovery / Google Research at the Google Brain team and the Robotics at Google team

This paper was written with support from the National Research Foundation of Korea.

KJCKorea
Journal Central

Journal of The Korea Society of Computer and Information 2023 KCI Impact Factor : 0.65

A Study of Collaborative and Distributed Multi-agent Path-planning using Reinforcement Learning

ABSTRACT

KEYWORDS

Citation status

* References for papers published after 2023 are currently being built.

Journal of The Korea Society of Computer and Information 2023 KCI Impact Factor : 0.65

A Study of Collaborative and Distributed Multi-agent Path-planning using Reinforcement Learning

ABSTRACT

KEYWORDS

Statistics

Tools

Issue List

Citation status

KCI Citation Counts (1)

REFERENCES (19) * References for papers published after 2023 are currently being built.

Search PDF

Citation

* References for papers published after 2023 are currently being built.