본문 바로가기
  • Home

Retained Message Delivery Scheme utilizing Reinforcement Learning in MQTT-based IoT Networks

  • Journal of Internet of Things and Convergence
  • Abbr : JKIOTS
  • 2024, 10(2), pp.131-135
  • Publisher : The Korea Internet of Things Society
  • Research Area : Engineering > Computer Science > Internet Information Processing
  • Received : February 24, 2024
  • Accepted : March 22, 2024
  • Published : April 30, 2024

Yeunwoong Kyung 1 KIM, TAEKOOK 2 Youngjun Kim 3

1공주대학교
2국립부경대학교
3경남대학교

Accredited

ABSTRACT

In the MQTT protocol, if the retained flag of a message published by a publisher is set, the message is stored in the broker as a retained message. When a new subscriber performs a subscribe, the broker immediately sends the retained message. This allows the new subscriber to perform updates on the current state via the retained message without waiting for new messages from the publisher. However, sending retained messages can become a traffic overhead if new messages are frequently published by the publisher. This situation could be considered an overhead when new subscribers frequently subscribe. Therefore, in this paper, we propose a retained message delivery scheme by considering the characteristics of the published messages. We model the delivery and waiting actions to new subscribers from the perspective of the broker using reinforcement learning, and determine the optimal policy through Q learning algorithm. Through performance analysis, we confirm that the proposed method shows improved performance compared to existing methods

Citation status

* References for papers published after 2023 are currently being built.

This paper was written with support from the National Research Foundation of Korea.