@article{ART003076615},
author={Yeunwoong Kyung and KIM, TAEKOOK and Youngjun Kim},
title={Retained Message Delivery Scheme utilizing Reinforcement Learning in MQTT-based IoT Networks},
journal={Journal of Internet of Things and Convergence},
issn={2466-0078},
year={2024},
volume={10},
number={2},
pages={131-135}
TY - JOUR
AU - Yeunwoong Kyung
AU - KIM, TAEKOOK
AU - Youngjun Kim
TI - Retained Message Delivery Scheme utilizing Reinforcement Learning in MQTT-based IoT Networks
JO - Journal of Internet of Things and Convergence
PY - 2024
VL - 10
IS - 2
PB - The Korea Internet of Things Society
SP - 131
EP - 135
SN - 2466-0078
AB - In the MQTT protocol, if the retained flag of a message published by a publisher is set, the message is stored in the broker as a retained message. When a new subscriber performs a subscribe, the broker immediately sends the retained message. This allows the new subscriber to perform updates on the current state via the retained message without waiting for new messages from the publisher.
However, sending retained messages can become a traffic overhead if new messages are frequently published by the publisher. This situation could be considered an overhead when new subscribers frequently subscribe. Therefore, in this paper, we propose a retained message delivery scheme by considering the characteristics of the published messages. We model the delivery and waiting actions to new subscribers from the perspective of the broker using reinforcement learning, and determine the optimal policy through Q learning algorithm. Through performance analysis, we confirm that the proposed method shows improved performance compared to existing methods
KW - MQTT;Retained Message;Reinforcement Learning;Q Learning;Optimal Policy
DO -
UR -
ER -
Yeunwoong Kyung, KIM, TAEKOOK and Youngjun Kim. (2024). Retained Message Delivery Scheme utilizing Reinforcement Learning in MQTT-based IoT Networks. Journal of Internet of Things and Convergence, 10(2), 131-135.
Yeunwoong Kyung, KIM, TAEKOOK and Youngjun Kim. 2024, "Retained Message Delivery Scheme utilizing Reinforcement Learning in MQTT-based IoT Networks", Journal of Internet of Things and Convergence, vol.10, no.2 pp.131-135.
Yeunwoong Kyung, KIM, TAEKOOK, Youngjun Kim "Retained Message Delivery Scheme utilizing Reinforcement Learning in MQTT-based IoT Networks" Journal of Internet of Things and Convergence 10.2 pp.131-135 (2024) : 131.
Yeunwoong Kyung, KIM, TAEKOOK, Youngjun Kim. Retained Message Delivery Scheme utilizing Reinforcement Learning in MQTT-based IoT Networks. 2024; 10(2), 131-135.
Yeunwoong Kyung, KIM, TAEKOOK and Youngjun Kim. "Retained Message Delivery Scheme utilizing Reinforcement Learning in MQTT-based IoT Networks" Journal of Internet of Things and Convergence 10, no.2 (2024) : 131-135.
Yeunwoong Kyung; KIM, TAEKOOK; Youngjun Kim. Retained Message Delivery Scheme utilizing Reinforcement Learning in MQTT-based IoT Networks. Journal of Internet of Things and Convergence, 10(2), 131-135.
Yeunwoong Kyung; KIM, TAEKOOK; Youngjun Kim. Retained Message Delivery Scheme utilizing Reinforcement Learning in MQTT-based IoT Networks. Journal of Internet of Things and Convergence. 2024; 10(2) 131-135.
Yeunwoong Kyung, KIM, TAEKOOK, Youngjun Kim. Retained Message Delivery Scheme utilizing Reinforcement Learning in MQTT-based IoT Networks. 2024; 10(2), 131-135.
Yeunwoong Kyung, KIM, TAEKOOK and Youngjun Kim. "Retained Message Delivery Scheme utilizing Reinforcement Learning in MQTT-based IoT Networks" Journal of Internet of Things and Convergence 10, no.2 (2024) : 131-135.