@article{ART003132624},
author={Noyoon Kwak},
title={A Study on Hand-Face Hybrid Gesture Interface Using MediaPipe Models},
journal={Journal of Internet of Things and Convergence},
issn={2466-0078},
year={2024},
volume={10},
number={5},
pages={1-11}
TY - JOUR
AU - Noyoon Kwak
TI - A Study on Hand-Face Hybrid Gesture Interface Using MediaPipe Models
JO - Journal of Internet of Things and Convergence
PY - 2024
VL - 10
IS - 5
PB - The Korea Internet of Things Society
SP - 1
EP - 11
SN - 2466-0078
AB - This paper describes a hybrid gesture interface based on MediaPipe that recognizes facial gestures and hand gestures using the MediaPipe Hands model and MediaPipe Face Mesh model, and then combines them. First, the presence of hands and faces is determined by individually detecting 3D hand landmarks of MediaPipe Hands model and 3D face landmarks of MediaPipe Face Mesh model from camera input frames, and then the face cursor position and face gestures, as well as the hand cursor position and hand gestures are recognized. Then, these are mixed in a user-friendly way to implement a user interface based on hand-face hybrid gestures. The proposed hand-face hybrid gesture interface based on MediaPipe has the advantage that the gesture mode is set to either the hand or the face, but the interface can be controlled freely using the face and hands without additional gestures for mode switching. In addition, the practicality and usefulness of the proposed hand-face hybrid gesture interface were confirmed through software operation experiments in Windows environment.
KW - Hybrid Gesture Interface;Facial Gesture Recognition;Hand Gesture Recognition;MediaPipe;NUI
DO -
UR -
ER -
Noyoon Kwak. (2024). A Study on Hand-Face Hybrid Gesture Interface Using MediaPipe Models. Journal of Internet of Things and Convergence, 10(5), 1-11.
Noyoon Kwak. 2024, "A Study on Hand-Face Hybrid Gesture Interface Using MediaPipe Models", Journal of Internet of Things and Convergence, vol.10, no.5 pp.1-11.
Noyoon Kwak "A Study on Hand-Face Hybrid Gesture Interface Using MediaPipe Models" Journal of Internet of Things and Convergence 10.5 pp.1-11 (2024) : 1.
Noyoon Kwak. A Study on Hand-Face Hybrid Gesture Interface Using MediaPipe Models. 2024; 10(5), 1-11.
Noyoon Kwak. "A Study on Hand-Face Hybrid Gesture Interface Using MediaPipe Models" Journal of Internet of Things and Convergence 10, no.5 (2024) : 1-11.
Noyoon Kwak. A Study on Hand-Face Hybrid Gesture Interface Using MediaPipe Models. Journal of Internet of Things and Convergence, 10(5), 1-11.
Noyoon Kwak. A Study on Hand-Face Hybrid Gesture Interface Using MediaPipe Models. Journal of Internet of Things and Convergence. 2024; 10(5) 1-11.
Noyoon Kwak. A Study on Hand-Face Hybrid Gesture Interface Using MediaPipe Models. 2024; 10(5), 1-11.
Noyoon Kwak. "A Study on Hand-Face Hybrid Gesture Interface Using MediaPipe Models" Journal of Internet of Things and Convergence 10, no.5 (2024) : 1-11.
