본문 바로가기
  • Home

Researching NUI-type experiential training with handtracking

  • Journal of The Korea Society of Computer and Information
  • Abbr : JKSCI
  • 2025, 30(11), pp.115~124
  • Publisher : The Korean Society Of Computer And Information
  • Research Area : Engineering > Computer Science
  • Received : October 15, 2025
  • Accepted : November 17, 2025
  • Published : November 28, 2025

Kwang Hyuk Im 1 HongDae Kim 2 SeokHun Kim 1

1배재대학교
2(주)라이크잇

Accredited

ABSTRACT

This study proposes an immersive education and training system based on a Natural User Interface (NUI) utilizing hand tracking technology. Existing XR (eXtended Reality) educational content has faced limitations in immersion and realism due to its controller-input-centric interaction structure. This study directly recognizes hand gestures, eliminating the physical mediation between the user and the system, thereby implementing a more intuitive and natural interaction environment. The research methodology consists of analyzing educational training procedures and defining learning objectives, designing a hand-tracking-based gesture recognition interface, implementing an NUI-type immersive learning system, and conducting experimental validation. Hand-tracking-based NUI is expected to show improved results compared to existing input methods in terms of learner motion accuracy, response feedback, and immersion. This research holds significance as core foundational work for a non-contact, immersive education platform applicable across diverse fields such as XR industry, military, medical, and machinery maintenance training.

Citation status

* References for papers published after 2024 are currently being built.

This paper was written with support from the National Research Foundation of Korea.