본문 바로가기
  • Home

A Multi-modal Interaction Glove for Immersive Education

  • Journal of Knowledge Information Technology and Systems
  • Abbr : JKITS
  • 2015, 10(6), pp.619-626
  • Publisher : Korea Knowledge Information Technology Society
  • Research Area : Interdisciplinary Studies > Interdisciplinary Research
  • Published : December 31, 2015

Choi Dong-Soo 1 SangKyu Byeon 1 Sang-Youn Kim 1 - 1

1한국기술교육대학교

Accredited

ABSTRACT

The virtual reality systems may be used as a new educational tool because a user can be provided immersive sensation as he/she experiences a real object. One of the most important factors in developing educational tool based on virtual reality is to make a user naturally interact with a target object and to convey the sense of reality to a user. The sense of the reality means that a user feels or experiences an object in virtual world as the object exists in real world. In order to increase the sense of the reality, this paper addresses a multimodal interface device that allows a user not only to naturally interact with virtual objects but also to sense graphic and haptic feedback according to his/her interaction. The proposed system measures a user’s motion based on IMU (an inertia measurement unit) and then re-creates haptic feedback by the proposed multimodal interface device. To generate the haptic feedback in response to user’s interaction with virtual objects, our system consists of a haptic part for creating haptic information, a motion sensing part to measure user’s motion input, and a virtual environment part. We have also implemented educational contents in the virtual environment and have manipulated the educational contents with the proposed multimodal interaction device.

Citation status

* References for papers published after 2023 are currently being built.