Leap Motion Framework for Juggling Motion According to User Motion in Virtual Environment (가상환경에서 사용자 동작에 따른 저글링 모션을 하기 위한 립모션 프레임워크)

Jong-Hyun Kim (김종현)

doi:10.9708/jksci.2021.26.11.051

Leap Motion Framework for Juggling Motion According to User Motion in Virtual Environment

Journal of The Korea Society of Computer and Information
Abbr : JKSCI
2021, 26(11), pp.51-57
DOI : 10.9708/jksci.2021.26.11.051
Publisher : The Korean Society Of Computer And Information
Research Area : Engineering > Computer Science
Received : August 17, 2021
Accepted : October 12, 2021
Published : November 30, 2021

Jong-Hyun Kim ¹

¹강남대학교

Accredited

ABSTRACT

In this paper, we propose a new framework that calculates the user's hand motions using a Leap Motion device, and uses this to practice and analyze arm muscles as well as juggling motions. The proposed method can map the movement of the ball in a virtual environment according to the user's hand motions in real time, and analyze the amount of exercise by visualizing the relaxation and contraction of the muscles. The proposed framework consists of three main parts : 1) It tracks the user's hand position with the Leap Motion device. 2) As with juggling, the action pattern of the user throwing the ball is defined as an event. 3) We propose a parabola-based particle method to map the movement of a juggling shape to a ball based on the user's hand position. As a result, using the our framework, it is possible to play a juggling game in real-time.

KEYWORDS

Leap Motion device, Hand motion, Arm muscles, Virtual environment, Juggling motion

Citation status

* References for papers published after 2023 are currently being built.

[confproc] S. I. Park / 2008 / Data-driven modeling of skin and muscle deformation / ACM SIGGRAPH 2008 1(6) : 1~6

[journal] S. Lee / 2019 / Scalable muscleactuated human simulation and control / ACM Transactions on Graphics(TOG) 38(4) : 1~13

[journal] M. Romeo / 2020 / Muscle and fascia simulation with extended position based dynamics / Computer Graphics Forum 39(1) : 134~146

[journal] R. Yu / 2019 / Figure skating simulation from video / Computer graphics forum 38(7) : 225~234

[confproc] P. Khungurn / 2016 / Pose estimation of anime/manga characters: a case for synthetic data / Proceedings of the 1st International Workshop on coMics ANalysis, Processing and Understanding : 1~6

[confproc] J. Chemin / 2018 / A physics-based juggling simulation using reinforcement learning / Proceedings of the 11th Annual International Conference on Motion, Interaction, and Games : 1~7

[other] L. Kumarapu / 2020 / Animepose : Multiperson 3d pose estimation and animation / arXiv preprint arXiv:2002.02792

[journal] J. Won / 2019 / Learning body shape variation in physicsbased characters / ACM Transactions on Graphics(TOG) 38(6) : 1~12

[other] M. Sra / 2015 / Metaspace ii: Object and full-body tracking for interaction and navigation in social vr / arXiv preprint arXiv:1512.02922

[confproc] L. E. Potter / 2013 / The leap motion controller:a view on sign language / Proceedings of the 25th Australian computer-human interaction conference: augmentation, application, innovation, collaboration : 175~178

[journal] J.-I. Choi / 2016 / Let’s be a virtual juggler / Computer Animation and Virtual Worlds 27(3-4) : 443~450

[journal] D. G. Thelen / 2003 / Adjustment of muscle mechanics model parameters to simulate dynamic contractions in older adults / J. Biomech. Eng 125(1) : 70~77

[journal] S. -H. Lee / 2009 / Comprehensive biomechanical modeling and simulation of the upper body / ACM Transactions on Graphics(TOG) 28(4) : 1~17

[journal] W. Si / 2014 / Realistic biomechanical simulation and control of human swimming / ACM Transactions on Graphics(TOG) 34(1) : 1~15

[journal] Y. Fan / 2014 / Active volumetric musculoskeletal systems / ACM Transactions on Graphics(TOG) 33(4) : 1~9

[journal] O. Arikan / 2002 / Interactive motion generation from examples / ACM Transactions on Graphics(TOG) 21(3) : 483~490

[journal] D. Holden / 2016 / A deep learning framework for character motion synthesis and editing / ACM Transactions on Graphics(TOG) 35(4) : 1~11

[journal] D. Holden / 2017 / Phase-functioned neural networks for character control / ACM Transactions on Graphics(TOG) 36(4) : 1~13

[confproc] S. Clavet / 2016 / Motion matching and the road to next-gen animation / Proc. of GDC

[journal] M. Da Silva / 2008 / Simulation of human motion data using short-horizon model-predictive control / Computer Graphics Forum 27(2) : 371~380

[journal] D. Han / 2016 / Data-guided model predictive control based on smoothed contact dynamics / Computer Graphics Forum 35(2) : 533~543

[journal] L. Liu / 2016 / Guided learning of control graphs for physics-based characters / ACM Transactions on Graphics 35(3)

[confproc] S. Barrett / 2010 / Controlled kicking under uncertainty / The Fifth Workshop on Humanoid Soccer Robots at Humanoids

[confproc] T. Hester / 2010 / Generalized model learning for reinforcement learning on a humanoid robot / 2010 IEEE International Conference on Robotics and Automation : 2369~2374

[confproc] S. Jain / 2009 / Interactive synthesis of humanobject interaction / Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation : 47~53

[journal] J.-I. Choi / 2015 / Virtual ball player / The Visual Computer 31(6-8) : 905~914

[confproc] K. Ding / 2015 / Learning reduced-order feedback policies for motion skills / Proceedings of the 14th ACM SIGGRAPH/Eurographics Symposium on Computer Animation : 83~92

This paper was written with support from the National Research Foundation of Korea.

KJCKorea
Journal Central

Journal of The Korea Society of Computer and Information 2023 KCI Impact Factor : 0.65

Leap Motion Framework for Juggling Motion According to User Motion in Virtual Environment

ABSTRACT

KEYWORDS

Citation status

* References for papers published after 2023 are currently being built.

Journal of The Korea Society of Computer and Information 2023 KCI Impact Factor : 0.65

Leap Motion Framework for Juggling Motion According to User Motion in Virtual Environment

ABSTRACT

KEYWORDS

Statistics

Tools

Issue List

Citation status

KCI Citation Counts (0)

REFERENCES (27) * References for papers published after 2023 are currently being built.

Search PDF

Citation

* References for papers published after 2023 are currently being built.