본문 바로가기
  • Home

Implementation of Paper Keyboard Piano with a Kinect

  • Journal of The Korea Society of Computer and Information
  • Abbr : JKSCI
  • 2012, 17(12), pp.219-228
  • Publisher : The Korean Society Of Computer And Information
  • Research Area : Engineering > Computer Science

Jungchul Lee 1 김민성 1

1울산대학교

Accredited

ABSTRACT

In this paper, we propose a paper keyboard piano implementation using the finger movement detection with the 3D image data from a kinect. Keyboard pattern and keyboard depth information are extracted from the color image and depth image to detect the touch event on the paper keyboard and to identify the touched key. Hand region detection error is unavoidable when using the simple comparison method between input depth image and background depth image, and this error is critical in key touch detection. Skin color is used to minimize the error. And finger tips are detected using contour detection with area limit and convex hull. Finally decision of key touch is carried out with the keyboard pattern information at the finger tip position. The experimental results showed that the proposed method can detect key touch with high accuracy. Paper keyboard piano can be utilized for the easy and convenient interface for the beginner to learn playing piano with the PC-based learning software.

Citation status

* References for papers published after 2023 are currently being built.