Home > Explore Content > All Issues > Article View
Implementation of Paper Keyboard Piano with a Kinect
Journal of The Korea Society of Computer and Information
Abbr :
JKSCI
2012, 17(12), pp.219-228
Publisher : The Korean Society Of Computer And Information
Research Area : Computer Science
2012, 17(12), pp.219-228
Publisher : The Korean Society Of Computer And Information
Research Area : Computer Science
-
In this paper, we propose a paper keyboard piano implementation using the finger movement detection with the 3D image data from a kinect. Keyboard pattern and keyboard depth information are extracted from the color image and depth image to detect the touch event on the paper keyboard and to identify the touched key. Hand region detection error is unavoidable when using the simple comparison method between input depth image and background depth image, and this error is critical in key touch detection. Skin color is used to minimize the error. And finger tips are detected using contour detection with area limit and convex hull. Finally decision of key touch is carried out with the keyboard pattern information at the finger tip position. The experimental results showed that the proposed method can detect key touch with high accuracy. Paper keyboard piano can be utilized for the easy and convenient interface for the beginner to learn playing piano with the PC-based learning software.
325 Viewed
Print this page
Download PDF