Efficient Mobile Writing System with Korean Input Interface Based on Face Recognition (안면 인식 기반의 한국어 입력 인터페이스를 통한 효율적인 모바일 필기 시스템)

Jong-Hyun Kim (김종현)

doi:10.9708/jksci.2020.25.06.049

Efficient Mobile Writing System with Korean Input Interface Based on Face Recognition

Journal of The Korea Society of Computer and Information
Abbr : JKSCI
2020, 25(6), pp.49-56
DOI : 10.9708/jksci.2020.25.06.049
Publisher : The Korean Society Of Computer And Information
Research Area : Engineering > Computer Science
Received : April 20, 2020
Accepted : June 1, 2020
Published : June 30, 2020

Jong-Hyun Kim ¹

¹강남대학교

Accredited

ABSTRACT

The virtual Korean keyboard system is a method of inputting characters by touching a fixed position. This system is very inconvenient for people who have difficulty moving their fingers. To alleviate this problem, this paper proposes an efficient framework that enables keyboard input and handwriting through video and user motion obtained through the RGB camera of the mobile device. To develop this system, we use face recognition to calculate control coordinates from the input video, and develop an interface that can input and combine Hangul using this coordinate value. The control position calculated based on face recognition acts as a pointer to select and transfer the letters on the keyboard, and finally combines the transmitted letters to integrate them to perform the Hangul keyboard function. The result of this paper is an efficient writing system that utilizes face recognition technology, and using this system is expected to improve the communication and special education environment for people with physical disabilities as well as the general public.

KEYWORDS

RGB camera, Mobile device, Face recognition, Korean input interface, Korean keyboard system, Special education environment

Citation status

* References for papers published after 2023 are currently being built.

[confproc] S. E. Park / 1994 / An Input Method for Hangul Character and Implementation for Personal Digital Assistant / Proc. of Fall Conference of KIISE 21(2) : 657~660

[other] W. H. Choi / 1999 / Apparatus and Method for Inputting the Korean Alphabet Based on the Character-Generative Principles of HUNMINJUNGEUM, Patent no. 1999-052648

[other] J. W. Kim / Apparatus for Inputting Key and Method for Inputting Character by Direction Key, Patent no. 2001-0006208 : 2001~

[web] / Share-typing / https://www.sharetyping.com/

[journal] 강승식 / 2005 / Hangul Vowel Input System for Electronic Networking Devices / 정보처리학회 논문지 / 한국정보처리학회 12(4) : 507~512

[journal] 엄태정 / 2012 / Design of Smart Phone-Based Braille Keyboard System for Visually Impaired People / 융합보안 논문지 / 한국융합보안학회 12(1) : 63~70

[report] Y. C. Byun / 2012 / 2011 Survey on Impaired People

[thesis] 김현영 / 2011 / Keyboard 삽입 형 IR 모듈을 이용한 제스처 인식 기반 인터페이스 / 석사 / 한국과학기술원

[confproc] D. H. Kim / 2005 / A Hangul Input Interface Using Continuous Gestures and Language Models / Proc. of KCC2005 : 586~588

[confproc] Won Il Lee / 2005 / Natural Language Processing for Korean Speech Recognition / Proc. of KCC2005 : 586~588

[journal] Sang Hun Jeong / 2007 / The Study on Phonetical Information for Speech Recognition, The Contents and Language Phenomena of Seokbosangjeol 49 : 135~160

[web] / Keyboard for Android / http://swypeinc.com/

[confproc] Jared Cechanowicz / 2006 / Stylus based text input using expanding CIRRIN / AVI '06

[confproc] Gennaro Costagliola / 2009 / Performances of Multiple-Selection Enabled Menus in Soft Keyboards / DMS'09 - The 15th International Conference on Distributed Multimedia Systems : 359~364

[confproc] Amberkar, Aditya / 2018 / Speech Recognition using Recurrent Neural Networks / International Conference on Current Trends towards Converging Technologies : 1~4

[confproc] Lim, Chee Peng / 2000 / Speech recognition using artificial neural networks / Proceedings of the First International Conference on Web Information Systems Engineering 1 : 419~423

[confproc] Graves, Alex / 2013 / Hybrid speech recognition with deep bidirectional LSTM / IEEE workshop on automatic speech recognition and understanding : 273~278

[confproc] Sundermeyer, Martin / 2012 / LSTM neural networks for language modeling / Thirteenth annual conference of the international speech communication association

[journal] 경왕준 / 2014 / Enhancement of Faded Images Using Integrated Compensation Coefficients Based on Multi-Scale Gray World Algorithm / 한국통신학회논문지 / 한국통신학회 39(8) : 459~466

[other] Schneider, Steffen / 2019 / wav2vec: Unsupervised pre-training for speech recognition / arXiv preprint arXiv:1904.05862

[other] Tian, Xu / 2017 / Deep LSTM for large vocabulary continuous speech recognition / arXiv preprint arXiv : 1703. 07090

[confproc] Sriram, Anuroop / 2017 / Robust speech recognition using generative adversarial networks / 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) : 5639~5643

KJCKorea
Journal Central

Journal of The Korea Society of Computer and Information 2023 KCI Impact Factor : 0.65

Efficient Mobile Writing System with Korean Input Interface Based on Face Recognition

ABSTRACT

KEYWORDS

Citation status

* References for papers published after 2023 are currently being built.

Journal of The Korea Society of Computer and Information 2023 KCI Impact Factor : 0.65

Efficient Mobile Writing System with Korean Input Interface Based on Face Recognition

ABSTRACT

KEYWORDS

Statistics

Tools

Issue List

Citation status

KCI Citation Counts (0)

REFERENCES (22) * References for papers published after 2023 are currently being built.

Search PDF

Citation

* References for papers published after 2023 are currently being built.