Design and Implementation of Emergency Recognition System based on Multimodal Information

김영운; Kang Sun-Kyung; 소인미; 권대규; Sang Seol. Lee; Yong-Ju Lee; Jung， Sung-Tae

Journal of The Korea Society of Computer and Information

Abbr : JKSCI
2009, 14(2), pp.181-190
Publisher : The Korean Society Of Computer And Information
Research Area : Computer Science

김영운 ¹ , Kang Sun-Kyung ² , 소인미 ³ , 권대규 ⁴ , Sang Seol. Lee ⁵ , Yong-Ju Lee ⁶ , Jung， Sung-Tae ⁷

¹ 원광대학교
² 원광대학교
³ 원광대학교
⁴ 전북대학교
⁵ 원광대학교
⁶ 원광대학교
⁷ 원광대학교

ABSTRACT

This paper presents a multimodal emergency recognition system based on visual information, audio information and gravity sensor information. It consists of video processing module, audio processing module, gravity sensor processing module and multimodal integration module. The video processing module and gravity sensor processing module respectively detects actions such as moving, stopping and fainting and transfer them to the multimodal integration module. The multimodal integration module detects emergency by fusing the transferred information and verifies it by asking a question and recognizing the answer via audio channel. The experiment results show that the recognition rate of video processing module only is 91.5% and that of gravity sensor processing module only is 94%, but when both information are combined the recognition result becomes 100%.
KEYWORDS

Emergency Recognition , Multimodal Information , Gravity Sensor , Faint Recognition
REFERENCES (24)

[journal] J. K. Aggarwal / 1999 / Human Motion Analysis: A Review / Computer Vision and Image Understand 73 (3) : 428~440

[journal] C. Rigotti / 2001 / Modeling and Driving a Reduced Human Mannequin through Motion Captured Data: A Neural Network Approach / IEEE Trans. on System, Man, and Cybernetics-part A 31 (3) : 187~193

[confproc] Y. B. Lee / 2007 / Implementation of Accelerometer Sensor Module and Fall Detection Monitoring System based on Wireless Sensor Network / Annual International Conference of the IEEE Engineering in Medicine and Biology Society : 2315~2318

[confproc] M. R. Narayanan / 2007 / Falls Management: Detection and Prevention, using a Waist-mounted Triaxial Accelerometer / Annual International Conference of the IEEE Engineering in Medicine and Biology Society : 4037~4040

[journal] M. Kangas / 2007 / Determination of simple thresholds for accelerometry-based parameters for fall detection / Annual International Conference of the IEEE Engineering in Medicine and Biology Society : 1367~1370

[confproc] F. R. Allen / 2006 / An Adapted Gaussian Mixture Model Approach to Accelerometry-Based Movement Classification Using Time-Domain Features / Annual International Conference of the IEEE Engineering in Medicine and Biology Society : 3600~3603

[journal] A. Sixsmith / 2004 / A smart sensor to detect the falls of the elderly / IEEE Pervasive Computing 3 (2) : 42~47

[confproc] M. Alwan / 2006 / A Smart and Passive Floor-Vibration Based Fall Detector for Elderly / Proceedings of Internaltional Conference on Information and Communication Technologies : 1003~1007

[confproc] C. Rougier / 2006 / J. Rousseau, "Monocular 3D Head Tracking to Detect Falls of Elderly People / International Conference of the IEEE Engineering in Medicine and Biology Society : 6384~6387

[confproc] C. Rougier / 2007 / Fall Detection from Human Shape and Motion History Using Video Surveillance / International Conference on Advanced Information Networking and Applications Workshops(AINAW '07 : 875~880

[confproc] B. Jansen / 2006 / Context aware inactivity recognition for visual fall detection / Pervasive Health Conference and Workshops : 1~4

[confproc] N. Thome / 2006 / A HHMM-Based Approach for Robust Fall Detection / International Conference on Control, Automation, Robotics and Vision : 1~8

[confproc] D. Anderson / 2006 / Recognizing Falls from Silhouettes / Annual International Conference of the IEEE Engineering in Medicine and Biology Society : 6388~6391

[journal] H. Nait-Charif / 2004 / Activity summarisation and fall detection in a supportive home environment / In Proceedings of the 17th International Conference on Pattern Recognition(ICPR) : 323~326

[confproc] S.-G. Miaou / 2006 / A Customized Human Fall Detection System Using Omni-Camera Images and Personal Information / Proc. of Distributed Diagnosis and Home Healthcare(D2H2) Conference : 39~42

[journal] M.-L. Wang / 2006 / An Intelligent Surveillance System Based on an Omnidirectional Vision Sensor / IEEE Conference on Cybernetics and Intelligent Systems : 1~6

[journal] 소인미 / 2008 / Development of a Fall Detection System Using Fish-eye Lens Camera / 한국컴퓨터정보학회논문지 / 한국컴퓨터정보학회 13 (4) : 97~104

[journal] 김영운 / 2008 / 멀티모달 정보를 이용한 응급상황 인식 시스템 / 대한전자공학회 하계학술대회 6 : 757~758

[confproc] C. Stauffer / 1999 / Adaptive background mixture models for real-time tracking / IEEE Computer Society Conference on Computer Vision and Pattern Recognition : 246~252

[book] R. Crane / 1997 / A simplified approach to image processing / Prentice Hall

[book] I. Pitas / 2000 / Digital Image Processing schemes and Application / John Wiley and Sons Inc.

[journal] A. Fitzgibbon / 1999 / Direct least square fitting of ellipses / IEEE Transactions on Pattern Analysis and Machine Intelligence 21 (5) : 476~480

[journal] 이동규 / 2006 / Human Behavior Analysis and Remote Emergency Detection System Using the Neural Network / 한국콘텐츠학회 논문지 / 한국콘텐츠학회 6 (9) : 50~59

[journal] 소인미 / 2006 / Development of a Vision Based Fall Detection System For Healthcare / 한국컴퓨터정보학회논문지 / 한국컴퓨터정보학회 11 (6) : 279~288
KCI Citation (1)

KJC Korea
Journal Central

Statistics

Tools