본문 바로가기
  • Home

Divide and Conquer Strategy for CNN model in Facial Emotion Recognition based on Thermal Images

  • Journal of Software Assessment and Valuation
  • Abbr : JSAV
  • 2021, 17(2), pp.1-10
  • DOI : 10.29056/jsav.2021.12.01
  • Publisher : Korea Software Assessment and Valuation Society
  • Research Area : Engineering > Computer Science
  • Received : November 12, 2021
  • Accepted : December 20, 2021
  • Published : December 31, 2021

Lee Donghwan 1 Jang-Hee Yoo 2

1과학기술연합대학원대학교
2한국전자통신연구원

Accredited

ABSTRACT

The ability to recognize human emotions by computer vision is a very important task, with many potential applications. Therefore the demand for emotion recognition using not only RGB images but also thermal images is increasing. Compared to RGB images, thermal images has the advantage of being less affected by lighting conditions but require a more sophisticated recognition method with low-resolution sources. In this paper, we propose a Divide and Conquer-based CNN training strategy to improve the performance of facial thermal image-based emotion recognition. The proposed method first trains to classify difficult-to-classify similar emotion classes into the same class group by confusion matrix analysis and then divides and solves the problem so that the emotion group classified into the same class group is recognized again as actual emotions. In experiments, the proposed method has improved accuracy in all the tests than when recognizing all the presented emotions with a single CNN model.

Citation status

* References for papers published after 2023 are currently being built.