본문 바로가기
  • Home

Sasang Constitution Classification using Convolutional Neural Network on Facial Images

  • Journal of Sasang Constitutional Medicine
  • Abbr : J Sasang Constitut Med
  • 2022, 34(3), pp.31-40
  • DOI : 10.7730/JSCM.2022.34.3.31
  • Publisher : The Society Of Sasang Constitutional Medicine
  • Research Area : Medicine and Pharmacy > Korean Medicine
  • Received : June 28, 2022
  • Accepted : August 10, 2022
  • Published : September 30, 2022

Ilkoo Ahn 1 Kim Sang-Hyuk 1 Kyoungsik Jeong 1 Hoseok Kim 1 Siwoo Lee 1

1한국한의학연구원

Accredited

ABSTRACT

Objectives Sasang constitutional medicine is a traditional Korean medicine that classifies humans into four constitutions in consideration of individual differences in physical, psychological, and physiological characteristics. In this paper, we proposed a method to classify Taeeum person (TE) and Non-Taeeum person (NTE), Soeum person (SE) and Non-Soeum person (NSE), and Soyang person (ST) and Non-Soyang person (NSY) using a convolutional neural network with only facial images. Methods Based on the convolutional neural network VGG16 architecture, transfer learning is carried out on the facial images of 3738 subjects to classify TE and NTE, SE and NSE, and SY and NSY. Data augmentation techniques are used to increase classification performance. Results The classification performance of TE and NTE, SE and NSE, and SY and NSY was 77.24%, 85.17%, and 80.18% by F1 score and 80.02%, 85.96%, and 72.76% by Precision-Recall AUC (Area Under the receiver operating characteristic Curve) respectively. Conclusions It was found that Soeum person had the most heterogeneous facial features as it had the best classification performance compared to the rest of the constitution, followed by Taeeum person and Soyang person. The experimental results showed that there is a possibility to classify constitutions only with facial images. The performance is expected to increase with additional data such as BMI or personality questionnaire.

Citation status

* References for papers published after 2022 are currently being built.