@article{ART003397359},
author={Jongchan Lee and Junha Hwang and Young-Seob Jeong},
title={Pretrained Model for Civil Complaint Classification},
journal={Journal of The Korea Society of Computer and Information},
issn={1598-849X},
year={2026},
volume={31},
number={10},
pages={37-45}
TY - JOUR
AU - Jongchan Lee
AU - Junha Hwang
AU - Young-Seob Jeong
TI - Pretrained Model for Civil Complaint Classification
JO - Journal of The Korea Society of Computer and Information
PY - 2026
VL - 31
IS - 10
PB - The Korean Society Of Computer And Information
SP - 37
EP - 45
SN - 1598-849X
AB - With the expansion of online administrative services and the growing volume of civil complaints, automated complaint classification has become increasingly important. However, previous studies have mainly focused on fine-tuning general-purpose language models using labeled data, while the effectiveness of Domain-Adaptive Pretraining (DAPT) using large-scale unlabeled Korean civil complaint and administrative corpora has not been sufficiently investigated. In this study, we constructed a corpus of approximately 137.9 million tokens and applied MLM-based DAPT to A.X-Encoder-base. We also constructed a civil complaint classification dataset consisting of 116,042 queries across 17 categories and compared performance according to the application of DAPT and different training configurations under identical conditions. Experimental results showed that the model trained for 1.25 epochs at a learning rate of 1×10⁻⁴ achieved an accuracy of 73.4% and a Macro F1 score of 72.5%, improving upon the base model by 0.4 and 0.3 percentage points, respectively. These results suggest the importance of domain adaptation in the civil complaint domain.
KW - Korean Civil Complaint Classification;Domain-Adaptive Pretraining;Korean Language Models;Masked Language Modeling;Domain-Specific Language Models
DO -
UR -
ER -
Jongchan Lee, Junha Hwang and Young-Seob Jeong. (2026). Pretrained Model for Civil Complaint Classification. Journal of The Korea Society of Computer and Information, 31(10), 37-45.
Jongchan Lee, Junha Hwang and Young-Seob Jeong. 2026, "Pretrained Model for Civil Complaint Classification", Journal of The Korea Society of Computer and Information, vol.31, no.10 pp.37-45.
Jongchan Lee, Junha Hwang, Young-Seob Jeong "Pretrained Model for Civil Complaint Classification" Journal of The Korea Society of Computer and Information 31.10 pp.37-45 (2026) : 37.
Jongchan Lee, Junha Hwang, Young-Seob Jeong. Pretrained Model for Civil Complaint Classification. 2026; 31(10), 37-45.
Jongchan Lee, Junha Hwang and Young-Seob Jeong. "Pretrained Model for Civil Complaint Classification" Journal of The Korea Society of Computer and Information 31, no.10 (2026) : 37-45.
Jongchan Lee; Junha Hwang; Young-Seob Jeong. Pretrained Model for Civil Complaint Classification. Journal of The Korea Society of Computer and Information, 31(10), 37-45.
Jongchan Lee; Junha Hwang; Young-Seob Jeong. Pretrained Model for Civil Complaint Classification. Journal of The Korea Society of Computer and Information. 2026; 31(10) 37-45.
Jongchan Lee, Junha Hwang, Young-Seob Jeong. Pretrained Model for Civil Complaint Classification. 2026; 31(10), 37-45.
Jongchan Lee, Junha Hwang and Young-Seob Jeong. "Pretrained Model for Civil Complaint Classification" Journal of The Korea Society of Computer and Information 31, no.10 (2026) : 37-45.
