본문 바로가기
  • Home

Developing an Argument-Structure–Based Chatbot PoC to Enhance the Intelligence of Archival Information Services and Validating through a Two-Phase Evaluation

  • Journal of Korean Society of Archives and Records Management
  • Abbr : JRMASK
  • 2026, 26(1), pp.59~79
  • DOI : 10.14404/JKSARM.2026.26.1.059
  • Publisher : Korean Society of Archives and Records Management
  • Research Area : Interdisciplinary Studies > Library and Information Science > Archival Studies / Conservation
  • Received : January 12, 2026
  • Accepted : February 20, 2026
  • Published : February 28, 2026

Choi You-Ree 1 Oh Hyo-Jung 2

1전북대학교 기록관리학과 석사과정
2전북대학교 문헌정보학과 교수, 문화융복합아카이빙연구소 공통연구원

Accredited

ABSTRACT

As generative AI has popularized natural language–based conversational interfaces, chatbot services have gained attention as an intelligent alternative to single-turn, keyword-based searches in archival information services. This study implements an intelligent archival information service chatbot Proof of Concept (PoC) based on a previously established question-type classification framework and examines its applicability in archival institutions. The chatbot was developed with five response stabilization rules. Performance was evaluated through quantitative assessment using 50 test queries and qualitative focus group interviews (FGIs) with 3 records management professionals. Results showed 96% accuracy in question-type classification and 84% in sentence structure appropriateness. Qualitative findings indicated suitability for handling repetitive inquiries in public institutions and potential use as a preliminary guidance tool prior to filing an information disclosure request. Based on dual evaluations, four improvement directions were identified: question-type refinement, linguistic rule enhancement, complex sentence handling advancement, and task-data integration expansion. This study presents an empirical model for archival chatbot development by implementing a question-type–based response structure in an actual system environment and validating its functionality and performance through dual quantitative and qualitative evaluations.

Citation status

* References for papers published after 2024 are currently being built.

This paper was written with support from the National Research Foundation of Korea.