본문 바로가기
  • Home
Basic Search

Test Set Construction for Quality Evaluation of NAK Portal’s Search Service and the Status Analysis

  • Journal of Korean Society of Archives and Records Management
  • Abbr : JRMASK
  • 2022, 22(4), pp.25~43
  • DOI : 10.14404/JKSARM.2022.22.4.025
  • Publisher : Korean Society of Archives and Records Management
  • Research Area : Interdisciplinary Studies > Library and Information Science > Archival Studies / Conservation
  • Received : October 17, 2022
  • Accepted : November 8, 2022
  • Published : November 30, 2022

Na Jeong Ho 1,  Hyeon-Gi So 1,  Gyung Rok Yeom 2,  Jung-Ok Lee 3,  Hyo-Jung Oh 1

1전북대학교
2㈜ 아이와즈, 솔루션개발팀장
3국가기록원

Accredited

ABSTRACT

The ultimate record management’s purpose is preservation and utilization. However, the National Archives of Korea (NAK)s Portal has problems such as search system aging and search tools dualization. As a result, the users’ search satisfaction is not satisfied, and the improvement demand increases. This study aimed to evaluate the NAK’s search quality as a preliminary study for NAK search system advancement. To this end, we analyzed the current status of CAMS and NAK’s Portal. Then, we established the test sets and evaluated the NAK’s Portal quality from the user’s point of view. Evaluation results were analyzed using Precision, Recall, F-score, and MRR. The analysis results showed that the overall search performance was low, particularly in the “advanced subject search,” which showed low performance in Precision, Recall, and MRR. Thus, improvement is urgently needed. The test sets established for this study are expected to be used as a basis for objectively measuring the improvement of the search performance after the NAK search system advancement.

Statistics

  • 316 Viewed
  • 200 Downloaded

Tools

Issue List

Citation status

* References for papers published after 2023 are currently being built.

Basic Search Advanced Search