본문 바로가기
  • Home

Design and Evaluation of LLM-Based Conversational Agents for Diagnosing Science Learning Difficulties

  • Journal of The Korea Society of Computer and Information
  • Abbr : JKSCI
  • 2025, 30(7), pp.87~96
  • Publisher : The Korean Society Of Computer And Information
  • Research Area : Engineering > Computer Science
  • Received : May 22, 2025
  • Accepted : July 2, 2025
  • Published : July 31, 2025

Tae-Ho Min 1

1보라중학교

Accredited

ABSTRACT

This study explores the use of large language model-based conversational agents to diagnose science learning difficulties. Four prototype models were developed by varying the classification schemes of science learning difficulties and the inclusion of emotional support, and simulation-based experiments were conducted by using ChatGPT-4o in the roles of students. The results showed that models using detailed classifications of environmental factors achieved higher diagnostic accuracy than those using detailed classifications of individual factors, while the inclusion of emotional support did not have a statistically significant effect. Based on these findings, an improved model was designed and applied to twelve students in the ninth grade. Analysis of the interactions revealed that certain areas, including community-related factors, were sometimes omitted from the diagnosis. In addition, the diagnostic process was prematurely terminated when students deviated from the topic or refused to continue the conversation. Drawing on these results, the study proposes design recommendations for conversational agents aimed at diagnosing science learning difficulties.

Citation status

* References for papers published after 2024 are currently being built.