본문 바로가기
  • Home

Modeling Short Answer Grading Performance Improvement by GPT Augmentation Data

  • Journal of Software Assessment and Valuation
  • Abbr : JSAV
  • 2024, 20(2), pp.35-45
  • Publisher : Korea Software Assessment and Valuation Society
  • Research Area : Engineering > Computer Science
  • Received : May 16, 2024
  • Accepted : June 20, 2024
  • Published : June 30, 2024

Maresha Caroline Wijanto 1 Hwanseung Yong 1

1이화여자대학교

Accredited

ABSTRACT

The automatic grading of short answer question is important in the field of Natural Language Processing. ASAG (Automated Short Answer Grading) task have undergone numerous advancements. Recent studies have adopted transformer models such as the T5 embedding or BERT-base models. Nonetheless, ASAG tasks encounter significant challenges stemming from limited data availability. The urgent need for more training data emerges as a central issue. Several researchers have proposed augmentation approaches to address this gap. In this study, we introduce other data augmentation technique utilizing prompt engineering by the GPT model. We deploy ASAG system using the Sentence Transformers model, fine-tuning specific hyper-parameters alongside the augmented dataset. The primary factors influencing performance enhancement include the augmentation process, particularly the quantity of augmented data, and the dataset split size for training and testing purposes. Furthermore, alternative GPT models or fine-tuning GPT could be explored within the augmentation process.

Citation status

* References for papers published after 2023 are currently being built.