본문 바로가기
  • Home

Generative AI in Legal Information Retrieval and Regulatory Classification: An Exploratory Study Using ChatGPT

Park Jungwon 1

1국립경국대학교

Accredited

ABSTRACT

This study explores the applicability of generative artificial intelligence (Generative AI), particularly ChatGPT, to legal information retrieval and regulatory classification. Two tasks were designed: one involved generating legal provisions based on input information such as statute name, article number, and title; the other involved classifying whether a given provision is regulatory or non-regulatory. The study evaluated classification accuracy, content similarity, execution consistency, and performance variation across conditions. Results showed that in the provision generation task, ChatGPT often produced inaccurate, inconsistent, or hallucinated content, with low similarity to reference texts. In contrast, the classification task achieved a mean accuracy of 66.9%, with high consistency and reliability, suggesting potential utility as a supportive tool for identifying regulatory provisions. However, the frequent misclassification of non-regulatory provisions remains a key limitation. As an initial empirical assessment of generative AI in legal and regulatory contexts, this study provides a foundation for future research comparing domain-specific AI models and exploring their use in regulatory support tasks.

Citation status

* References for papers published after 2024 are currently being built.

This paper was written with support from the National Research Foundation of Korea.