본문 바로가기
  • Home

The Relationship Between Text Readability, Item Types, and Their Impact on Student Performance on CSAT English Reading Items

  • Modern English Education
  • Abbr : MEESO
  • 2025, 26(), pp.68~83
  • Publisher : The Modern English Education Society
  • Research Area : Humanities > English Language and Literature > English Language Teaching
  • Received : January 4, 2025
  • Accepted : January 30, 2025
  • Published : February 23, 2025

김정란 1 Jung, YeonJoo 2

1김해외국어고등학교
2부산대학교

Accredited

ABSTRACT

Despite extensive research on readability formulas in language assessment, their relationship with student performance in high-stakes English as a Foreign Language (EFL) testing remains understudied. This study investigated the relationship between text readability and student performance across four item categories in English reading comprehension section of the Korean College Scholastic Ability Test (CSAT). Analysis was conducted on 335 reading passages from CSAT examinations (2017– 2024) using four readability formulas (two traditional and two advanced). Results revealed varying patterns of incorrect response rates across item categories. Main Idea Comprehension items showed the most consistent performance patterns (CV = 0.137) while Discourse Structure Inference items displayed the highest variability (CV = 0.165). Correlation analyses indicated weak relationships between readability measures and incorrect response rates, with contextual inference items showing weak but significant correlations with certain readability indices. Subsequent multiple regression analyses revealed that readability measures explained very small or small amounts of variance in incorrect response rates across item categories (R² = 0.015– 0.091). Findings of this study are discussed in terms of developing differentiated approaches to difficulty calibration tailored to each item category’s distinct linguistic features and cognitive demands.

Citation status

* References for papers published after 2023 are currently being built.