본문 바로가기
  • Home

Criterion-Related Validity and Temporal Stability of the Affective Domain of Digital Literacy Scale (ADLS): A Three-Wave Longitudinal Study Using Metacognitive Self-Regulation as an External Criterion

  • Journal of The Korea Society of Computer and Information
  • Abbr : JKSCI
  • 2026, 31(4), pp.233~245
  • Publisher : The Korean Society Of Computer And Information
  • Research Area : Engineering > Computer Science
  • Received : February 20, 2026
  • Accepted : March 24, 2026
  • Published : April 30, 2026

Eun-Ji Kim 1 Lee Youngjun ORD ID 1

1한국교원대학교

Accredited

ABSTRACT

This study examined the criterion-related validity and temporal stability of the Affective Domain of Digital Literacy Scale (ADLS) using a three-wave longitudinal design, with metacognitive self-regulation serving as an external criterion. A total of 157 fifth-grade students completed the ADLS and a metacognitive self-regulation measure at three time points: pretest (April), midpoint (September), and posttest (December). Data were analyzed using Pearson correlations, cross-time correlations, and mixed-design repeated-measures analysis of variance (ANOVA).The ADLS total score demonstrated significant positive correlations with metacognitive self-regulation across all three time points (r = .599 - .641). The magnitude of these correlations showed no significant differences over time, indicating consistent criterion-related validity. Regarding temporal stability (test-retest reliability), the ADLS total score and the Self-Efficacy subfactor exhibited adequate stability, whereas the Value Perception subfactor showed relatively lower stability. Furthermore, repeated-measures ANOVA revealed that ADLS scores increased significantly from the pretest to the midpoint and remained stable thereafter. In contrast, metacognitive self-regulation showed no significant changes over the same period.These findings provide empirical evidence for the criterion-related validity and temporal stability of the ADLS, supporting its utility as a reliable repeated-measurement tool.

Citation status

* References for papers published after 2024 are currently being built.