본문 바로가기
  • Home

Development and Standardization of Major Competency Assessment Tools: Transitioning from Indirect Evaluation to Performance-Type Direct Evaluation questions Focusing on the Case of Education Department at University A

  • Journal of Studies on Schools and Teaching
  • Abbr : JSST
  • 2024, 9(1), pp.183-210
  • DOI : 10.23041/jsst.2024.9.1.008
  • Publisher : Education Research Institute at CNUE
  • Research Area : Social Science > Education
  • Received : January 1, 2024
  • Accepted : February 28, 2024
  • Published : February 28, 2024

Heo Jiwon 1

1남부대학교

Accredited

ABSTRACT

This study criticizes the fact that most university major competency assessment tests are conducted using the self-check indirect evaluation methods. In response to that, this study aims to develop a direct evaluation method for major competency assessment tests by incorporating performance-based questions as an alternative. To achieve this, the study focuses on the education and teaching departments conducting preliminary test development based on previous research, case analysis, expert interviews, advisory committees’ recommendations, and an understanding of the major background. Preliminary tests were developed and a pilot test was conducted, which involved the education and teaching departments students to assess its validity. The results were used to modify and improve the test items, and the content experts evaluated the content validity. The content validity index (CVI) was high at 0.96, with 5 out of 6 performance-based categories with a CVI of 1.0 (83.3%) and 1 category with a CVI of 0.87 (16.7%). The study then compared the developed performance-based test categories for direct evaluation with the self-check categories of the existing assessment to derive meaningful implications. Based on the results of this study, a proposal is made to use performance-based direct evaluation methods to more accurately measure students’ the major competencies. This study also presents a standardized manual for the entire research process. We hope that the results of this research will serve as valuable resources for developing direct evaluation categories for various majors

Citation status

* References for papers published after 2023 are currently being built.