본문 바로가기
  • Home

The validation of ability measurements with the use of explicit algorithm based methods on the basis of essay writing:In the case of measuring educational effects of a study abroad program

  • The Japanese Language Association of Korea
  • Abbr : JLAK
  • 2014, (41), pp.101-114
  • Publisher : The Japanese Language Association Of Korea
  • Research Area : Humanities > Japanese Language and Literature

Akihiro Tsutsui 1

1이화여자대학교

Accredited

ABSTRACT

In measuring specific traits on the basis of essay writing, explicit algorithm based methods exceed human rating in reliability and labor costs, but raise a controversy over the validity. This paper examines the validity of explicit algorithm based methods of measurement through essay writing in the case of detecting educational effects of a study abroad program. Indicators used in this paper for measuring program participants’ reflection on a given topic, knowledge expansion, and argument logicality are lexical density, Guiraud’s Index, and betweenness centrality in Centering Resonance Analysis, respectively. Correlations shown in a multitrait-multimethod matrix composed of those three variables with the use of both explicit algorithm based methods and human rating did not verify the validity of those indicators. This result, however, does not deny, but rather reinforces the significance of validating the measurement of educational effects in all the possible situations in college education.

Citation status

* References for papers published after 2023 are currently being built.