Effect of a Cognitive Diagnosis Model-Based Feedback in an English Writing Class: Focusing on Korean English Learners

Sookyung Cho (조수경)

Effect of a Cognitive Diagnosis Model-Based Feedback in an English Writing Class: Focusing on Korean English Learners

Modern English Education
Abbr : MEESO
2023, 24(), pp.171-185
Publisher : The Modern English Education Society
Research Area : Humanities > English Language and Literature > English Language Teaching
Received : August 24, 2023
Accepted : October 6, 2023
Published : October 31, 2023

Sookyung Cho ¹

¹한국외국어대학교

Accredited

ABSTRACT

This study aimed to investigate the effects of cognitive diagnosis model (CDM)-based teacher feedback on student writing ability and their perceptions. CDMs have been applied to various tests of language proficiency due to their ability to provide fine-grained information about a student's language proficiency. However, it has rarely been studied how this information can be incorporated into language instruction. Therefore, this study administered a multiple-choice writing exam to Korean English learners, analyzed the test results using a CDM, and used this information to evaluate student writing ability and provide feedback on their writing. The effects were measured in three ways: a comparison of the CDM analyses conducted at the beginning and end of the semester, a qualitative analysis of two focal students' writing, and an analysis of student questionnaires. The results revealed that most students increased their mastery level at the end of the semester. Also, the CDM-based feedback brought positive changes to the writing of the focal students. Finally, students had positive perceptions of the CDMbased feedback. These findings imply that CDM-based feedback can contribute to English as a Foreign Language (EFL) students' improvement in their writing abilities by adjusting it to their needs.

KEYWORDS

cognitive diagnosis model, formative assessment, L2 writing, teacher feedback

Citation status

* References for papers published after 2023 are currently being built.

[journal] Black, P. / 1990 / Assessment and classroom learning / Assessment in Education: Principles, Policy, and Practice 5(1) : 1~65

[journal] Black, P. / 2009 / Developing the theory of formative assessment / Educational Assessment, Evaluation and Accountability 21(1) : 5~31

[journal] Buck, G. / 1998 / Application of the rule-space procedure to language testing : Examining attributes of a free response listening test / Language Test 15(2) : 119~157

[journal] 조수경 / 2022 / Application of a Cognitive Diagnosis Model to a Multiple-Choice English Writing Test / 교육학연구 / 한국교육학회 60(7) : 43~62

[journal] 조수경 / 2021 / Development of a Multiple-Choice Writing Examination Validated with a Cognitive Diagnosis Model / 현대영어교육 / 현대영어교육학회 22(4) : 12~23

[book] Culham, R / 2018 / Teach writing well: How to assess writing, invigorate instruction, and rethink revision / Stenhouse Publishers

[journal] Ferris, D. / 2014 / Responding to student writing : Teachers’ philosophies and practices / Assessing Writing 19(1) : 6~23

[journal] Hattie, J. / 2007 / The power of feedback / Review of Educational Research 77(1) : 81~112

[book] Huot, B. / 2009 / The SAGE handbook of writing development / Sage : 423~435

[journal] Hyland, F. / 2006 / Feedback on second language students’ writing / Language Teaching 39(2) : 83~101

[book] Hyland, K / 2003 / Second language writing / Cambridge University Press

[journal] Kim, Youn-Hee. / 2011 / Diagnosing EAP writing ability using the reduced reparameterized unified model / Language Testing 28(4) : 509~541

[journal] Lee, I. / 2007 / Assessment for learning : Integrating assessment, teaching, and learning in the ESL/EFL writing classroom / The Canadian Modern Language Review 64(1) : 199~214

[journal] Lee, Yong-Won / 2009 / Application of three cognitive diagnosis models to ESL reading and listening assessments / Language Assessment Quarterly 6(3) : 239~263

[journal] Matsuno, S. / 2009 / Self-, peer-, and teacher-assessment in Japanese university EFL writing classrooms / Language Testing 26(1) : 75~100

[journal] McGarrel, H. / 2007 / Motivating draft revision through formative feedback / ELT Journal 61(3) : 228~236

[journal] Nicol, D. J. / 2006 / Formative assessment and self-regulated learning : A model and seven principles of good feedback practice / Studies in Higher Education 31(2) : 199~218

[journal] 박찬호 / 2011 / Cognitive Diagnostic Assessment of English Grammar for Korean EFL Learners / 영어교육 / 한국영어교육학회 66(4) : 101~117

[journal] 박찬호 / 2017 / An Exploratory Analysis of Compensatory Cognitive Diagnosis in EFL Reading Comprehension / 영어학 / 한국영어학회 17(1) : 85~104

[web] R Core Team / 2021 / R: A language and environment for statistical computing / R Foundation for Statistical Computing / https://www.R-project.org/

[journal] Ramaprasad, A. / 1983 / On the definition of feedback / Systems Research and Behavioral Science 28(1) : 4~13

[journal] Sadler, D. R. / 1989 / Formative assessment and the design of instructional systems / Instructional Science 18(2) : 119~144

[journal] Sadler, D. R. / 1989 / Formative assessment: Revisiting the theory. Formative assessment and the design of instructional systems / Education: Principles, Policy, and Practice 5(1) : 77~84

[journal] Sawaki, Y. / 2009 / Q-matrix construction : Defining the link between constructs and test items in largescale reading and listening comprehension assessment / Language Assessment Quarterly 6(3) : 190~209

[journal] Shahsavar, Z. / 2019 / Diagnosing English learners’ writing skills : A cognitive diagnostic modeling study / Cogent Education 6(1) : 1~19

[journal] Shute, V. / 2008 / Focus on formative feedback / Review of Educational Research 78(1) : 153~189

[journal] Tatsuoka, K. K. / 1983 / Rule space : An approach for dealing with misconceptions based on item response theory / Journal of Educational Measurement 20(4) : 345~354

[journal] Truscott, J. / 1996 / The case against grammar correction in L2 writing classes / Language Learning 46(2) : 327~369

[web] Tuttle, H. G / 2008 / Formative assessment: responding to your students / https://ebookcentral.proquest.com/lib/malmo/detail.action?docID=1595017#

[book] Wiliam, D. / 2011 / Embedded formative assessment / Solution Tree Press

[journal] Wiliam, D. / 2011 / What is assessment for learning? / Studies in Educational Evaluation 37(1) : 3~14

[journal] Xie, Q. / 2016 / Diagnosing university students’ academic writing in English: Is cognitive diagnostic modelling the way forward? / Educational Psychology 37(1) : 26~47

[journal] Xin, T. / 2022 / Editorial : Cognitive diagnostic models : Methods for practical applications / Frontiers in Psychology 13 : 1~3

KJCKorea
Journal Central

Modern English Education 2023 KCI Impact Factor : 1.55