Modern English Education 2023 KCI Impact Factor : 1.55
-
pISSN : 1598-0782 / eISSN : 2586-6141
- https://journal.kci.go.kr/meeso
KJCKorea
Journal Central
Examining the Effects of Peer Review in EFL Writing: A Coh-Metrix Analysis
- Modern English Education
- Abbr : MEESO
- 2021, 22(4), pp.60-69
- DOI : 10.18095/meeso.2021.22.4.60
- Publisher : The Modern English Education Society
- Research Area : Humanities > English Language and Literature > English Language Teaching
- Received : September 10, 2021
- Accepted : November 5, 2021
- Published : November 30, 2021
Philip Yoongoo Jung 1, Jeong-Ah Shin 2
1동국대
2동국대학교
Accredited
ABSTRACT
This study investigated the effectiveness of peer feedback in EFL writing classes. A total of 285 original editorials by 103 Korean learners of English were compared with revised drafts reviewed by classmates. Coh-Metrix, an automated tool offering a wide range of measures on cohesion and language was used for analyses. Fourteen indices of the Coh-Metrix system were selected to observe variances in lexical (i.e., TTR, frequency, age of acquisition, concreteness, familiar- ity, meaningfulness, polysemy), syntactic (i.e., number of words before the main verb, NP/VP density), and discourse (i.e., argument/content word overlap, LSA) aspects between the two sets of writings. There were significant improvements in the lexical aspect as positive modifications were noted in revised drafts. In addition, selective enhancements were observed in the syntactic aspect. Although the number of words before the main verb increased in the revised drafts, NP/VP density resulted in no difference between the two corpora. For the discourse aspect, no significant difference was found. Overall, the implementation of peer review led to positive outcomes in specific areas. However, results also revealed overt limitations of the practice in EFL settings. These findings suggest some educational implications in EFL writing pedagogy.
Statistics
-
181 Viewed
-
68 Downloaded
Tools
Issue List
Citation status
* References for papers published after 2023 are currently being built.
[journal]
안병규
/ 2015
/
A Coh-Metrix Analysis of Elementary School English Textbooks
/ 영어영문학21
/ 21세기영어영문학회
28(3)
: 435~460
[journal]
안수진
/ 2018
/
An Analysis of Coh-Metrix on the Differences in English Expository and Argumentative Writing of Korean and Native English University Students
/ 새한영어영문학
/ 새한영어영문학회
60(3)
: 177~205
[journal]
Arapoff, N.
/ 1969
/ Discover and transform : A method of teaching writing to foreign students
/ TESOL Quarterly
3(4)
: 297~304
[other]
Baayen, R. H.
/ 1995
/ The CELEX lexical database [CD-ROM]
/ Linguistic Data Consortium, University of Pennsylvania
[journal]
Bangert-Drowns, R.
/ 1991
/ The instructional effect of feedback in testlike events
/ Review of Educational Research
61(2)
: 213~238
[book]
Beck, I.
/ 2002
/ Bringing words to life: Robust vocabulary development
/ Guilford Press
[journal]
Berlin, J.
/ 1988
/ Rhetoric and ideology in the writing class
/ College English
50(5)
: 477~494
[journal]
Bialystok, E.
/ 1993
/ Symbolic representation and attentional control in pragmatic competence
/ Interlanguage Pragmatics
3(1)
: 43~57
[journal]
M. Ali Bolgün
/ 2017
/
A Contrastive Rhetoric Analysis of English and Hindi Editorials
/ Journal of Pan-Pacific Association of Applied Linguistics
/ 범태평양 응용언어학회
21(2)
: 15~39
[journal]
Bouton, L. F.
/ 1994
/ Conversational implicature in the second language: Learned slowly when not deliberately taught
/ Journal of Pragmatics
22(2)
: 157~167
[journal]
장지연
/ 2018
/
A comparison of 2017-2018 CSAT reading passages via Coh-Metrix: Focusing on descriptive, readability, and easibility measures
/ Foreign Languages Education
/ 한국외국어교육학회
25(4)
: 81~106
[journal]
Chaudron, C.
/ 1984
/ Evaluating writing : Effects of feedback on revision
/ RELC Journal
15(2)
: 1~14
[journal]
Cho, Kwangsu
/ 2007
/ Scaffolded writing and rewriting in the discipline
/ Computers and Education
48(3)
: 409~426
[journal]
최정은
/ 2015
/
A Comparative Discourse Analysis of English and Korean Editorials
/ 영어학
/ 한국영어학회
15(2)
: 231~257
[journal]
Cohen, A.
/ 1996
/ Developing the ability to perform speech acts
/ Studies in Second Language Acquisition
18(2)
: 253~267
[journal]
Coltheart, M.
/ 1981
/ The MRC psycholinguistic database
/ The Quarterly Journal of Experimental Psychology Section A
33(4)
: 497~505
[book]
Connor, U.
/ 1996
/ Contrastive rhetoric: Cross-cultural aspects of second-language writing
/ Cambridge University Press
[journal]
Crossley, S. A.
/ 2009
/ Computational assessment of lexical differences in L1 and L2 writing
/ Journal of Second Language Writing
18(2)
: 119~135
[journal]
Crossley, S. A.
/ 2011
/ Understanding expert ratings of essay quality: Coh-Metrix analyses of first and second language writing
/ International Journal of Continuing Engineering Education and Life Long Learning
21(2-3)
: 170~191
[journal]
Crossley, S. A.
/ 2014
/ Does writing development equal writing quality? A computational investigation of syntactic complexity in L2 learners
/ Journal of Second Language Writing
26
: 66~79
[journal]
Edelsky, C.
/ 1982
/ Writing in a bilingual program : The relation of L1 and L2 texts
/ TESOL Quarterly
16(2)
: 211~228
[book]
Elbow, P.
/ 1973
/ Writing without teachers
/ Oxford University Press
[book]
Fox, T.
/ 1990
/ The social uses of writing: Politics and Pedagogy
/ Ablex
[book]
Gernsbacher, M. A.
/ 1990
/ Language comprehension as structure building
/ Erlbaum
[journal]
Gielen, S.
/ 2010
/ Improving the effectiveness of peer feedback for learning
/ Learning and Instruction
20(4)
: 304~315
[journal]
Gilhooly, K. J.
/ 1980
/ Age-of-acquisition, imagery, concreteness, familiarity, and ambiguity measures for 1, 944 words
/ Behavior Research Methods & Instrumentation
12(4)
: 395~427
[journal]
Graesser, A. C.
/ 2007
/ Discourse cohesion in text and tutorial dialogue
/ Information Design Journal
15(3)
: 199~213
[journal]
Graesser, A. C.
/ 2004
/ Coh-Metrix: Analysis of text on cohesion and language
/ Behavior Research Methods, Instruments, & Computers
36(2)
: 193~202
[journal]
Haberlandt, K. F.
/ 1985
/ Component processes in text comprehension and some of their interactions
/ Journal of Experimental Psychology : General
114(3)
: 357~374
[journal]
Hattie, J.
/ 2007
/ The power of feedback
/ Review of Educational Research
77(1)
: 81~112
[journal]
House, J.
/ 1996
/ Developing pragmatic fluency in English as a foreign language : Routines and metapragmatic awareness
/ Studies in Second Language Acquisition
18(2)
: 225~252
[book]
Jacobs, S. E.
/ 1982
/ Linguistics and literacy series: 3
/ Center for Applied Linguistics
[journal]
장은영
/ 2014
/
Comparison of the Discourse Function of English Relative Pronouns Used in ‘News Report’ and ‘Editorial’ of Newspaper
/ 영어영문학연구
/ 한국중앙영어영문학회
56(3)
: 365~382
[journal]
전문기
/ 2011
/
A Corpus-based Analysis of the Continuity of the Reading Materials in Middle School English 1 and 2 Textbooks with Coh-Metrix.
/ 언어과학연구
/ 언어과학회
(56)
: 201~218
[journal]
전문기
/ 2014
/
An Analysis of the Continuity of the Reading Materials in High School English Textbooks
/ Journal of The Korean Data Analysis Society
/ 한국자료분석학회
16(2)
: 925~938
[journal]
전문기
/ 2015
/
An analysis of the continuity among middle school English textbooks with an automated language analysis program.
/ 현대영어교육
/ 현대영어교육학회
16(1)
: 195~218
[journal]
전문기
/ 2009
/
A Corpus-based analysis of middle school English 1 textbooks with Coh-Metrix
/ 영어교육연구
/ 팬코리아영어교육학회
21(4)
: 265~292
[thesis]
Jeong, Mikyung
/ 2015
/ A comparative study on the English argumentative essays of Korean and native English university students with Coh-Metrix: Focused on lexical, syntactic, and discourse features
/ doctoral
/ Kangwon National University
[journal]
정미경
/ 2014
/
An Analysis of the Linguistic Features on the Corpus of Korean EFL Learners and Native English Speakers with Coh-Metrix
/ 언어학 연구
/ 한국중원언어학회
(33)
: 373~395
[journal]
Jung, Philip-Yoongoo
/ Comparing the difficulty of classroom English in teacher-guidebooks by levels using Coh-Metrix
/ English Teaching
[book]
Just, M. A.
/ 1987
/ The psychology of reading and language comprehension
/ Allyn & Bacon
[journal]
김철규
/ 2009
/
A Corpus-Based Comparison of Metadiscourse in Argumentative Texts of a British Newspaper and Korean University Students’ English Argumentative Texts
/ 담화와 인지
/ 담화·인지언어학회
16(3)
: 65~88
[journal]
김정렬
/ 2012
/
An analysis of the continuity of elementary and middle school English textbooks using Coh-Metrix.
/ 영어교육
/ 한국영어교육학회
67(2)
: 319~341
[thesis]
Kim, Minjeong
/ 2005
/ The effects of the assessor and assessee’s roles on preservice teachers’ metacognitive awareness, performance, and attitude in a technology-related design task
/ Doctoral
/ Florida State University
[journal]
김소정
/ 2016
/
An analysis study of English writing of elementary school 6th grade English language learners using Coh-Metrix. Modern English Education
/ 현대영어교육
/ 현대영어교육학회
17(3)
: 263~287
[journal]
Kluger, A. N.
/ 1996
/ The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory
/ Psychological Bulletin
119(2)
: 254~284
[journal]
Landauer, T. K.
/ 1997
/ A solution to Plato’s problem : The latent semantic analysis theory of acquisition, induction, and representation of knowledge
/ Psychological Review
104(2)
: 211~240
[book]
Landauer, T. K.
/ 2007
/ Handbook of latent semantic analysis
/ Lawrence Erlbaum
[journal]
이지영
/ 2018
/
A Coh-Metrix Analysis of Lexical, Syntactic and Discourse Aspects in the Newspaper Articles of Korean and British University Students
/ 현대영어교육
/ 현대영어교육학회
19(4)
: 17~26
[journal]
이지영
/ 2020
/
A Coh-Metrix Analysis of the English Editorials of Korean, American, and British University Students
/ 현대영어교육
/ 현대영어교육학회
21(3)
: 15~27
[journal]
이승환
/ 2013
/
A Corpus-based Analysis of the Difficulty of the Reading Materials in High School English 1 and 2 Textbooks using Coh-Metrix
/ 외국어교육연구
/ 외국어교육연구소
27(2)
: 131~148
[book]
Ljung, M.
/ 1997
/ Studies in English language and teaching
/ Rodopi
: 75~83
[book]
McNamara, D. S.
/ 2014
/ Automated evaluation of text and discourse with Coh-Metrix
/ Cambridge University Press
[journal]
McNamara, D. S.
/ 2004
/ Suppressing irrelevant information: Knowledge activation or inhibition?
/ Journal of Experimental Psychology: Learning, Memory, and Cognition
30(2)
: 465~182
[journal]
Mendonca, C. O.
/ 1994
/ Peer review negotiations : Revision activities in ESL writing instruction
/ TESOL Quarterly
28(4)
: 745~769
[book]
Mory, E. H.
/ 2004
/ Handbook of research on educational communications and technology
/ Lawrence Erlbaum
: 745~783
[journal]
Narciss, S.
/ 2008
/ Feedback strategies for interactive learning tasks
/ Handbook of Research on Educational Communications and Technology
3
: 125~144
[journal]
Nelson, G. L.
/ 1993
/ Peer response groups: Do L2 writers use peer comments in revising their drafts?
/ TESOL Quarterly
27(1)
: 135~142
[journal]
Orsmond, P.
/ 2013
/ Moving feedback forward : Theory to practice
/ Assessment & Evaluation in Higher Education
38(2)
: 240~252
[thesis]
Perdue, V. A.
/ 1984
/ Writing as an act of power: Basic writing pedagogy as social practice (Composition, literacy, rhetoric)
/ doctoral
/ University of Michigan
[journal]
Perfetti, C.
/ 2007
/ Reading ability : Lexical quality to comprehension
/ Scientific Studies of Reading
11(4)
: 357~383
[thesis]
Pierson, H.
/ 1967
/ Peer and teacher correction: A comparison of the effects of two methods of teaching composition in grade nine English classes
/ doctoral
/ New York University
[journal]
Purves, A. C.
/ 1984
/ The teacher as reader : An anatomy
/ College English
46(3)
: 259~265
[journal]
Rollinson, P.
/ 2005
/ Using peer feedback in the ESL writing class
/ ELT journal
59(1)
: 23~30
[journal]
류지수
/ 2020
/
An analysis of the text complexity of listening scripts of high school English textbooks using Coh-Metrix
/ 영어학
/ 한국영어학회
20
: 363~383
[journal]
Santos, T.
/ 1992
/ Ideology in composition : L1 and ESL
/ Journal of Second Language Writing
1(1)
: 1~15
[book]
Schmidt, R.
/ 1993
/ Interlanguage pragmatics
/ Oxford University Press
: 21~42
[journal]
Silva, T.
/ 1993
/ Toward an understanding of the distinct nature of L2 writing: The ESL research and its implications
/ TESOL Quarterly
27(4)
: 657~677
[journal]
Sluijsmans, D. M. A.
/ 2002
/ Peer assessment training in teacher education : Effects on performance and perceptions
/ Assessment and Evaluation in Higher Education
27(5)
: 443~454
[journal]
성일호
/ 2014
/
An Analysis of Korean High School English Textbooks through Readability Formulae and Coh-Metrix.
/ 영어영문학연구
/ 대한영어영문학회
40(4)
: 299~320
[book]
Toglia, M. P.
/ 1978
/ Handbook of semantic word norms
/ Erlbaum
[journal]
Topping, K.
/ 1998
/ Peer assessment between students in colleges and universities
/ Review of Educational Research
68(3)
: 249~276
[journal]
Tsui, A. B. M.
/ 2000
/ Do secondary L2 writers benefit from peer comments?
/ Journal of Second Language Writing
9(2)
: 147~170
[journal]
Van Steendam, E.
/ 2010
/ The effect of instruction type and dyadic or individual emulation on the quality of higher-order peer feedback in EFL
/ Learning and Instruction
20(4)
: 316~327
[journal]
Villamil, O. S.
/ 1996
/ Peer revision in the L2 classroom : Social-cognitive activities, mediating strategies, and aspects of social behavior
/ Journal of Second Language Writing
5(1)
: 51~75
[journal]
Zhang, S.
/ 1995
/ Reexamining the affective advantage of peer feedback in the ESL writing class
/ Journal of Second Language Writing
4(3)
: 209~222