Court Interpreting Assessment Using Rating Scales

Jieun Lee; Lee， Yoojin; Choi， Hyo-eun

doi:10.15749/jts.2019.20.2.004

For defendants and witnesses who do not speak the official language of the court, the provision of interpreting and the quality of court interpreting are equally important. This paper aims to develop a rating scale for the assessment of the competence of court interpreters and court interpreting quality. Based on the literature review, we have developed a rating scale with the three criteria of accuracy, target language quality, and delivery. The ten-point rating scale has four bands, ‘excellent’, ‘good’, ‘mediocre’, and ‘poor’, for each criterion of quality, and points assigned to each band: 10 points for ‘excellent’, 8 to 9 points for ‘good’, 6 to 7 points for ‘mediocre’, and 5 points and below for ‘poor’. The audio-recorded interpreting data and Korean court record of the examinations, which were made available for this study, consisted of dialogue interpreting during fourteen courtroom examinations of witnesses and defendants from non-Korean speaking backgrounds. The data of 10 hour and 34 minute long interpreting involved eleven interpreters in seven languages, including English, Chinese, Russian, Japanese, Mongol, Thai, and Uzbek. Each language interpreting was assessed by two raters based on the rubric provided by the researchers. While English, Chinese, Russian and Japanese raters had at least MA level training in translation and interpreting and included at least one rater who was familiar with court interpreting, Mongol, Thai, and Uzbek raters were language instructors or fluent bilinguals, lacking professional translator or interpreter training. The results indicate that the raters generally understood the criteria and the band descriptors and came up with similar results. The inter-rater reliability measured by a percent agreement between raters proved to be high. In terms of overall band scores, the rater agreement was 100% in six languages except for English, which was still strong (75%). The findings support the practicality and effectiveness of using rating scales in the assessment of court interpreting in different contexts, including certification examination. Despite the limitations of the current research, the rating scale proved to be a useful tool that can be employed by non-professional interpreter raters. The assessment of eleven interpreters performances revealed that the overall interpreting competence of the eleven interpreters was mediocre.

Citation status

KCI Citation Counts (4)
열림/닫힘 버튼
REFERENCES (26)
열림/닫힘 버튼
* 2021년 이후 발행 논문의 참고문헌은 현재 구축 중입니다.

[journal] 김혜림 / 2011 / Study on the Evaluation of Interpretation in Education: Based on a survey / 통역과 번역 / 한국통역번역학회 13(2) : 71~91

[book] 이지은 / 2012 / 다문화사회의 사법통역 / 집문당

[journal] 이지은 / 2013 / Action research on legal interpreter training: A case study of Ewha GSTI legal interpreter certificate program / 번역학연구 / 한국번역학회 14(5) : 195~223 / 10.15749/jts.2013.14.5.008

[journal] 이지은 / 2015 / A Case Study of Court Interpreters’ Consecutive Interpreting Performances / 언어학연구 / 한국언어연구학회 20(1) : 99~118

[journal] 이지은 / 2016 / 사법통역 제도개선을 위한 소고 / 이화여대 법학논집 20(1) : 251~277

[journal] 이혜승 / 2008 / Empirical research on the evaluation of Simultaneous Interpretation / 통번역학연구 / 통번역연구소 12(1) : 91~107

[journal] 정철자 / 2012 / A Case Study of Inter-rater Comparability in Interpreting Assessment / 통번역학연구 / 통번역연구소 16(2) : 219~239

[journal] 편혜원 / 2004 / A case study on the evaluation of AB interpretation according to different teacher profiles / 통역과 번역 / 한국통역번역학회 6(2) : 207~224

[book] Angelelli, Claudia V / 2009 / Testing and Assessment in Translation and Interpreting Studies: A Call for Dialogue between Research and Practice / John Benjamins : 13~99

[book] Bachman, Lyle F / 1996 / Language Testing in Practice: Designing and Developing Useful Language Tests / Oxford University Press

[journal] Clifford, Andrew / 2005 / Putting the Exam to the Test: Psychometric Validation and Interpreter Certification / Interpreting 7(1) : 97~131

[book] Giambruno, Cynthia / 2014 / Assessing Legal Interpreter Quality through Testing and Certification: The Qualitas Project / University of Alcant/Alicante Publications

[web] Graham, Mathew / 2012 / Measuring and Promoting Inter-Rater Agreement of Teacher and Principal Performance Ratings / The U.S. Department of Education / https://files.eric.ed.gov/fulltext/ED532068.pdf

[book] Hale, Sandra / 2019 / Discourse in Translation / Routledge : 47~66

[journal] Han, Cao / 2018 / Using Rating Scales to Assess Interpretation: Practices, Problems and Prospects / Interpreting 20(1) : 59~95

[book] Hatim, Basil / 1997 / The Translator as Communicator / Routledge

[book] Kalina, Sylvia / 2002 / Interpreting in the 21st Century: Challenges and Opportunities / John Benjamins : 121~130

[journal] Kurz, Ingrid / 2001 / Conference Interpreting: Quality in the Ears of the User’ / Meta 46(2) : 394~409

[journal] Lee, Jieun / 2008 / Rating Scale for Interpreting Performance / The Interpreter and Translator Training 2(8) : 172~173

[confproc] Moore, Alan D / 1997 / Clarifying the Blurred Image: Estimating the Interrater Reliability of Performance Assessment / paper presented at the annual meeting of the Northern Rocky Mountain Educational Research Association (414319) : 1~19

[web] NAATI / Certified Interpreter Test Assessment Rubrics / www.naati.com.au/https://www.naati.com.au/certification/certification-testing/

[journal] Pöchhacker, Franz / 2001 / Quality Assessment in Conferences and Community / Meta 46(2) : 410~425

[book] Riccardi, Alessandra / 2002 / Teaching Translation and Interpreting 4: Building Bridges / John Benjamins : 115~126

[book] Schjoldager, Anne / 1996 / Teaching Translation and Interpreting 3: New Horizons / John Benjamins : 187~195

[journal] Stansfield, Charles, W / 2005 / Examining the Predictive Validity of a Screening Test for Court Interpreters / Language Testing 22(4) : 438~462

[book] Tiselius, Elisabet / 2009 / Testing and Assessment in Translation and Interpreting Studies: A Call for Dialogue between Research and Practice / John Benjamins : 95~121

KJC Korea
Journal Central

Statistics

Tools

Sharing

Issue List

Citation status