A study on the quality of patent neural machine translation: A comparison of omission and syntactic errors in the Korean-English translations by patent-specialized Patent Translate and WIPO Translate. (인공신경망 특허 기계번역 성능에 관한 연구 - Patent Translate와 WIPO Translate 한영 번역 결과물의 누락과 통사 오류 분석을 중심으로 -)

Jieun Lee (이지은); Choi, Hyo-eun (최효은)

doi:10.22962/tnirvw.2022.12.2.005

A study on the quality of patent neural machine translation: A comparison of omission and syntactic errors in the Korean-English translations by patent-specialized Patent Translate and WIPO Translate.

T&I REVIEW
Abbr : tnirvw
2022, 12(2), pp.105-130
DOI : 10.22962/tnirvw.2022.12.2.005
Publisher : Ewha Research Institute for Translation Studies
Research Area : Humanities > Interpretation and Translation Studies
Received : October 31, 2022
Accepted : December 20, 2022
Published : December 31, 2022

Jieun Lee ¹, Choi, Hyo-eun ¹

¹이화여자대학교

Accredited

ABSTRACT

Jieun Lee and Hyoeun Choi (2022). A study on the quality of patent neural machine translation: A comparison of omission and syntactic errors in the Korean-English translations by patent-specialized Patent Translate and WIPO Translate. This paper aims to evaluate the quality of patent translations produced by the two patent-specialized machine translation engines, EPO’s Patent Translate and WIPO’s WIPO Translate. For manual evaluation, four experienced patent translators or patent translation service managers evaluated the quality of 106 English sentences from the translations of 30 Korean patent abstracts by the two MT engines. In the automatic evaluation, Patent Translate slightly outperformed WIPO Translate, whereas in the manual evaluation WIPO Translate outperformed Patent Translate. According to the error annotations provided by the evaluators, WIPO Translate produced more omission errors than Patent Translate but handled the complex syntax of the source text better, while Patent Translate produced more syntactic errors than WIPO Translate. The results indicate that in automatic evaluation, MT outputs with fewer omissions were rated higher, while in manual evaluation, comprehensible and accurate syntactic structures appeared to determine the overall quality evaluation. (Ewha Womans University, Korea)

KEYWORDS

Korean-English patent machine translation, patent-specialized neural machine translation engine, MT quality evaluation, Patent Translate, WIPO Translate

Citation status

* References for papers published after 2023 are currently being built.

[journal] 강병규 / 2018 / The Operating Principles of Neural Machine Translation and the Accuracy of Translation - Focusing on the Chinese-Korean Translation / 중어중문학 / 한국중어중문학회 (73) : 253~295

[journal] 곽중철 / 2018 / Revisiting Machine Translation Error Typology through Human Post-editing / 통번역학연구 / 통번역연구소 22(1) : 1~25

[journal] 김동미 / 2018 / A Study on Medication Texts for AI (Artificial Intelligence) Translation Strategies / 인문사회 21 / 인문사회 21 9(6) : 533~544

[journal] 정혜연 / 2020 / Application of Automatic Evaluation to Human Translation / 번역학연구 / 한국번역학회 21(1) : 9~29

[journal] 박건영 / 2021 / Post-editing Guidelines for Korean-English Machine Translation of Informative Texts / 번역학연구 / 한국번역학회 22(1) : 109~137

[journal] 전종섭 / 2013 / 웹기반 영한 번역을 위한 중간 언어의 효율성 연구 / 통번역학연구 / 통번역연구소 17(3) : 201~229

[journal] 서보현 / 2018 / An Analysis of Errors in Machine Translation / 번역학연구 / 한국번역학회 19(1) : 99~117

[journal] 이상빈 / 2020 / Review of literature on machine translation: Based on Arts and Humanities journals covered in KCI Journal Database (from 2011 to early 2020) / 통역과 번역 / 한국통역번역학회 22(2) : 75~104

[journal] 이준호 / 2019 / A Pilot Study Toward an Objective Assessment of Neural Machine Translation; Balance between Automatic and Manual Assessment / 통번역학연구 / 통번역연구소 23(3) : 171~202

[journal] 정혜연 / 2018 / Automatic Evaluation of Human Translation / 통번역학연구 / 통번역연구소 22(4) : 265~287

[thesis] 최효은 / 2016 / 한영 특허 번역 품질 평가 연구 / 박사 / 이화여자대학교 통역번역대학원

[journal] 최효은 / 2017 / A Study on the evaluation of Korean-English patent machine translation–Focusing on KIPRIS K2E-PAT translation. / 통역과 번역 / 한국통역번역학회 19(1) : 139~178

[journal] 한승희 / 2021 / Factor Analysis of Machine Translation Quality, Interpreting and Translation Studies / 통번역학연구 / 통번역연구소 25(2) : 147~170

[journal] 한현희 / 2020 / Current State of Korean-Russian Machine Translation: Based on the comparison of translation performances between Google and Papago / 노어노문학 / 한국노어노문학회 32(3) : 63~94

[thesis] Bazrafshan, M. / 2014 / Semantic Features for Statistical Machine Translation / Doctor / University of Rochester

[journal] Brkić, M. / 2013 / Automatic and human evaluation on English-Croatian legislative test set / Computer Science 7816 : 311~378

[journal] Castilho, S. / 2017 / Is neural machine translation the new state of the art? / The Prague Bulletin of Mathematical Linguistics 108 : 109~120

[book] Castilho, S. / 2018 / Translation Quality Assessment: From Principles to Practice / Springer : 9~38

[journal] Chatzikoumi, E. / 2020 / How to evaluate machine translation : A review of automated and human metrics / Natural Language Engineering 26 : 137~161

[journal] Costa A. / 2015 / A linguistically motivated taxonomy for Machine Translation error analysis / Machine Translation 29 : 127~161

[confproc] Coughlin, D / 2003 / Correlating automated and human assessments of machine translation quality / Paper presented at MT Summit Ⅸ

[book] Doherty, S. / 2017 / Human Issues in Translation Technology / Routledge : 131~148

[book] Doherty, S. / 2019 / The Routledge Handbook of translation and technology / Routledge : 339~353

[book] Dorr, B. / 2011 / Handbook of Natural Language Processing and Machine Translation / Springer : 745~843

[other] Gonzàlez, M. / 2014 / An open toolkit for automatic machine translation (meta-)evaluation. Technical Manual, version 3.0 / TALP Research Center, LSI Department, Universitat Politècnica de Catalunya

[journal] Giménez, J / 2010 / Linguistic measures for automatic machine translation evaluation / Machine Translation 24 : 209~240

[journal] Klubička, F. / 2018 / Quantitative fine-grained human evaluation of machine translation systems : A case study on English to Croatian / Machine Translation 32 : 195~215

[web] Kuczmarski, J. / 2018 / A new look for Google Translate on the web / https://www.blog.google/products/translate/new-look-google-translate-web/

[journal] Lavie, A. / 2013 / Automated metrics for mt evaluation / Machine Translation 11 : 731~

[confproc] Lavie, A. / 2007 / Meteor, m-bleu and m-ter: Evaluation metrics for high-correlation with human rankings of machine translation output / Paper presented at the Third Workshop on Statistical Machine Translation

[confproc] Läubli, S. / 2018 / Has machine translation achieved human parity? A case for document-level evaluation / Paper presented at the 2018 Conference on Empirical Methods in Natural Language Processing

[book] Lommel, A. / 2018 / Translation Quality Assessment: From Principles to Practice / Springer : 109~128

[journal] Nurminen, M. / 2020 / Raw machine translation use by patent professionals : A case of distributed cognition / Translation, Cognition & Behavior 3(1) : 100~121

[book] Olohan, M. / 2015 / Scientific and Technical Translation / Routledge

[confproc] Papineni, K. / 2002 / BLEU: A method for automatic evaluation of machine translation / Paper presented at the 40th Annual Meeting of the Association for Computational Linguistics

[confproc] Poliquen / 2015 / Full-text patent translation at WIPO: Scalability, quality and usability / Paper presented at MT Summit XV: The Sixth Workshop on Patent and Scientific Literature Translation (PSLT6)

[confproc] Poliquen, B / 2017 / WIPO Translate: Patent neural machine translation publicly available in 10languages / Paper presented at the Seventh Workshop on Patent and Scientific Literature Translation

[book] Popovic, M. / 2018 / Translation Quality Assessment:From Principles to Practice / Springer : 129~158

[confproc] Premoli, V. / 2019 / MTPE in patents: A successful business story / Paper presented at the MT Summit XVII

[journal] Rossi, L. / 2013 / Applicability and application of machine translation quality metrics in the patent field / World Patent Information 35 : 115~125

[confproc] Tsai, Y. / 2017 / Linguistic evaluation of translation errors in Chinese–English machine translations of patent titles / Forum 15(1) : 142~156

[web] USPTO / 2018 / Manual of patent examining procedure. USPTO United States Patent and Trademark / https://mpep.uspto.gov/RDMS/MPEP/current#/current/d0e122292.html

[journal] Wu, Y. / 2016 / Google's neural machine translation system: Bridging the gap between human and machine translation

[journal] Ying, C. / 2021 / Errors of machine translation of terminology in the patent text from English into Chinese / ASP Transactions on Comuputers 1(1) : 12~17

This paper was written with support from the National Research Foundation of Korea.

KJCKorea
Journal Central

T&I REVIEW 2023 KCI Impact Factor : 1.52

A study on the quality of patent neural machine translation: A comparison of omission and syntactic errors in the Korean-English translations by patent-specialized Patent Translate and WIPO Translate.

ABSTRACT

KEYWORDS

Citation status

* References for papers published after 2023 are currently being built.

T&I REVIEW 2023 KCI Impact Factor : 1.52

A study on the quality of patent neural machine translation: A comparison of omission and syntactic errors in the Korean-English translations by patent-specialized Patent Translate and WIPO Translate.

ABSTRACT

KEYWORDS

Statistics

Tools

Issue List

Citation status

KCI Citation Counts (3)

REFERENCES (44) * References for papers published after 2023 are currently being built.

Search PDF

Citation

* References for papers published after 2023 are currently being built.