본문 바로가기
  • Home

Evaluation of Patent English-Korean Machine Translations by a Patent-Specific NMT Engine Using AutoML

  • The Journal of Translation Studies
  • Abbr : JTS
  • 2023, 24(2), pp.101-130
  • DOI : 10.15749/jts.2023.24.2.004
  • Publisher : The Korean Association for Translation Studies
  • Research Area : Humanities > Interpretation and Translation Studies
  • Received : April 30, 2023
  • Accepted : June 20, 2023
  • Published : June 30, 2023

Choi, Hyo-eun 1 LEE JUNHO 2 Chung-ho Lee 3

1이화여자대학교
2중앙대학교
3에버트란

Accredited

ABSTRACT

This paper compares the quality of English-Korean patent translations by a patent-specific NMT engine trained using AutoML with the general Google Translate. The evaluation was based on both automatic and human evaluations of the Korean translations of 200 English patent sentences excerpted from a number of semiconductor patent gazettes. In automatic evaluation, BLEU scores showed that the patent-specific NMT engine significantly outperformed Google Translate. Human evaluation, carried out by sampling as well as error detection and correction analysis, confirmed the results of automatic evaluation, revealing that patent-specific NMT results were better than Google Translate results. In the error detection and correction analysis, Google Translate had more major errors than patent-specific NMT. Moreover, most errors in Google Translate were addressed in the patent-specific NMT, while errors in the patent-specific NMT still remained in Google Translate. In the sampling analysis, shorter sentences and longer sentences were sampled and analyzed. According to the results, both patent-specific NMT and Google Translate showed better performance in translating shorter sentences. In translating longer sentences, both translation engines exhibited accuracy-related errors and syntactic errors, though patent-specific NMT slightly outperformed Google Translate. Overall, translation results by patent-specific NMT showed better quality than those by Google Translate.

Citation status

* References for papers published after 2023 are currently being built.