본문 바로가기
  • Home

Real-time Object Recognition and Translation App for Foreign Workers Using Artificial Intelligence

  • Journal of Knowledge Information Technology and Systems
  • Abbr : JKITS
  • 2020, 15(6), pp.963-971
  • DOI : 10.34163/jkits.2020.15.6.005
  • Publisher : Korea Knowledge Information Technology Society
  • Research Area : Interdisciplinary Studies > Interdisciplinary Research
  • Received : November 10, 2020
  • Accepted : December 11, 2020
  • Published : December 31, 2020

Bum-Soo Kim 1 Young-Hyen Kim 1 Byung-Tae Chun 1

1한경대학교

Accredited

ABSTRACT

The number of foreign workers entering Korea is increasing every year. Accordingly, Korean language education and education on understanding Korean culture are provided at training institutions of government departments. Despite these efforts, it can be seen that foreign workers face many difficulties when they first encounter Korean culture. In this paper, we introduce a public app developed to solve the cultural difficulties of foreign workers. Among the popular objects in Korea, a study was conducted on objects that foreign workers feel somewhat unfamiliar to them. We developed an app that recognizes an object in real time on a smartphone and translates its usage into several languages. Language selection was based on the languages of five countries with a large portion of entry into Korea. 7,900 copies of training images were collected and labeled. A total of 20,000 iterations were trained with the Yolov3-tiny learning model using Darknet, an AI neural network. The developed app can recognize and translate real-time objects on a smartphone with an average accuracy of 91.3%. It is a system that translates and provides the description of the detected object into five languages at the touch of a button. It is expected that this app will be able to bridge cultural and linguistic differences in daily life of foreign workers.

Citation status

* References for papers published after 2023 are currently being built.