본문 바로가기
  • Home

A Design and Implementation CODA Service Application Based on Generative AI

  • Journal of The Korea Society of Computer and Information
  • Abbr : JKSCI
  • 2025, 30(3), pp.21~30
  • Publisher : The Korean Society Of Computer And Information
  • Research Area : Engineering > Computer Science
  • Received : December 30, 2024
  • Accepted : January 20, 2025
  • Published : March 31, 2025

Jeongmin Ahn 1 Hyewon Ryu 2 Dusan Baek 3 Gyeongho Cho 4 Seongbin Choi 5 Ho-Young Kwak 6 Won Joo Lee 7

1숙명여자대학교
2고려대학교
3UNIST
4부산대학교
5경희대학교
6제주대학교
7인하공업전문대학

Accredited

ABSTRACT

In this paper, we proposes a CODA service application equipped with a sign language translation function based on generative AI. The application is characterized by its sign language translation technology and a user interface (UI) that minimizes text. The sign language translation technology consists of the Image2Pose, Pose2Gloss, Gloss2Text, and Image Generation modules. The Image2Pose module analyzes input sign language videos and converts them into images. The Pose2Gloss module translates the meaning of Gloss based on continuous Pose key points. The Gloss2Text module converts Gloss into text, while the Image Generation module converts text into images. The application undergoes field testing with actual CODA users and is refined based on their feedback. Additionally, the need for additional sign language features is identified, and these are implemented using Contrastive Learning. The proposed application is expected to contribute not only to smooth communication within CODA families but also to the advancement of sign language translation technology.

Citation status

* References for papers published after 2023 are currently being built.