본문 바로가기
  • Home

Improvement of Character-net via Detection of Conversation Participant

  • Journal of The Korea Society of Computer and Information
  • Abbr : JKSCI
  • 2009, 14(10), pp.241-249
  • Publisher : The Korean Society Of Computer And Information
  • Research Area : Engineering > Computer Science

김원택 1 Seung Bo Park 1 조근식 1

1인하대학교

Accredited

ABSTRACT

Recently, a number of researches related to video annotation and representation have been proposed to analyze video for searching and abstraction. In this paper, we have presented a method to provide the picture elements of conversational participants in video and the enhanced representation of the characters using those elements, collectively called Character-net. Because conversational participants are decided as characters detected in a script holding time, the previous Character-net suffers serious limitation that some listeners could not be detected as the participants. The participants who complete the story in video are very important factor to understand the context of the conversation. The picture elements for detecting the conversational participants consist of six elements as follows: subtitle, scene, the order of appearance, characters’ eyes, patterns, and lip motion. In this paper, we present how to use those elements for detecting conversational participants and how to improve the representation of the Character-net. We can detect the conversational participants accurately when the proposed elements combine together and satisfy the special conditions. The experimental evaluation shows that the proposed method brings significant advantages in terms of both improving the detection of the conversational participants and enhancing the representation of Character-net.

Citation status

* References for papers published after 2023 are currently being built.