이용자 태그를 활용한 비디오 스피치 요약의 자동 생성 연구 (Investigating an Automatic Method in Summarizing a Video Speech Using User-Assigned Tags)

김현희 (Kim, Hyun Hee)

doi:10.4275/KSLIS.2012.46.1.163

Investigating an Automatic Method in Summarizing a Video Speech Using User-Assigned Tags

Journal of the Korean Society for Library and Information Science
2012, 46(1), pp.163-181
DOI : 10.4275/KSLIS.2012.46.1.163
Publisher : 한국문헌정보학회
Research Area : Interdisciplinary Studies > Library and Information Science
Received : January 16, 2012
Accepted : February 8, 2012

Kim, Hyun Hee ¹

¹명지대학교

Accredited

ABSTRACT

We investigated how useful video tags were in summarizing video speech and how valuable positional information was for speech summarization. Furthermore, we examined the similarity among sentences selected for a speech summary to reduce its redundancy. Based on such analysis results, we then designed and evaluated a method for automatically summarizing speech transcripts using a modified Maximum Marginal Relevance model. This model did not only reduce redundancy but it also enabled the use of social tags, title words, and sentence positional information. Finally, we compared the proposed method to the Extractor system in which key sentences of a video speech were chosen using the frequency and location information of speech content words. Results showed that the precision and recall rates of the proposed method were higher than those of the Extractor system, although there was no significant difference in the recall rates.

KEYWORDS

MMR Model, Social Summarization, Redundancy, Acoustic features, Prosodic Features, Extractor, Transcripts

Citation status

* References for papers published after 2023 are currently being built.

[journal] 김현희 / 2009 / Investigating the Efficient Method for Constructing Audio Surrogates of Digital Video Data / 정보관리학회지 / 한국정보관리학회 26(3) : 169~188

[journal] 김현희 / 2011 / A Study on the Interactive Effect of Spoken Words and Imagery not Synchronized in Multimedia Surrogates for Video Gisting / 한국문헌정보학회지 / 한국문헌정보학회 45(2) : 97~118

[book] 정영미 / 2007 / 정보검색연구 / 구미무역출판부

[journal] 이한성 / 2010 / A News Video Mining based on Multi-modal Approach and Text Mining / 정보과학회논문지 : 데이타베이스 / 한국정보과학회 37(3) : 127~136

[journal] Boydell, O. / 2010 / Social summarization in collaborative web search / Information Processing and Management (6) : 782~798

[journal] Chen, B. / 2012 / A risk-aware modeling framework for speech summarization / IEEE Transactions on Audio, Speech, and Language Processing 20(1) : 211~222

[confproc] Christensen, H. / 2003 / Are extractive text summarisation techniques portable to broadcast news? / Proceedings of Automatic Speech Recognition and Understanding Workshop : 489~494

[journal] Chung, M. / 2011 / Video summarisation based on collaborative temporal tags / Online Information Review 35(4) : 653~668

[confproc] Goldstein, J. / 2000 / Multi-document summarization by sentence extraction / Proceedings of the 2000 NAACL-ANLP Workshop on Automatic Summarization(NAACL-ANLP-AutoSum '00) / Association for Computational Linguistics 4 : 40~48

[confproc] Hannon, J. / 2011 / Personalized and automatic social summarization of events in video / Proceedings of the 16th International Conference on Intelligent User Interfaces : 335~338

[confproc] Heckner, M. / 2008 / Tree, funny, to read, google: What are tags supposed to achieve? / Proceedings of the 2008 ACM Workshop on Search in Social Media

[journal] Hirohata, M. / 2006 / Sentence-extractive automatic speech summarization and evaluation techniques / Speech Communication 48(9) : 1151~1161

[journal] 김현희 / 201101 / Toward Video Semantic Search Based on a Structured Folksonomy / JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY / WILEY-BLACKWELL 62(3) : 478~492

[book] Liu, Y. / 2011 / Speech summarization, In Spoken Language Understanding: Systems for Extracting Semantic Information from Speech. G / Wiley : 357~392

[confproc] Maskey, S. / 2006 / Summarizing speech without text using Hidden Markov Models / Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers(NAACL-Short'06) / Association for Computational Linguistics : 89~92

[journal] Marchionini, G. / 2009 / Multimedia surrogates for video gisting: Toward combining spoken words and imagery / Information Processing and Management 45(6) : 615~630

[confproc] Murray, G. / 2005 / Extractive summarization of meeting recordings / Proceedings of the 9th European Conference on Speech Communication and Technology (INTERSPEECH) : 593~596

[confproc] Song, Y. / 2007 / Effects of audio and visual surrogates for making sense of digital video / Proceedings of CHI 2007 : 867~876

[journal] Turney, P. / 2000 / Learning algorithms for keyphrase extraction / Information Retrieval 2(4) : 303~336

[confproc] Xie, S. / 2008 / Using corpus and knowledge-based similarity measure in maximum marginal relevance for meeting summarization / IEEE International Conference on Acoustics, Speech and Signal Processing : 4985~4988

[confproc] Xie, S. / 2009 / Integrating prosodic features in extractive meeting summarization / Proceedings of Automatic Speech Recognition & Understanding

[journal] Zechner, K. / 2002 / Automatic summarization of open-domain multiparty dialogues in diverse genres / Computational Linguistics 28(4) : 447~485

[confproc] Zhang, J. / 2007 / A comparative study on speech summarization of broadcast news and lecture speech / INTERSPEECH-2007 : 2781~2784

[confproc] Zhu, J. / 2009 / Tag-oriented document summarization / Proceedings of the 18th International Conference on World Wide Web : 1195~1196

[confproc] Zhu, X. / 2009 / Summarizing multiple spoken documents: Finding evidence from untranscribed audio / Proceedings of ACL/AFNLP : 549~557

This paper was written with support from the National Research Foundation of Korea.

KJCKorea
Journal Central

Journal of the Korean Society for Library and Information Science 2023 KCI Impact Factor : 0.84

Investigating an Automatic Method in Summarizing a Video Speech Using User-Assigned Tags

ABSTRACT

KEYWORDS

Citation status

* References for papers published after 2023 are currently being built.

Journal of the Korean Society for Library and Information Science 2023 KCI Impact Factor : 0.84

Investigating an Automatic Method in Summarizing a Video Speech Using User-Assigned Tags

ABSTRACT

KEYWORDS

Statistics

Tools

Issue List

Citation status

KCI Citation Counts (2)

REFERENCES (25) * References for papers published after 2023 are currently being built.

Search PDF

Citation

* References for papers published after 2023 are currently being built.