The Development of Realtime Smart Image Mixing System Using GPU Based Video Codec

Seung-Taek Ryoo; Kim, Youung Kwon; Chang, Jae-Khun

KJC Korea
Journal Central

Journal of Knowledge Information Technology and Systems 2022 KCI Impact Factor : 0.9

Korean | English

pISSN : 1975-7700 / eISSN : 2734-0570

http://journal.kci.go.kr/kkits

BACK
TOP

Home > Explore Content > All Issues > Article View

5 of 17

The Development of Realtime Smart Image Mixing System Using GPU Based Video Codec

Journal of Knowledge Information Technology and Systems
Abbr : JKITS
2016, 11(6), pp.617-624

Publisher : Korea Knowledge Information Technology Society
Research Area : Interdisciplinary Research

Published : December 31, 2016

Seung-Taek Ryoo ¹, Kim, Youung Kwon ², Chang, Jae-Khun ¹

¹한신대학교
²오산대학교

ABSTRACT
열림/닫힘 버튼

As a result of recent advances in GPU programming using graphics hardware, many studies have been focused on the application of parallel and realtime rendering. This paper introduces the development of realtime smart image mixing system using ultra high density video based decoding and encoding techniques. The smart image mixing system implements sequential and streaming based image mixer that consists of video decoding, image resizing and mixing, video encoding step. Sequential based image mixing system decodes whole frames from multiple video inputs and merges extracted synchronous frames from multiple videos into single image. And then, encodes each single image into whole frames and save final result video file. Streaming based image mixing system decodes single frame from multiple video inputs and merges an extracted synchronous frame from multiple videos into single image. And then, encodes a merged image into each frame and repeat the above steps(decoding/mixing/encoding) until last frame from multiple video inputs is extracted. We compare sequential based image mixing method with streaming based image mixing method. In temporal performance, streaming based image mixing method is better than sequential based image mixing method. Suggested method can be used in various fields such as image and game contents generation, UHD image display and network service and video conferencing.
KEYWORDS
열림/닫힘 버튼

Realistic media, GPU programming, Ultra high definition, Video codec, Smart systems

Statistics

261 Viewed

25 Downloaded

Tools

Print this page

Download PDF

Export Citation

Sharing

Facebook

Twitter

Issue List

Vol.15 No.6

Vol.15 No.5

Vol.15 No.4

Citation status

KCI Citation Counts (0)
REFERENCES (15)
열림/닫힘 버튼
* 2022년 이후 발행 논문의 참고문헌은 현재 구축 중입니다.

[journal] W. C. Seo / 2013 / The trend of Real media techniques in smart era / The Korean Institute of Communications and Information Science 30(5) : 78~87

[book] H. Nguyen / 2007 / GPU gems 3 / Addison-Wesley Professional

[book] G. Singer / 2013 / The history of the modern graphics processor / Techspot

[journal] J. D. Owens / 2007 / A survey of general-purpose computation on graphics hardware / Computer Graphics Forum 26(1) : 80~113

[other] / 2016 / Graphics Processing Unit (GPU) / Nvidia Corporation

[journal] S. R. Kim / 2012 / The trend of ultra UHD image industry / Journal of Communication & Radion Spectrum (Special) : 54~61

[other] A. Thomas / 2016 / Just how useful is 2160p aka 4K?

[other] A. Cotton / 2015 / Defining the future of television / BBC

[other] / 2014 / Leading Television Industry Players Line Up To Support '4K Ultra HD' / Consumer Electronics Association

[confproc] Y. Shishikui / 2011 / Development of high performance video codec for super hi-vision / 65th NAB Broadcast Engineering Conference : 234~239

[book] P. Joshi / 2016 / OpenCV By example / PACKT Publishing

[book] J. Sanders / 2010 / CUDA by example: An introduction to general-purpose GPU programming / Addison-Wesley Professional

[other] / 2016 / Video Decoder Programming Guide / Nvidia Corporation

[book] G. Seller / 2013 / OpenGL superbible: Comprehensive tutorial and reference / Addison-Wesley Professional

[other] / 2016 / Video Decoder Programming Guide / Nvidia Corporation