Non-intrusive Calibration for User Interaction based Gaze Estimation (사용자 상호작용 기반의 시선 검출을 위한 비강압식 캘리브레이션)

YongSoo Choi (이태균); Jang-Hee Yoo (유장희)

doi:10.29056/jsav.2020.06.06

Non-intrusive Calibration for User Interaction based Gaze Estimation

Journal of Software Assessment and Valuation
Abbr : JSAV
2020, 16(1), pp.45-53
DOI : 10.29056/jsav.2020.06.06
Publisher : Korea Software Assessment and Valuation Society
Research Area : Engineering > Computer Science
Received : May 17, 2020
Accepted : June 19, 2020
Published : June 30, 2020

YongSoo Choi ¹, Jang-Hee Yoo ²

¹과학기술연합대학원대학교 ICT전공
²한국전자통신연구원

Candidate

ABSTRACT

In this paper, we describe a new method for acquiring calibration data using a user interaction process, which occurs continuously during web browsing in gaze estimation, and for performing calibration naturally while estimating the user's gaze. The proposed non-intrusive calibration is a tuning process over the pre-trained gaze estimation model to adapt to a new user using the obtained data. To achieve this, a generalized CNN model for estimating gaze is trained, then the non-intrusive calibration is employed to adapt quickly to new users through online learning. In experiments, the gaze estimation model is calibrated with a combination of various user interactions to compare the performance, and improved accuracy is achieved compared to existing methods.

KEYWORDS

gaze estimation, non-intrusive calibration, user interaction, convolutional neural network

Citation status

* References for papers published after 2023 are currently being built.

[confproc] X. Wang / 2015 / A Survey on Gaze Estimation / Proceeding of the 10th International Conference on Intelligent Systems and Knowledge Engineering : 260~267

[journal] Keith Rayner / 1998 / Eye movements in reading and information processing: 20 years of research / Psychological Bulletin / American Psychological Association (APA) 124(3) : 372~422

[confproc] G. Buscher / 2008 / Eye Movements as Implicit Relevance Feedback / Proceeding of the CHI'08Extended Abstracts on Human Factors in Computing Systems : 2991~2996

[web] L. E. Nacke / 2010 / Gameplay Experience in a Gaze Interaction Game, arXiv preprint arXiv:1004.0259 / https://arxiv.org/abs/1004.0259

[journal] Anahita Navab / 2012 / Eye-Tracking as a Measure of Responsiveness to Joint Attention in Infants at Risk for Autism / Infancy / Wiley 17(4) : 416~431

[journal] Moshe Eizenman / 2003 / A naturalistic visual scanning approach to assess selective attention in major depressive disorder / Psychiatry Research / Elsevier BV 118(2) : 117~128

[confproc] S. S. Deepika / 2015 / A Novel Approach for Human Computer Interface based on Eye Movements for Disabled People / Proceeding of the IEEE International Conference on Electrical, Computer and Communication Technologies : 1~3

[journal] J. P. Johnson / 2013 / Targeted Advertising and Advertising Avoidance / The RAND Journal of Economics 44(1) : 128~144

[confproc] E. D. Guestrin / 2008 / Remote Point-of-Gaze Estimation Requiring a Single-point Calibration for Applications with Infants / Proceeding of the 2008Symposium on Eye Tracking Research &Applications(ETRA) : 267~274

[journal] Yilmaz Durna / 2017 / Design of a Binocular Pupil and Gaze Point Detection System Utilizing High Definition Images / Applied Sciences / MDPI AG 7(5) : 1~16

[journal] Muhammad Syaiful Amri bin Suhaimi / 2019 / 24-Gaze-Point Calibration Method for Improving the Precision of AC-EOG Gaze Estimation / Sensors / MDPI AG 19(17) : 1~13

[journal] Katarzyna Harezlak / 2014 / Towards Accurate Eye Tracker Calibration – Methods and Procedures / Procedia Computer Science / Elsevier BV 35 : 1073~1081

[confproc] T. Nagamatsu / 2009 / Calibration-free Gaze Tracking using a Binocular 3D Eye Model / Proceeding of the CHI'09 Extended Abstracts on Human Factors in Computing Systems : 3613~3618

[confproc] S. W. Shih / 2000 / A Calibration-free Gaze Tracking Technique / Proceeding of International Conference on Pattern Recognition (ICPR) : 201~204

[confproc] K. Wang / 2016 / Deep Eye Fixation Map Learning for Calibrationfree Eye Gaze Tracking / Proceeding of the 9th Biennial ACM Symposium on Eye Tracking Research & Applications (ETRA) : 47~55

[confproc] Y. Sugano / 2010 / Calibration-free Gaze Sensing using Saliency Maps / Proceeding of the International Conference on Computer Vision and Pattern Recognition (CVPR) : 2667~2674

[confproc] X. Zhang / 2017 / It's Written All over Your Face:Full-face Appearance-based Gaze Estimation / Proceeding of the International Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) : 51~60

[confproc] D. Sahoo / 2017 / Online Deep Learning: Learning Deep Neural Networks on The Fly / Proceeding of the Twenty-Seventh International Joint Conference on Artificial Intelligence (IJCAI) : 2660~2666

[confproc] D. J. Liebling / 2014 / Gaze and Mouse Coordination in Everyday Work / Proceeding of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing:Adjunct Publication : 1141~1150

[confproc] J. Huang / 2012 / User See, User Point : Gaze and Cursor Alignment in Web Search / Proceeding of the SIGCHI Conference on Human Factors in Computing Systems : 1341~1350

[confproc] A. Papoutsaki / 2018 / The Eye of the Typer: a Benchmark and Analysis of Gaze Behavior during Typing / Proceeding of the 2018 ACM Symposium on Eye Tracking Research & Applications (ETRA) : 1~9

[confproc] A. Krizhevsky / 2012 / ImageNet Classification with Deep Convolutional Neural Networks / Proceeding of Advances in Neural Information Processing Systems (NIPS) : 1097~1105

[web] / 2020 / https://www.tobiipro.com/ko/productlisting/tobii-pro-x3-120/ / https://www.tobiipro.com/ko/productlisting/tobii-pro-x3-120/

[confproc] A. Papoutsaki / 2016 / Webgazer: Scalable Webcam Eye Tracking using User Interactions / Proceeding of the 25th International Joint Conference on Artificial Intelligence (IJCAI) : 3839~3845

KJCKorea
Journal Central

Journal of Software Assessment and Valuation 2023 KCI Impact Factor : 0.35

Non-intrusive Calibration for User Interaction based Gaze Estimation

ABSTRACT

KEYWORDS

Citation status

* References for papers published after 2023 are currently being built.

Journal of Software Assessment and Valuation 2023 KCI Impact Factor : 0.35

Non-intrusive Calibration for User Interaction based Gaze Estimation

ABSTRACT

KEYWORDS

Statistics

Tools

Issue List

Citation status

KCI Citation Counts (2)

REFERENCES (24) * References for papers published after 2023 are currently being built.

Search PDF

Citation

* References for papers published after 2023 are currently being built.