RT-BENE: A Dataset and Baselines for Real-Time Blink Estimation in Natural Environments
File(s)ICCV2019W__Blink_detection_stamped.pdf (1.06 MB)
Accepted version
Author(s)
Cortacero, Kevin
Fischer, Tobias
Demiris, Yiannis
Type
Conference Paper
Abstract
In recent years gaze estimation methods have made substantial progress, driven by the numerous application areas including human-robot interaction, visual attention estimation and foveated rendering for virtual reality headsets. However, many gaze estimation methods typically assume that the subject's eyes are open; for closed eyes, these methods provide irregular gaze estimates. Here, we address this assumption by first introducing a new open-sourced dataset with annotations of the eye-openness of more than 200,000 eye images, including more than 10,000 images where the eyes are closed. We further present baseline methods that allow for blink detection using convolutional neural networks. In extensive experiments, we show that the proposed baselines perform favourably in terms of precision and recall. We further incorporate our proposed RT-BENE baselines in the recently presented RT-GENE gaze estimation framework where it provides a real-time inference of the openness of the eyes. We argue that our work will benefit both gaze estimation and blink estimation methods, and we take steps towards unifying these methods.
Date Issued
2019-10-24
Date Acceptance
2019-08-19
Citation
Workshop Proceedings of the IEEE International Conference on Computer Vision, 2019
Publisher
Institute of Electrical and Electronics Engineers Inc.
Journal / Book Title
Workshop Proceedings of the IEEE International Conference on Computer Vision
Copyright Statement
This ICCV 2019 papers are the Open Access versions, provided by the Computer Vision Foundation.
Except for the watermark, they are identical to the accepted versions; the final published version of the proceedings is available on IEEE Xplore.
Except for the watermark, they are identical to the accepted versions; the final published version of the proceedings is available on IEEE Xplore.
Sponsor
Commission of the European Communities
Royal Academy Of Engineering
Grant Number
643783
CiET1718\46
Source
IEEE International Conference on Computer Vision Workshops
Start Date
2019-10-27
Coverage Spatial
Seoul, Korea