Inferring human knowledgeability from eye gaze in mobile learning environments
Author(s)
Celiktutan, Oya
Demiris, Yiannis
Type
Conference Paper
Abstract
What people look at during a visual task reflects an interplay between ocular motor functions and cognitive processes. In this paper, we study the links between eye gaze and cognitive states to investigate whether eye gaze reveal information about an individual’s knowledgeability. We focus on a mobile learning scenario where a user and a virtual agent play a quiz game using a hand-held mobile device. To the best of our knowledge, this is the first attempt to predict user’s knowledgeability from eye gaze using a noninvasive eye tracking method on mobile devices: we perform gaze estimation using front-facing camera of mobile devices in contrast to using specialised eye tracking devices. First, we define a set of eye movement features that are discriminative for inferring user’s knowledgeability. Next, we train a model to predict users’ knowledgeability in the course of responding to a question. We obtain a classification performance of 59.1% achieving human performance, using eye movement features only, which has implications for (1) adapting behaviours of the virtual agent to user’s needs (e.g., virtual agent can give hints); (2) personalising quiz questions to the user’s perceived knowledgeability.
Editor(s)
LealTaixe, L
Roth, S
Date Issued
2019-01-23
Date Acceptance
2019-01-01
Citation
COMPUTER VISION - ECCV 2018 WORKSHOPS, PT VI, 2019, 11134, pp.193-209
ISBN
978-3-030-11023-9
ISSN
0302-9743
Publisher
SPRINGER INTERNATIONAL PUBLISHING AG
Start Page
193
End Page
209
Journal / Book Title
COMPUTER VISION - ECCV 2018 WORKSHOPS, PT VI
Volume
11134
Copyright Statement
© Springer Nature Switzerland AG 2019. The final publication is available at Springer via https://doi.org/10.1007/978-3-030-11024-6_13
Sponsor
Commission of the European Communities
Identifier
http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000594200000013&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=1ba7043ffcc86c417c072aa74d649202
Grant Number
643783
Source
15th European Conference on Computer Vision (ECCV)
Subjects
Science & Technology
Technology
Computer Science, Artificial Intelligence
Imaging Science & Photographic Technology
Computer Science
Assistive mobile applications
Noninvasive gaze tracking
Analysis of eye movements
Human knowledgeability prediction
Publication Status
Published
Start Date
2018-09-08
Finish Date
2018-09-14
Coverage Spatial
Munich, GERMANY
Date Publish Online
2019-01-23