Hand gesture recognition with inertial sensors
File(s)embc18_gsr_v10-1-2.pdf (420.65 KB)
Accepted version
Author(s)
Teachasrisaksakul, Krittameth
Wu, Liqun
Yang, Guang-Zhong
Lo, Benny
Type
Conference Paper
Abstract
Dyscalculia is a learning difficulty hindering fundamental arithmetical competence. Children with dyscalculia often have difficulties in engaging in lessons taught with traditional teaching methods. In contrast, an educational game is an attractive alternative. Recent educational studies have shown that gestures could have a positive impact in learning. With the recent development of low cost wearable sensors, a gesture based educational game could be used as a tool to improve the learning outcomes particularly for children with dyscalculia. In this paper, two generic gesture recognition methods are proposed for developing an interactive educational game with wearable inertial sensors. The first method is a multilayered perceptron classifier based on the accelerometer and gyroscope readings to recognize hand gestures. As gyroscope is more power demanding and not all low-cost wearable device has a gyroscope, we have simplified the method using a nearest centroid classifier for classifying hand gestures with only the accelerometer readings. The method has been integrated into open-source educational games. Experimental results based on 5 subjects have demonstrated the accuracy of inertial sensor based hand gesture recognitions. The results have shown that both methods can recognize 15 different hand gestures with the accuracy over 93%.
Date Issued
2018-10-29
Date Acceptance
2018-05-08
Citation
2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2018, 2018, pp.3517-3520
ISBN
978-1-5386-3646-6
ISSN
1558-4615
Publisher
IEEE
Start Page
3517
End Page
3520
Journal / Book Title
2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
Volume
2018
Copyright Statement
© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor
Engineering & Physical Science Research Council (E
British Council (UK)
Identifier
https://www.ncbi.nlm.nih.gov/pubmed/30441137
Grant Number
EP/K503733/1
330760239
Source
40th International Conference of the IEEE Engineering in Medicine and Biology Society
Publication Status
Published
Start Date
2018-07-18
Finish Date
2018-07-21
Coverage Spatial
Honolulu, HI, USA