IRUS Total

Hand gesture recognition with inertial sensors

File Description SizeFormat 
embc18_gsr_v10-1-2.pdfAccepted version420.65 kBAdobe PDFView/Open
Title: Hand gesture recognition with inertial sensors
Authors: Teachasrisaksakul, K
Wu, L
Yang, G-Z
Lo, B
Item Type: Conference Paper
Abstract: Dyscalculia is a learning difficulty hindering fundamental arithmetical competence. Children with dyscalculia often have difficulties in engaging in lessons taught with traditional teaching methods. In contrast, an educational game is an attractive alternative. Recent educational studies have shown that gestures could have a positive impact in learning. With the recent development of low cost wearable sensors, a gesture based educational game could be used as a tool to improve the learning outcomes particularly for children with dyscalculia. In this paper, two generic gesture recognition methods are proposed for developing an interactive educational game with wearable inertial sensors. The first method is a multilayered perceptron classifier based on the accelerometer and gyroscope readings to recognize hand gestures. As gyroscope is more power demanding and not all low-cost wearable device has a gyroscope, we have simplified the method using a nearest centroid classifier for classifying hand gestures with only the accelerometer readings. The method has been integrated into open-source educational games. Experimental results based on 5 subjects have demonstrated the accuracy of inertial sensor based hand gesture recognitions. The results have shown that both methods can recognize 15 different hand gestures with the accuracy over 93%.
Issue Date: 29-Oct-2018
Date of Acceptance: 8-May-2018
URI: http://hdl.handle.net/10044/1/64800
DOI: https://dx.doi.org/10.1109/EMBC.2018.8513098
ISBN: 978-1-5386-3646-6
ISSN: 1558-4615
Publisher: IEEE
Journal / Book Title: 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
Copyright Statement: © 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Sponsor/Funder: Engineering & Physical Science Research Council (E
British Council (UK)
Funder's Grant Number: EP/K503733/1
Conference Name: 40th International Conference of the IEEE Engineering in Medicine and Biology Society
Publication Status: Published
Start Date: 2018-07-18
Finish Date: 2018-07-21
Conference Place: Honolulu, HI, USA
Appears in Collections:Department of Surgery and Cancer
Faculty of Engineering