Rehabilitation Exergames: use of motion sensing and machine learning to quantify exercise performance in healthy volunteers
File(s)Haghifhi_Rehabilitation exergames_JMIR.pdf (3.69 MB)
Published version
Author(s)
Haghighi Osgouei, Reza
Soulsby, David
Bello, Fernando
Type
Journal Article
Abstract
Background:
Performing physiotherapy exercises in front of a physiotherapist yields qualitative assessment notes and immediate feedback. However, practicing the exercises at home lacks feedback on how well or not patients are performing the prescribed tasks. The absence of proper feedback might result in patients doing the exercises incorrectly, which could worsen their condition.
Objective:
We propose the use of two machine learning algorithms, namely Dynamic Time Warping (DTW) and Hidden Markov Model (HMM), to quantitively assess the patient’s performance with respects to a reference.
Methods:
Movement data were recorded using a Kinect depth sensor, capable of detecting 25 joints in the human skeleton model, and were compared to those of a reference. 16 participants were recruited to perform four different exercises: shoulder abduction, hip abduction, lunge, and sit-to-stand. Their performance was compared to that of a physiotherapist as a reference.
Results:
Both algorithms show a similar trend in assessing participants' performance. However, their sensitivity level was different. While DTW was more sensitive to small changes, HMM captured a general view of the performance, being less sensitive to the details.
Conclusions:
The chosen algorithms demonstrated their capacity to objectively assess physical therapy performances. HMM may be more suitable in the early stages of a physiotherapy program to capture and report general performance, whilst DTW could be used later on to focus on the detail.
Performing physiotherapy exercises in front of a physiotherapist yields qualitative assessment notes and immediate feedback. However, practicing the exercises at home lacks feedback on how well or not patients are performing the prescribed tasks. The absence of proper feedback might result in patients doing the exercises incorrectly, which could worsen their condition.
Objective:
We propose the use of two machine learning algorithms, namely Dynamic Time Warping (DTW) and Hidden Markov Model (HMM), to quantitively assess the patient’s performance with respects to a reference.
Methods:
Movement data were recorded using a Kinect depth sensor, capable of detecting 25 joints in the human skeleton model, and were compared to those of a reference. 16 participants were recruited to perform four different exercises: shoulder abduction, hip abduction, lunge, and sit-to-stand. Their performance was compared to that of a physiotherapist as a reference.
Results:
Both algorithms show a similar trend in assessing participants' performance. However, their sensitivity level was different. While DTW was more sensitive to small changes, HMM captured a general view of the performance, being less sensitive to the details.
Conclusions:
The chosen algorithms demonstrated their capacity to objectively assess physical therapy performances. HMM may be more suitable in the early stages of a physiotherapy program to capture and report general performance, whilst DTW could be used later on to focus on the detail.
Date Issued
2020-08-18
Date Acceptance
2020-06-14
Citation
JMIR Rehabilitation and Assistive Technologies, 2020, 7 (2)
ISSN
2369-2529
Publisher
JMIR Publications Inc.
Journal / Book Title
JMIR Rehabilitation and Assistive Technologies
Volume
7
Issue
2
Copyright Statement
©Reza Haghighi Osgouei, David Soulsby, Fernando Bello. Originally published in JMIR Rehabilitation and Assistive Technology(http://rehab.jmir.org), 18.08.2020. This is an open-access article distributed under the terms of the Creative Commons AttributionLicense (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in anymedium, provided the original work, first published in JMIR Rehabilitation and Assistive Technology, is properly cited. Thecomplete bibliographic information, a link to the original publication on http://rehab.jmir.org/, as well as this copyright and licenseinformation must be included.
License URL
Identifier
https://preprints.jmir.org/preprint/17289/accepted
Subjects
dynamic time warping
hidden Markov model
machine learning
motion sensing
performance assessment
rehabilitation exergames
similarity score
Publication Status
Published
Date Publish Online
2020-06-14