Assessing arthroscopic skills using wireless elbow-worn motion sensors
File(s)1119.full.pdf (1.13 MB)
Published version
Author(s)
Type
Journal Article
Abstract
Background: Assessment of surgical skill is a critical component of surgical training. Approaches to assessment remain predominantly subjective, although more objective measures such as Global Rating Scales are in use. This study aimed to validate the use of elbow-worn, wireless, miniaturized motion sensors to assess the technical skill of trainees performing arthroscopic procedures in a simulated environment.
Methods: Thirty participants were divided into three groups on the basis of their surgical experience: novices (n = 15), intermediates (n = 10), and experts (n = 5). All participants performed three standardized tasks on an arthroscopic virtual reality simulator while wearing wireless wrist and elbow motion sensors. Video output was recorded and a validated Global Rating Scale was used to assess performance; dexterity metrics were recorded from the simulator. Finally, live motion data were recorded via Bluetooth from the wireless wrist and elbow motion sensors and custom algorithms produced an arthroscopic performance score.
Results: Construct validity was demonstrated for all tasks, with Global Rating Scale scores and virtual reality output metrics showing significant differences between novices, intermediates, and experts (p < 0.001). The correlation of the virtual reality path length to the number of hand movements calculated from the wireless sensors was very high (p < 0.001). A comparison of the arthroscopic performance score levels with virtual reality output metrics also showed highly significant differences (p < 0.01). Comparisons of the arthroscopic performance score levels with the Global Rating Scale scores showed strong and highly significant correlations (p < 0.001) for both sensor locations, but those of the elbow-worn sensors were stronger and more significant (p < 0.001) than those of the wrist-worn sensors.
Conclusions: A new wireless assessment of surgical performance system for objective assessment of surgical skills has proven valid for assessing arthroscopic skills. The elbow-worn sensors were shown to achieve an accurate assessment of surgical dexterity and performance.
Clinical Relevance: The validation of an entirely objective assessment of arthroscopic skill with wireless elbow-worn motion sensors introduces, for the first time, a feasible assessment system for the live operating theater with the added potential to be applied to other surgical and interventional specialties.
Methods: Thirty participants were divided into three groups on the basis of their surgical experience: novices (n = 15), intermediates (n = 10), and experts (n = 5). All participants performed three standardized tasks on an arthroscopic virtual reality simulator while wearing wireless wrist and elbow motion sensors. Video output was recorded and a validated Global Rating Scale was used to assess performance; dexterity metrics were recorded from the simulator. Finally, live motion data were recorded via Bluetooth from the wireless wrist and elbow motion sensors and custom algorithms produced an arthroscopic performance score.
Results: Construct validity was demonstrated for all tasks, with Global Rating Scale scores and virtual reality output metrics showing significant differences between novices, intermediates, and experts (p < 0.001). The correlation of the virtual reality path length to the number of hand movements calculated from the wireless sensors was very high (p < 0.001). A comparison of the arthroscopic performance score levels with virtual reality output metrics also showed highly significant differences (p < 0.01). Comparisons of the arthroscopic performance score levels with the Global Rating Scale scores showed strong and highly significant correlations (p < 0.001) for both sensor locations, but those of the elbow-worn sensors were stronger and more significant (p < 0.001) than those of the wrist-worn sensors.
Conclusions: A new wireless assessment of surgical performance system for objective assessment of surgical skills has proven valid for assessing arthroscopic skills. The elbow-worn sensors were shown to achieve an accurate assessment of surgical dexterity and performance.
Clinical Relevance: The validation of an entirely objective assessment of arthroscopic skill with wireless elbow-worn motion sensors introduces, for the first time, a feasible assessment system for the live operating theater with the added potential to be applied to other surgical and interventional specialties.
Date Issued
2015-07-01
Date Acceptance
2015-07-01
Citation
Journal of Bone and Joint Surgery-American Volume, 2015, 97A (13), pp.1119-1127
ISSN
1535-1386
Publisher
Journal of Bone and Joint Surgery, Inc
Start Page
1119
End Page
1127
Journal / Book Title
Journal of Bone and Joint Surgery-American Volume
Volume
97A
Issue
13
Copyright Statement
© 2015 The Journal of Bone and Joint Surgery, Inc. All Rights Reserved.
Sponsor
Engineering & Physical Science Research Council (EPSRC)
Imperial College Healthcare NHS Trust- BRC Funding
Imperial College Healthcare NHS Trust- BRC Funding
Engineering & Physical Science Research Council (EPSRC)
Grant Number
EP/H009744/1
RDB04 79560
RD207
EP/L014149/1
Subjects
Science & Technology
Life Sciences & Biomedicine
Orthopedics
Surgery
GLOBAL RATING-SCALE
OPERATIVE EXPERIENCE
TECHNICAL SKILLS
SURGICAL SKILLS
ADVERSE EVENTS
PERFORMANCE
COMPETENCE
SIMULATION
EDUCATION
SURGERY
Arthroscopy
Clinical Competence
Elbow
Humans
Models, Anatomic
Psychomotor Performance
Remote Sensing Technology
Reproducibility of Results
Shoulder Joint
Wrist
0903 Biomedical Engineering
1103 Clinical Sciences
Publication Status
Published