Benchtop simulation of the retrosigmoid approach: validation of a surgical simulator and development of a task-specific outcome measure score
Author(s)
Williams, Simon C
Ahmed, Razna
Davids, Joseph Darlington
Funnell, Jonathan P
Hanrahan, John Gerrard
Type
Journal Article
Abstract
Background
Neurosurgical training is changing globally. Reduced working hours and training opportunities, increased patient safety expectations, and the impact of COVID-19 have reduced operative exposure. Benchtop simulators enable trainees to develop surgical skills in a controlled environment. We aim to validate a high-fidelity simulator model (RetrosigmoidBox, UpSurgeOn) for the retrosigmoid approach to the cerebellopontine angle (CPA).
Methods
Novice and expert Neurosurgeons and Ear, Nose, and Throat surgeons performed a surgical task using the model – identification of the trigeminal nerve. Experts completed a post-task questionnaire examining face and content validity. Construct validity was assessed through scoring of operative videos employing Objective Structured Assessment of Technical Skills (OSATS) and a novel Task-Specific Outcome Measure score.
Results
Fifteen novice and five expert participants were recruited. Forty percent of experts agreed or strongly agreed that the brain tissue looked real. Experts unanimously agreed that the RetrosigmoidBox was appropriate for teaching. Statistically significant differences were noted in task performance between novices and experts, demonstrating construct validity. Median total OSATS score was 14/25 (IQR 10–19) for novices and 22/25 (IQR 20–22) for experts (p < 0.05). Median Task-Specific Outcome Measure score was 10/20 (IQR 7–17) for novices compared to 19/20 (IQR 18.5–19.5) for experts (p < 0.05).
Conclusion
The RetrosigmoidBox benchtop simulator has a high degree of content and construct validity and moderate face validity. The changing landscape of neurosurgical training mean that simulators are likely to become increasingly important in the delivery of high-quality education. We demonstrate the validity of a Task-Specific Outcome Measure score for performance assessment of a simulated approach to the CPA.
Neurosurgical training is changing globally. Reduced working hours and training opportunities, increased patient safety expectations, and the impact of COVID-19 have reduced operative exposure. Benchtop simulators enable trainees to develop surgical skills in a controlled environment. We aim to validate a high-fidelity simulator model (RetrosigmoidBox, UpSurgeOn) for the retrosigmoid approach to the cerebellopontine angle (CPA).
Methods
Novice and expert Neurosurgeons and Ear, Nose, and Throat surgeons performed a surgical task using the model – identification of the trigeminal nerve. Experts completed a post-task questionnaire examining face and content validity. Construct validity was assessed through scoring of operative videos employing Objective Structured Assessment of Technical Skills (OSATS) and a novel Task-Specific Outcome Measure score.
Results
Fifteen novice and five expert participants were recruited. Forty percent of experts agreed or strongly agreed that the brain tissue looked real. Experts unanimously agreed that the RetrosigmoidBox was appropriate for teaching. Statistically significant differences were noted in task performance between novices and experts, demonstrating construct validity. Median total OSATS score was 14/25 (IQR 10–19) for novices and 22/25 (IQR 20–22) for experts (p < 0.05). Median Task-Specific Outcome Measure score was 10/20 (IQR 7–17) for novices compared to 19/20 (IQR 18.5–19.5) for experts (p < 0.05).
Conclusion
The RetrosigmoidBox benchtop simulator has a high degree of content and construct validity and moderate face validity. The changing landscape of neurosurgical training mean that simulators are likely to become increasingly important in the delivery of high-quality education. We demonstrate the validity of a Task-Specific Outcome Measure score for performance assessment of a simulated approach to the CPA.
Date Issued
2023-10-01
Date Acceptance
2023-06-12
Citation
World Neurosurgery: X, 2023, 20
ISSN
2590-1397
Publisher
Elsevier
Journal / Book Title
World Neurosurgery: X
Volume
20
Copyright Statement
© 2023 The Authors. Published by Elsevier Inc. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/bync-nd/4.0/).
License URL
Subjects
ACQUISITION
Clinical Neurology
COVID-19
DELIBERATE PRACTICE
Education
ERRORS
IMPACT
Life Sciences & Biomedicine
Microvascular decompression
MICROVASCULAR DECOMPRESSION
MODEL
Model validation
Neurosciences & Neurology
Neurosurgery
Retrosigmoid craniotomy
Science & Technology
Simulation training
Surgery
TECHNICAL SKILLS
VALIDITY
Publication Status
Published
Article Number
100230
Date Publish Online
2023-06-24