A Descriptive Analysis of the Use of Workplace-Based Assessments in UK Surgical Training
File(s)ISCP Analysis 10032015_clean.docx (122.5 KB)
Accepted version
Author(s)
Shalhoub, J
Santos, C
Bussey, M
Eardley, I
Allum, W
Type
Journal Article
Abstract
Background
Workplace-based assessments (WBAs) were introduced formally in the UK in 2007. The aim of the study was to describe the use of WBAs by UK surgical trainees and examine variations by training region, specialty, and level of training.
Methods
The database of the Intercollegiate Surgical Curriculum Programme was examined for WBAs between August 2007 and July 2013, with in-depth analysis of 2 periods: August 2011 to July 2012 and August 2012 to July 2013.
Results
The numbers of validated WBAs per trainee per year increased more than 7-fold, from median 6 per trainee in 2007 to 2008, to 39 in 2011 to 2012, and 44 in 2012 to 2013. In the period 2011 to 2012, 58.4% of core trainees completed the recommended 40 WBAs, with only 38.1% of specialty trainees achieving 40 validated WBAs. In the period 2012 to 2013, these proportions increased to 67.7% and 57.0% for core and specialty trainees, respectively. Core trainees completed more WBAs per year than specialty trainees in the same training region. London core trainees completed the highest numbers of WBAs in both the periods 2011 to 2012 (median 67) and 2012 to 2013 (median 74). There was a peak in WBAs completed by London specialty trainees in the period 2012 to 2013 (median 63). The most validated WBAs were completed by ST1/CT1 (specialty surgical training year, core surgical training year), with a gradual decrease in median WBAs to ST4, followed by a plateau; in the period 2012 to 2013, there was an increase in WBAs at ST8. Core surgical trainees complete ~50% “operative” (procedure-based assessment/direct observation of procedural skills) and ~50% “nonoperative” assessments (case-based discussion/clinical evaluation exercise). During specialty training, procedure-based assessments represented ~46% of WBAs, direct observation of procedural skills 11.2%, case-based discussion ~23%, and clinical evaluation exercise ~15%.
Conclusions
UK surgical trainees are, on an average, undertaking 1 WBA per week. Variation exists in use of WBAs between training regions. Core trainees tend to use the spectrum of WBAs more frequently than their senior colleagues do. Further work is required to examine the role of WBAs in assessment, and engagement and training of trainers in processes and validation of WBAs.
Workplace-based assessments (WBAs) were introduced formally in the UK in 2007. The aim of the study was to describe the use of WBAs by UK surgical trainees and examine variations by training region, specialty, and level of training.
Methods
The database of the Intercollegiate Surgical Curriculum Programme was examined for WBAs between August 2007 and July 2013, with in-depth analysis of 2 periods: August 2011 to July 2012 and August 2012 to July 2013.
Results
The numbers of validated WBAs per trainee per year increased more than 7-fold, from median 6 per trainee in 2007 to 2008, to 39 in 2011 to 2012, and 44 in 2012 to 2013. In the period 2011 to 2012, 58.4% of core trainees completed the recommended 40 WBAs, with only 38.1% of specialty trainees achieving 40 validated WBAs. In the period 2012 to 2013, these proportions increased to 67.7% and 57.0% for core and specialty trainees, respectively. Core trainees completed more WBAs per year than specialty trainees in the same training region. London core trainees completed the highest numbers of WBAs in both the periods 2011 to 2012 (median 67) and 2012 to 2013 (median 74). There was a peak in WBAs completed by London specialty trainees in the period 2012 to 2013 (median 63). The most validated WBAs were completed by ST1/CT1 (specialty surgical training year, core surgical training year), with a gradual decrease in median WBAs to ST4, followed by a plateau; in the period 2012 to 2013, there was an increase in WBAs at ST8. Core surgical trainees complete ~50% “operative” (procedure-based assessment/direct observation of procedural skills) and ~50% “nonoperative” assessments (case-based discussion/clinical evaluation exercise). During specialty training, procedure-based assessments represented ~46% of WBAs, direct observation of procedural skills 11.2%, case-based discussion ~23%, and clinical evaluation exercise ~15%.
Conclusions
UK surgical trainees are, on an average, undertaking 1 WBA per week. Variation exists in use of WBAs between training regions. Core trainees tend to use the spectrum of WBAs more frequently than their senior colleagues do. Further work is required to examine the role of WBAs in assessment, and engagement and training of trainers in processes and validation of WBAs.
Date Issued
2015-09-01
Date Acceptance
2015-05-14
Citation
Journal of Surgical Education, 2015, 72 (5), pp.786-794
ISSN
1931-7204
Publisher
Elsevier
Start Page
786
End Page
794
Journal / Book Title
Journal of Surgical Education
Volume
72
Issue
5
Copyright Statement
© 2015, Elsevier. Licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/
Subjects
Social Sciences
Science & Technology
Life Sciences & Biomedicine
Education, Scientific Disciplines
Surgery
Education & Educational Research
workplace-based assessment
surgical training
intercollegiate surgical curriculum programme
Publication Status
Published