Assessing the predictive validity of the UCAT—A systematic review and narrative synthesis
Author(s)
Bala, Laksha
Pedder, Stephen
Sam, Amir H
Brown, Celia
Type
Journal Article
Abstract
Background
The University Clinical Aptitude Test (UCAT) is an admissions assessment used by a consortium of universities across the UK, Australia, and New Zealand, to aid the selection of applicants to medical and dental degree programmes. The UCAT aims to measure the mental aptitude and professional behaviours required to become successful doctors and dentists. We conducted a systematic review to establish the predictive value of the UCAT across measures of performance at undergraduate and post-graduate levels.
Methods
A literature search was conducted in April 2020 using eight electronic databases: MEDLINE, APA PsycInfo, SCOPUS, Web of Science, EThOS, OpenGrey, PROSPERO, and the UCAT website. Data were extracted from selected studies and tabulated as results matrices. A narrative synthesis was performed.
Results
Twenty-four studies satisfied our inclusion criteria, 23 of which were deemed to be of good quality (using the Newcastle-Ottawa Scale). For over 70% of univariate data points, the UCAT exerted no statistically significant predictive validity; for the remainder, predictive power was weak. The cognitive total and verbal reasoning subtests had the largest evidence base as weakly positive predictors of academic performance. The SJT subtest was a weak predictor of professional behaviour during medical school. Studies specific to dental schools demonstrated variable findings across the five studies. Only 1 study looked at post-graduate outcome measures and demonstrated that the UCAT was not a predictor of health- or conduct-related fitness to practice declarations at GMC registration.
Conclusions
These data provide some support for the use of cognitive total and verbal reasoning subtests as part of medical school selection. Further research is needed to investigate outcomes beyond professional registration and for dental students.
The University Clinical Aptitude Test (UCAT) is an admissions assessment used by a consortium of universities across the UK, Australia, and New Zealand, to aid the selection of applicants to medical and dental degree programmes. The UCAT aims to measure the mental aptitude and professional behaviours required to become successful doctors and dentists. We conducted a systematic review to establish the predictive value of the UCAT across measures of performance at undergraduate and post-graduate levels.
Methods
A literature search was conducted in April 2020 using eight electronic databases: MEDLINE, APA PsycInfo, SCOPUS, Web of Science, EThOS, OpenGrey, PROSPERO, and the UCAT website. Data were extracted from selected studies and tabulated as results matrices. A narrative synthesis was performed.
Results
Twenty-four studies satisfied our inclusion criteria, 23 of which were deemed to be of good quality (using the Newcastle-Ottawa Scale). For over 70% of univariate data points, the UCAT exerted no statistically significant predictive validity; for the remainder, predictive power was weak. The cognitive total and verbal reasoning subtests had the largest evidence base as weakly positive predictors of academic performance. The SJT subtest was a weak predictor of professional behaviour during medical school. Studies specific to dental schools demonstrated variable findings across the five studies. Only 1 study looked at post-graduate outcome measures and demonstrated that the UCAT was not a predictor of health- or conduct-related fitness to practice declarations at GMC registration.
Conclusions
These data provide some support for the use of cognitive total and verbal reasoning subtests as part of medical school selection. Further research is needed to investigate outcomes beyond professional registration and for dental students.
Date Issued
2021-11-23
Date Acceptance
2021-10-19
Citation
Medical Teacher, 2021, 44 (4), pp.401-409
ISSN
0142-159X
Publisher
Informa UK Limited
Start Page
401
End Page
409
Journal / Book Title
Medical Teacher
Volume
44
Issue
4
Copyright Statement
© 2021 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
License URL
Identifier
https://www.tandfonline.com/doi/full/10.1080/0142159X.2021.1998401
Subjects
Social Sciences
Science & Technology
Life Sciences & Biomedicine
Education, Scientific Disciplines
Health Care Sciences & Services
Education & Educational Research
Assessment
medicine
predictive
validity
UCAT
CLINICAL APTITUDE-TEST
SITUATIONAL JUDGMENT TEST
MEDICAL-SCHOOL
1 PERFORMANCE
SELECTION
UKCAT
EXAM
MCAT
Assessment
UCAT
medicine
predictive
validity
Achievement
Aptitude Tests
Humans
School Admission Criteria
Schools, Medical
Universities
1301 Education Systems
1302 Curriculum and Pedagogy
1303 Specialist Studies in Education
Medical Informatics
Publication Status
Published
Date Publish Online
2021-11-23