Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension
File(s)s41591-020-1037-7.pdf (1009.48 KB)
Published version
Author(s)
Type
Journal Article
Abstract
The SPIRIT 2013 statement aims to improve the completeness of clinical trial protocol reporting by providing evidence-based recommendations for the minimum set of items to be addressed. This guidance has been instrumental in promoting transparent evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate their impact on health outcomes. The SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence) extension is a new reporting guideline for clinical trial protocols evaluating interventions with an AI component. It was developed in parallel with its companion statement for trial reports: CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 26 candidate items, which were consulted upon by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a consensus meeting (31 stakeholders) and refined through a checklist pilot (34 participants). The SPIRIT-AI extension includes 15 new items that were considered sufficiently important for clinical trial protocols of AI interventions. These new items should be routinely reported in addition to the core SPIRIT 2013 items. SPIRIT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention will be integrated, considerations for the handling of input and output data, the human-AI interaction and analysis of error cases. SPIRIT-AI will help promote transparency and completeness for clinical trial protocols for AI interventions. Its use will assist editors and peer reviewers, as well as the general readership, to understand, interpret and critically appraise the design and risk of bias for a planned clinical trial.
Date Issued
2020-09-09
Date Acceptance
2020-07-23
Citation
Nature Medicine, 2020, 26 (9), pp.1351-1363
ISSN
1078-8956
Publisher
Nature Research
Start Page
1351
End Page
1363
Journal / Book Title
Nature Medicine
Volume
26
Issue
9
Copyright Statement
© 2020 The Author(s). This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
License URL
Sponsor
National Institute of Health Research
Identifier
https://www.ncbi.nlm.nih.gov/pubmed/32908284
PII: 10.1038/s41591-020-1037-7
Subjects
SPIRIT-AI and CONSORT-AI Working Group
SPIRIT-AI and CONSORT-AI Steering Group
SPIRIT-AI and CONSORT-AI Consensus Group
Immunology
11 Medical and Health Sciences
Publication Status
Published
Coverage Spatial
United States