Development and validation of the food allergy severity score
File(s)all.15165.pdf (1.33 MB)
Published version
Author(s)
Turner, Paul
Type
Journal Article
Abstract
Background
The heterogeneity and lack of validation of existing severity scores for food allergic reactions limit standardization of case management and research advances. We aimed to develop and validate a severity score for food allergic reactions.
Methods
Following a multidisciplinary experts consensus, it was decided to develop a food allergy severity score (FASS) with ordinal (oFASS) and numerical (nFASS) formats. oFASS with 3 and 5 grades were generated through expert consensus, and nFASS by mathematical modeling. Evaluation was performed in the EuroPrevall outpatient clinic cohort (8232 food reactions) by logistic regression with request of emergency care and medications used as outcomes. Discrimination, classification, and calibration were calculated. Bootstrapping internal validation was followed by external validation (logistic regression) in 5 cohorts (3622 food reactions). Correlation of nFASS with the severity classification done by expert allergy clinicians by Best-Worst Scaling of 32 food reactions was calculated.
Results
oFASS and nFASS map consistently, with nFASS having greater granularity. With the outcomes emergency care, adrenaline and critical medical treatment, oFASS and nFASS had a good discrimination (receiver operating characteristic area under the curve [ROC-AUC]>0.80), classification (sensitivity 0.87–0.92, specificity 0.73–0.78), and calibration. Bootstrapping over ROC-AUC showed negligible biases (1.0 × 10−6–1.23 × 10−3). In external validation, nFASS performed best with higher ROC-AUC. nFASS was strongly correlated (R 0.89) to best-worst scoring of 334 expert clinicians.
Conclusion
FASS is a validated and reliable method to measure severity of food allergic reactions. The ordinal and numerical versions that map onto each other are suitable for use by different stakeholders in different settings.
The heterogeneity and lack of validation of existing severity scores for food allergic reactions limit standardization of case management and research advances. We aimed to develop and validate a severity score for food allergic reactions.
Methods
Following a multidisciplinary experts consensus, it was decided to develop a food allergy severity score (FASS) with ordinal (oFASS) and numerical (nFASS) formats. oFASS with 3 and 5 grades were generated through expert consensus, and nFASS by mathematical modeling. Evaluation was performed in the EuroPrevall outpatient clinic cohort (8232 food reactions) by logistic regression with request of emergency care and medications used as outcomes. Discrimination, classification, and calibration were calculated. Bootstrapping internal validation was followed by external validation (logistic regression) in 5 cohorts (3622 food reactions). Correlation of nFASS with the severity classification done by expert allergy clinicians by Best-Worst Scaling of 32 food reactions was calculated.
Results
oFASS and nFASS map consistently, with nFASS having greater granularity. With the outcomes emergency care, adrenaline and critical medical treatment, oFASS and nFASS had a good discrimination (receiver operating characteristic area under the curve [ROC-AUC]>0.80), classification (sensitivity 0.87–0.92, specificity 0.73–0.78), and calibration. Bootstrapping over ROC-AUC showed negligible biases (1.0 × 10−6–1.23 × 10−3). In external validation, nFASS performed best with higher ROC-AUC. nFASS was strongly correlated (R 0.89) to best-worst scoring of 334 expert clinicians.
Conclusion
FASS is a validated and reliable method to measure severity of food allergic reactions. The ordinal and numerical versions that map onto each other are suitable for use by different stakeholders in different settings.
Date Acceptance
2021-10-10
Citation
Allergy, 77 (5)
ISSN
0105-4538
Publisher
John Wiley and Sons
Journal / Book Title
Allergy
Volume
77
Issue
5
Copyright Statement
© 2021 The Authors. Allergy published by European Academy of Allergy and Clinical Immunology and John Wiley & Sons Ltd.
This is an open access article under the terms of the Creative Commons Attribution-NonCommercial-NoDerivs License, which permits use and distribution in any medium, provided the original work is properly cited, the use is non-commercial and no modifications or adaptations are made.
This is an open access article under the terms of the Creative Commons Attribution-NonCommercial-NoDerivs License, which permits use and distribution in any medium, provided the original work is properly cited, the use is non-commercial and no modifications or adaptations are made.
Sponsor
Commission of the European Communities
Identifier
https://onlinelibrary.wiley.com/doi/10.1111/all.15165
Grant Number
312147
Subjects
Science & Technology
Life Sciences & Biomedicine
Allergy
Immunology
allergic reactions
anaphylaxis
food allergy
score
severity
ANAPHYLACTOID REACTIONS
SUBCUTANEOUS IMMUNOTHERAPY
GRADING SYSTEM
DOUBLE-BLIND
PEANUT
CHALLENGES
DIAGNOSIS
EUROPE
EPIDEMIOLOGY
SURVEILLANCE
allergic reactions
anaphylaxis
food allergy
score
severity
Allergens
Area Under Curve
Food
Food Hypersensitivity
Humans
ROC Curve
Allergy
1107 Immunology
Publication Status
Published online
Date Publish Online
2021-10-30