Evaluation of measurement errors in the patient‐oriented eczema measure (POEM) outcome
Author(s)
Duverdier, Ariane
Hurault, Guillem
Thomas, Kim
Custovic, Adnan
Tanaka, Reiko
Type
Journal Article
Abstract
Background:
The Patient-Oriented Eczema Measure (POEM) is the recommended core outcome instrument for atopic dermatitis (AD) symptoms. POEM is reported by recalling the presence/absence of seven symptoms in the last 7 days.
Objective:
To evaluate measurement errors in POEM recordings due to imperfect recall.
Methods:
Using data from a clinical trial of 247 AD patients aged 12–65 years, we analysed the reported POEM score (r-POEM) and the POEM derived from the corresponding daily scores for the same seven symptoms without weekly recall (d-POEM). We quantified recall error by comparing the r-POEM and d-POEM for 777 patient-weeks collected from 207 patients, and estimated two components of recall error: (1) recall bias due to systematic errors in measurements and (2) recall noise due to random errors in measurements, using a bespoke statistical model.
Results:
POEM scores have a relatively low recall bias, but a high recall noise. Recall bias was estimated at 1.2 points lower for the r-POEM on average than the d-POEM, with a recall noise of 5.7 points. For example, a patient with a recall-free POEM of 11 (moderate) could report their POEM score anywhere from 5 to 14 (with 95% probability) because of recall error. Model estimates suggested that patients tend to recall itch and dryness more often than experienced (positive bias of less than 1 day), but less often for the other symptoms (bleeding, cracking, flaking, oozing/weeping and sleep disturbance; negative bias ranging 1–4 days).
Conclusions:
In this clinical trial data set, we found that patients tended to slightly underestimate their symptoms when reporting POEM, with significant variation in how well they were able to recall the frequency of their symptoms every time they reported POEM. A large recall noise should be taken into consideration when interpreting POEM scores.
The Patient-Oriented Eczema Measure (POEM) is the recommended core outcome instrument for atopic dermatitis (AD) symptoms. POEM is reported by recalling the presence/absence of seven symptoms in the last 7 days.
Objective:
To evaluate measurement errors in POEM recordings due to imperfect recall.
Methods:
Using data from a clinical trial of 247 AD patients aged 12–65 years, we analysed the reported POEM score (r-POEM) and the POEM derived from the corresponding daily scores for the same seven symptoms without weekly recall (d-POEM). We quantified recall error by comparing the r-POEM and d-POEM for 777 patient-weeks collected from 207 patients, and estimated two components of recall error: (1) recall bias due to systematic errors in measurements and (2) recall noise due to random errors in measurements, using a bespoke statistical model.
Results:
POEM scores have a relatively low recall bias, but a high recall noise. Recall bias was estimated at 1.2 points lower for the r-POEM on average than the d-POEM, with a recall noise of 5.7 points. For example, a patient with a recall-free POEM of 11 (moderate) could report their POEM score anywhere from 5 to 14 (with 95% probability) because of recall error. Model estimates suggested that patients tend to recall itch and dryness more often than experienced (positive bias of less than 1 day), but less often for the other symptoms (bleeding, cracking, flaking, oozing/weeping and sleep disturbance; negative bias ranging 1–4 days).
Conclusions:
In this clinical trial data set, we found that patients tended to slightly underestimate their symptoms when reporting POEM, with significant variation in how well they were able to recall the frequency of their symptoms every time they reported POEM. A large recall noise should be taken into consideration when interpreting POEM scores.
Date Issued
2024-03
Date Acceptance
2023-11-07
Citation
Clinical and Experimental Allergy, 2024, 54 (3), pp.207-215
ISSN
0954-7894
Publisher
Wiley
Start Page
207
End Page
215
Journal / Book Title
Clinical and Experimental Allergy
Volume
54
Issue
3
Copyright Statement
© 2024 The Authors. Clinical & Experimental Allergy published by John Wiley & Sons Ltd.
This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
License URL
Identifier
https://onlinelibrary.wiley.com/doi/10.1111/cea.14441
Publication Status
Published
Date Publish Online
2024-01-02