Accuracy and usability of AcuPebble SA100 for automated diagnosis of obstructive sleep apnoea in the home environment setting: an evaluation study
File(s)e046803.full.pdf (852.63 KB)
Published version
Author(s)
Devani, Nikesh
Pramono, Renard Xaviero Adhi
Imtiaz, Syed Anas
Bowyer, Stuart
Rodriguez-Villegas, Esther
Type
Journal Article
Abstract
Objectives Obstructive sleep apnoea (OSA) is a heavily underdiagnosed condition, which can lead to significant multimorbidity. Underdiagnosis is often secondary to limitations in existing diagnostic methods. We conducted a diagnostic accuracy and usability study, to evaluate the efficacy of a novel, low-cost, small, wearable medical device, AcuPebble_SA100, for automated diagnosis of OSA in the home environment.
Settings Patients were recruited to a standard OSA diagnostic pathway in an UK hospital. They were trained on the use of type-III-cardiorespiratory polygraphy, which they took to use at home. They were also given AcuPebble_SA100; but they were not trained on how to use it.
Participants 182 consecutive patients had been referred for OSA diagnosis in which 150 successfully completed the study.
Primary outcome measures Efficacy of AcuPebble_SA100 for automated diagnosis of moderate–severe-OSA against cardiorespiratory polygraphy (sensitivity/specificity/likelihood ratios/predictive values) and validation of usability by patients themselves in their home environment.
Results After returning the systems, two expert clinicians, blinded to AcuPebble_SA100’s output, manually scored the cardiorespiratory polygraphy signals to reach a diagnosis. AcuPebble_SA100 generated automated diagnosis corresponding to four, typically followed, diagnostic criteria: Apnoea Hypopnoea Index (AHI) using 3% as criteria for oxygen desaturation; Oxygen Desaturation Index (ODI) for 3% and 4% desaturation criteria and AHI using 4% as desaturation criteria. In all cases, AcuPebble_SA100 matched the experts’ diagnosis with positive and negative likelihood ratios over 10 and below 0.1, respectively. Comparing against the current American Academy of Sleep Medicine’s AHI-based criteria demonstrated 95.33% accuracy (95% CI (90·62% to 98·10%)), 96.84% specificity (95% CI (91·05% to 99·34%)), 92.73% sensitivity (95% CI (82·41% to 97·98%)), 94.4% positive-predictive value (95% CI (84·78% to 98·11%)) and 95.83% negative-predictive value (95% CI (89·94% to 98·34%)). All patients used AcuPebble_SA100 correctly. Over 97% reported a strong preference for AcuPebble_SA100 over cardiorespiratory polygraphy.
Conclusions These results validate the efficacy of AcuPebble_SA100 as an automated diagnosis alternative to cardiorespiratory polygraphy; also demonstrating that AcuPebble_SA100 can be used by patients without requiring human training/assistance. This opens the doors for more efficient patient pathways for OSA diagnosis.
Settings Patients were recruited to a standard OSA diagnostic pathway in an UK hospital. They were trained on the use of type-III-cardiorespiratory polygraphy, which they took to use at home. They were also given AcuPebble_SA100; but they were not trained on how to use it.
Participants 182 consecutive patients had been referred for OSA diagnosis in which 150 successfully completed the study.
Primary outcome measures Efficacy of AcuPebble_SA100 for automated diagnosis of moderate–severe-OSA against cardiorespiratory polygraphy (sensitivity/specificity/likelihood ratios/predictive values) and validation of usability by patients themselves in their home environment.
Results After returning the systems, two expert clinicians, blinded to AcuPebble_SA100’s output, manually scored the cardiorespiratory polygraphy signals to reach a diagnosis. AcuPebble_SA100 generated automated diagnosis corresponding to four, typically followed, diagnostic criteria: Apnoea Hypopnoea Index (AHI) using 3% as criteria for oxygen desaturation; Oxygen Desaturation Index (ODI) for 3% and 4% desaturation criteria and AHI using 4% as desaturation criteria. In all cases, AcuPebble_SA100 matched the experts’ diagnosis with positive and negative likelihood ratios over 10 and below 0.1, respectively. Comparing against the current American Academy of Sleep Medicine’s AHI-based criteria demonstrated 95.33% accuracy (95% CI (90·62% to 98·10%)), 96.84% specificity (95% CI (91·05% to 99·34%)), 92.73% sensitivity (95% CI (82·41% to 97·98%)), 94.4% positive-predictive value (95% CI (84·78% to 98·11%)) and 95.83% negative-predictive value (95% CI (89·94% to 98·34%)). All patients used AcuPebble_SA100 correctly. Over 97% reported a strong preference for AcuPebble_SA100 over cardiorespiratory polygraphy.
Conclusions These results validate the efficacy of AcuPebble_SA100 as an automated diagnosis alternative to cardiorespiratory polygraphy; also demonstrating that AcuPebble_SA100 can be used by patients without requiring human training/assistance. This opens the doors for more efficient patient pathways for OSA diagnosis.
Date Issued
2021-12
Date Acceptance
2021-11-15
Citation
BMJ Open, 2021, 11 (12), pp.1-10
ISSN
2044-6055
Publisher
BMJ Publishing Group
Start Page
1
End Page
10
Journal / Book Title
BMJ Open
Volume
11
Issue
12
Copyright Statement
© Author(s) (or their employer(s)) 2021. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ. http://creativecommons.org/licenses/by-nc/4.0/
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
License URL
Identifier
http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000733431100015&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=1ba7043ffcc86c417c072aa74d649202
Subjects
Science & Technology
Life Sciences & Biomedicine
Medicine, General & Internal
General & Internal Medicine
sleep medicine
telemedicine
respiratory physiology
POSITIVE AIRWAY PRESSURE
COST-EFFECTIVENESS
PORTABLE MONITOR
Publication Status
Published
Article Number
e046803
Date Publish Online
2021-12-21