Development and validation of binary classifiers to predict nocturnal hypoglycemia in adults with type 1 diabetes
Author(s)
Type
Journal Article
Abstract
Background:
One of the biggest challenges for people with type 1 diabetes (T1D) using multiple daily injections (MDIs) is nocturnal hypoglycemia (NH). Recurrent NH can lead to serious complications; hence, prevention is of high importance. In this work, we develop and externally validate, device-agnostic Machine Learning (ML) models to provide bedtime decision support to people with T1D and minimize the risk of NH.
Methods:
We present the design and development of binary classifiers to predict NH (blood glucose levels occurring below 70 mg/dL). Using data collected from a 6-month study of 37 adult participants with T1D under free-living conditions, we extract daytime features from continuous glucose monitor (CGM) sensors, administered insulin, meal, and physical activity information. We use these features to train and test the performance of two ML algorithms: Random Forests (RF) and Support Vector Machines (SVMs). We further evaluate our model in an external population of 20 adults with T1D using MDI insulin therapy and wearing CGM and flash glucose monitoring sensors for two periods of eight weeks each.
Results:
At population-level, SVM outperforms RF algorithm with a receiver operating characteristic–area under curve (ROC-AUC) of 79.36% (95% CI: 76.86%, 81.86%). The proposed SVM model generalizes well in an unseen population (ROC-AUC = 77.06%), as well as between the two different glucose sensors (ROC-AUC = 77.74%).
Conclusions:
Our model shows state-of-the-art performance, generalizability, and robustness in sensor devices from different manufacturers. We believe it is a potential viable approach to inform people with T1D about their risk of NH before it occurs.
One of the biggest challenges for people with type 1 diabetes (T1D) using multiple daily injections (MDIs) is nocturnal hypoglycemia (NH). Recurrent NH can lead to serious complications; hence, prevention is of high importance. In this work, we develop and externally validate, device-agnostic Machine Learning (ML) models to provide bedtime decision support to people with T1D and minimize the risk of NH.
Methods:
We present the design and development of binary classifiers to predict NH (blood glucose levels occurring below 70 mg/dL). Using data collected from a 6-month study of 37 adult participants with T1D under free-living conditions, we extract daytime features from continuous glucose monitor (CGM) sensors, administered insulin, meal, and physical activity information. We use these features to train and test the performance of two ML algorithms: Random Forests (RF) and Support Vector Machines (SVMs). We further evaluate our model in an external population of 20 adults with T1D using MDI insulin therapy and wearing CGM and flash glucose monitoring sensors for two periods of eight weeks each.
Results:
At population-level, SVM outperforms RF algorithm with a receiver operating characteristic–area under curve (ROC-AUC) of 79.36% (95% CI: 76.86%, 81.86%). The proposed SVM model generalizes well in an unseen population (ROC-AUC = 77.06%), as well as between the two different glucose sensors (ROC-AUC = 77.74%).
Conclusions:
Our model shows state-of-the-art performance, generalizability, and robustness in sensor devices from different manufacturers. We believe it is a potential viable approach to inform people with T1D about their risk of NH before it occurs.
Date Issued
2025-01-01
Date Acceptance
2023-07-01
Citation
Journal of Diabetes Science and Technology, 2025, 19 (1), pp.153-160
ISSN
1932-2968
Publisher
SAGE Publications
Start Page
153
End Page
160
Journal / Book Title
Journal of Diabetes Science and Technology
Volume
19
Issue
1
Copyright Statement
© 2023 Diabetes Technology Society. This article is distributed under the terms of the Creative Commons Attribution 4.0 License (https://creativecommons.org/licenses/by/4.0/) which permits any use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access page (https://us.sagepub.com/en-us/nam/open-access-at-sage).
License URL
Identifier
https://www.ncbi.nlm.nih.gov/pubmed/37434362
Subjects
CONSENSUS
decision support
Endocrinology & Metabolism
GLUCOSE
Life Sciences & Biomedicine
machine learning
MANAGEMENT
nocturnal hypoglycemia
Science & Technology
type 1 diabetes
Publication Status
Published
Coverage Spatial
United States
Date Publish Online
2023-07-11