Is the LITE version of the usability metric for user experience (UMUX-LITE) a reliable tool to support rapid assessment of new healthcare technology?
File(s)JERG-D-18-00514R1.pdf (542.72 KB)
Accepted version
Author(s)
Borsci, S
Buckle, Peter
Walne, S
Type
Journal Article
Abstract
Objective
To ascertain the reliability of a standardised, short-scale measure of satisfaction in the use of new healthcare technology i.e., the LITE version of the usability metric for user experience (UMUX-LITE). Whilst previous studies have demonstrated the reliability of UMUX-LITE, and its relationship with measures of likelihood to recommend a product, such as the Net Promoter Score (NPS) in other sectors no such testing has been undertaken with healthcare technology.
Materials and methods
Six point-of-care products at different stages of development were assessed by 120 healthcare professionals. UMUX-LITE was used to gather their satisfaction in use, and NPS to declare their intention to promote the product. Inferential statistics were used to: i) ascertain the reliability of UMUX-LITE, and ii) assess the relationship between UMUX-LITE and NPS at different stages of products development.
Results
UMUX-LITE showed an acceptable reliability (α = 0.7) and a strong positive correlation with NPS (r = 0.455, p < .001). This is similar to findings in other fields of application. The level of product development did not affect the UMUX-LITE scores, while the stage of development was a significant predictor (R2 = 0.49) of the intention to promote.
Discussion and conclusion
Practitioners may apply UMUX-LITE alone, or in combination with the NPS, to complement interview and ‘homemade’ scales to investigate the quality of new products at different stages of development. This shortened scale is appropriate for use in the context of healthcare in which busy professionals have a minimal amount of time to support innovation.
To ascertain the reliability of a standardised, short-scale measure of satisfaction in the use of new healthcare technology i.e., the LITE version of the usability metric for user experience (UMUX-LITE). Whilst previous studies have demonstrated the reliability of UMUX-LITE, and its relationship with measures of likelihood to recommend a product, such as the Net Promoter Score (NPS) in other sectors no such testing has been undertaken with healthcare technology.
Materials and methods
Six point-of-care products at different stages of development were assessed by 120 healthcare professionals. UMUX-LITE was used to gather their satisfaction in use, and NPS to declare their intention to promote the product. Inferential statistics were used to: i) ascertain the reliability of UMUX-LITE, and ii) assess the relationship between UMUX-LITE and NPS at different stages of products development.
Results
UMUX-LITE showed an acceptable reliability (α = 0.7) and a strong positive correlation with NPS (r = 0.455, p < .001). This is similar to findings in other fields of application. The level of product development did not affect the UMUX-LITE scores, while the stage of development was a significant predictor (R2 = 0.49) of the intention to promote.
Discussion and conclusion
Practitioners may apply UMUX-LITE alone, or in combination with the NPS, to complement interview and ‘homemade’ scales to investigate the quality of new products at different stages of development. This shortened scale is appropriate for use in the context of healthcare in which busy professionals have a minimal amount of time to support innovation.
Date Issued
2020-04-01
Date Acceptance
2019-11-21
Citation
Applied Ergonomics: human factors in technology and society, 2020, 84
ISSN
0003-6870
Publisher
Elsevier
Journal / Book Title
Applied Ergonomics: human factors in technology and society
Volume
84
Copyright Statement
© 2019 Elsevier Ltd. All rights reserved. This manuscript is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International Licence http://creativecommons.org/licenses/by-nc-nd/4.0/
Sponsor
National Institute for Health Research
Innovate UK
Grant Number
RDB21 79560
Biocatalyst Project
Subjects
In-vitro diagnostics
Net promoter score
Point-of-care systems
Satisfaction
Technology readiness level
UMUX
UMUX-LITE
Usability
Human Factors
1116 Medical Physiology
1203 Design Practice and Management
1106 Human Movement and Sports Sciences
Publication Status
Published
Article Number
ARTN 103007
Date Publish Online
2019-11-27