Development of a composite outcome score for a complex intervention - measuring the impact of Community Health Workers
File(s)Trials 2015, 16:107.pdf (458.51 KB)
Published version
Author(s)
Type
Journal Article
Abstract
Background
In health services research, composite scores to measure changes in health-seeking behaviour and uptake of services do not exist. We describe the rationale and analytical considerations for a composite primary outcome for primary care research. We simulate its use in a large hypothetical population and use it to calculate sample sizes. We apply it within the context of a proposed cluster randomised controlled trial (RCT) of a Community Health Worker (CHW) intervention.
Methods
We define the outcome as the proportion of the services (immunizations, screening tests, stop-smoking clinics) received by household members, of those that they were eligible to receive. First, we simulated a population household structure (by age and sex), based on household composition data from the 2011 England and Wales census. The ratio of eligible to received services was calculated for each simulated household based on published eligibility criteria and service uptake rates, and was used to calculate sample size scenarios for a cluster RCT of a CHW intervention. We assume varying intervention percentage effects and varying levels of clustering.
Results
Assuming no disease risk factor clustering at the household level, 11.7% of households in the hypothetical population of 20,000 households were eligible for no services, 26.4% for 1, 20.7% for 2, 15.3% for 3 and 25.8% for 4 or more. To demonstrate a small CHW intervention percentage effect (10% improvement in uptake of services out of those who would not otherwise have taken them up, and additionally assuming intra-class correlation of 0.01 between households served by different CHWs), around 4,000 households would be needed in each of the intervention and control arms. This equates to 40 CHWs (each servicing 100 households) needed in the intervention arm. If the CHWs were more effective (20%), then only 170 households would be needed in each of the intervention and control arms.
Conclusions
This is a useful first step towards a process-centred composite score of practical value in complex community-based interventions. Firstly, it is likely to result in increased statistical power compared with multiple outcomes. Second, it avoids over-emphasis of any single outcome from a complex intervention.
In health services research, composite scores to measure changes in health-seeking behaviour and uptake of services do not exist. We describe the rationale and analytical considerations for a composite primary outcome for primary care research. We simulate its use in a large hypothetical population and use it to calculate sample sizes. We apply it within the context of a proposed cluster randomised controlled trial (RCT) of a Community Health Worker (CHW) intervention.
Methods
We define the outcome as the proportion of the services (immunizations, screening tests, stop-smoking clinics) received by household members, of those that they were eligible to receive. First, we simulated a population household structure (by age and sex), based on household composition data from the 2011 England and Wales census. The ratio of eligible to received services was calculated for each simulated household based on published eligibility criteria and service uptake rates, and was used to calculate sample size scenarios for a cluster RCT of a CHW intervention. We assume varying intervention percentage effects and varying levels of clustering.
Results
Assuming no disease risk factor clustering at the household level, 11.7% of households in the hypothetical population of 20,000 households were eligible for no services, 26.4% for 1, 20.7% for 2, 15.3% for 3 and 25.8% for 4 or more. To demonstrate a small CHW intervention percentage effect (10% improvement in uptake of services out of those who would not otherwise have taken them up, and additionally assuming intra-class correlation of 0.01 between households served by different CHWs), around 4,000 households would be needed in each of the intervention and control arms. This equates to 40 CHWs (each servicing 100 households) needed in the intervention arm. If the CHWs were more effective (20%), then only 170 households would be needed in each of the intervention and control arms.
Conclusions
This is a useful first step towards a process-centred composite score of practical value in complex community-based interventions. Firstly, it is likely to result in increased statistical power compared with multiple outcomes. Second, it avoids over-emphasis of any single outcome from a complex intervention.
Date Issued
2015-03-21
Date Acceptance
2015-03-02
Citation
Trials, 2015, 16
ISSN
1745-6215
Publisher
BioMed Central
Journal / Book Title
Trials
Volume
16
Copyright Statement
© 2015 Watt et al.; licensee BioMed Central.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
License URL
Identifier
ARTN 107
Subjects
Science & Technology
Life Sciences & Biomedicine
Medicine, Research & Experimental
Research & Experimental Medicine
Health services research
Health impact assessment
Delivery of health care
Research outcomes
RESEARCH-COUNCIL GUIDANCE
PRIMARY-CARE
CLINICAL-TRIALS
BRAZIL
MORTALITY
PROGRAM
Publication Status
Published
Article Number
ARTN 107