Cost-effectiveness analysis of a multiple health behaviour change intervention in people aged between 45 and 75 years: a cluster randomized controlled trial in primary care (EIRA study)

Abstract

Background

Multiple health behaviour change (MHBC) interventions that promote healthy lifestyles may be an efficient approach in the prevention or treatment of chronic diseases in primary care. This study aims to evaluate the cost-utility and cost-effectiveness of the health promotion EIRA intervention in terms of MHBC and cardiovascular reduction.

Methods

An economic evaluation alongside a 12-month cluster-randomised (1:1) controlled trial conducted between 2017 and 2018 in 25 primary healthcare centres from seven Spanish regions. The study took societal and healthcare provider perspectives. Patients included were between 45 and 75 years old and had any two of these three behaviours: smoking, insufficient physical activity or low adherence to Mediterranean dietary pattern. Intervention duration was 12 months and combined three action levels (individual, group and community). MHBC, defined as a change in at least two health risk behaviours, and cardiovascular risk (expressed in % points) were the outcomes used to calculate incremental cost-effectiveness ratios (ICER). Quality-adjusted life-years (QALYs) were estimated and used to calculate incremental cost-utility ratios (ICUR). Missing data was imputed and bootstrapping with 1000 replications was used to handle uncertainty in the modelling results.

Results

The study included 3062 participants. Intervention costs were €295 higher than usual care costs. Five per-cent additional patients in the intervention group did a MHBC compared to usual care patients. Differences in QALYS or cardiovascular risk between-group were close to 0 (− 0.01 and 0.04 respectively). The ICER was €5598 per extra health behaviour change in one patient and €6926 per one-point reduction in cardiovascular risk from a societal perspective. The cost-utility analysis showed that the intervention increased costs and has no effect, in terms of QALYs, compared to usual care from a societal perspective. Cost-utility planes showed high uncertainty surrounding the ICUR. Sensitivity analysis showed results in line with the main analysis.

Conclusion

The efficiency of EIRA intervention cannot be fully established and its recommendation should be conditioned by results on medium-long term effects.

Trial registration

Clinicaltrials.gov NCT03136211. Registered 02 May 2017 – Retrospectively registered

Introduction

Chronic diseases are one of the main challenges for health systems. These diseases account for a high proportion of morbidity and mortality worldwide [1]. The cost of these diseases, when they are considered alone, has a relevant impact but it is even higher when comorbidities are present [2]. It is estimated that 10 million deaths attributed to chronic diseases can be prevented by adopting healthy behaviours while not adopting them has a significant economic impact [3, 4]. Against this background, the primary health care (PHC) system offers comprehensive, continuous care as the optimal context for the promotion of healthy lifestyles [5]. Health promotion does not have to be focused on specific health risk, but it can address several of them together. In this context, multiple health behaviour changes (MHBC) interventions approach several risk factors within the same intervention [6], which might increase their efficiency and effectiveness.

However, as far as we know, few economic evaluations have assessed the impact of MHBC interventions [7]. McRobbie et al showed that a diet and physical activity intervention addressing weight management in obese patients had an incremental cost-utility ratio (ICUR) of £7400 per quality-adjusted life-year (QALY) gained using a health system perspective [7], while van Keulen et al showed that a tailored print intervention aiming to improve physical activity and/or diet in adults between 45 and 70 years cost €2867 per QALY gained and €160 per improved behaviour [8]. Similar evidence is available on the assessment of single behaviour interventions. Systematic reviews focused on cardiovascular risk (CVR) or physical activity did not find a great number of economic evaluations based on randomized clinical trials [9, 10]. Indeed, some authors have pointed out that more robust, real-world evidence focused on MHBC intervention is needed, especially in light of the resource requirements to implement them [9].

The EIRA study contained an MHBC intervention focused on smoking cessation, physical activity and adherence to the Mediterranean dietary pattern in PHC patients [11]. This study aimed to evaluate the cost-utility and cost-effectiveness, in terms of MHBC and CVR reduction, of the EIRA intervention through a cluster-randomized controlled trial.

Methods

This was an economic evaluation alongside a 12-month cluster-randomized control trial conducted between 2017 and 2018 in 25 PHC centres from seven Spanish regions. The cost perspectives taken were societal and healthcare providers. The study protocol (NCT03136211.R), with details on the study design and intervention, was published elsewhere [11].

Setting

The Spanish public healthcare system provides universal coverage for citizens and foreign nationals. It is funded through taxes and free of charge at the point of use, with some exceptions such as medication. Although it is a decentralised system, where each of the 17 Spanish regions controls health planning, public health and the management of health services (including tariffs publication), PHC is the most accessible point of contact within the public system [12].

Participants

PHC centres

The following inclusion criteria were used for selection: 1) internet access; 2) possibility of developing community activities; 3) not being located in areas with high cultural or linguistic diversity or tourist areas and; 4) having a signed commitment document from the management team. Healthcare professionals and administrative staff were involved in the study and signed a collaboration commitment form.

Participants were people aged between 45 and 75 years old who engaged in at least two of these behaviours: smoking, insufficient physical activity or low adherence to Mediterranean dietary pattern. Participants had to be registered in the health system and have an assigned healthcare professional. They needed to provide signed informed consent. The exclusion criteria set were: advanced serious illnesses, dependence in daily life activities, being included in long-term home health programme and planning to move to another area in the current year.

Randomisation

Twenty-six PHC centres were computer randomized 1:1 based on each region at a central location (IDIAP Jordi Gol, Barcelona, Spain). After randomisation, one intervention centre dropped out due to administrative reasons, leaving 12 centres in the intervention group. Participants were assigned to the intervention or control group based on their PHC centre.

Interventions

EIRA was a health promotion intervention designed following Medical Research Council methodology [13] (including systematic reviews [14,15,16,17,18,19,20,21,22], citizen and professional participation through qualitative research [23,24,25] and a previous pilot study, among other techniques) and was based on the Transtheoretical Model [26]. Physicians and nurses applied the intervention in their routine practice in the PHC centre. It consisted of a first screening visit where the PHC professionals assessed the potential risk behaviours. Subsequently, the PHC professionals advised the participant, reached an agreement with them on achievable goals, developed a specific plan taking the three potential risks and stage of change into account, assisted with anticipation of barriers and arranged follow-up support (i.e., 2–3 visits). The duration of the intervention was 12 months and it combined three action levels (i.e., individual, group and community). The individual intervention consisted of a face-to-face intervention to increase awareness of the need for a behaviour change or making a plan for this change. The group intervention consisted of two health education workshops about healthy diet and physical activity while the community intervention consisted of social prescribing of resources available in the catchment area.

Participants in the control PHC centres received usual care, which integrates Spanish preventive protocols involving lifestyle recommendations and preventive activities based on screening and brief advice. These recommendations are focused on lifestyles, cardiovascular and mental diseases, cancer and vaccination [27,28,29,30,31].

Outcomes and data collection

Information was recorded at baseline and 12-month follow-up.

Use of resources, loss of productivity and other costs

Resources included healthcare utilisation in PHC (general practitioner (GP) and nurse home or centre visits, laboratory test, social worker visits, emergency visits) and hospital (admissions and length of admission, emergency visits, diagnostic tests), medication use, sick leave and intervention-related costs such as tobacco use and cost of activities (group activities were managed by a nurse but they varied in attendees and/or duration; cost assumed was one nurse visit at the centre per patient). As described in Supplementary Table, information on healthcare utilisation and sick leave were collected from electronic health records, individual clinical record review and/or a Case Report Form (CRF) depending on the region. Intervention-related cost (tobacco use and cost of activities) were obtained from CRF. The information recorded at baseline referred to the previous year while information recorded at 12-month follow-up referred to the year of the intervention.

Unit costs

Healthcare services unit costs were based on public health service tariffs published in Regional Government Official Bulletins, which were updated to 2019 using the specific regional healthcare Consumer Price Index. Subsequently, the mean tariff was calculated for each health service. A social worker visit tariff was not found, and it was assumed to be the same as that of the Nurse centre visit. Medication cost was obtained from administrative databases. The cost of productivity loss was calculated based on the human capital approach using the minimum daily wage in Spain. All costs were expressed in euros 2019. Table 1 shows unit costs used in the study. The time horizon was one year and no discount rate was applied.

Table 1 Unit cost (€ in 2019) (mean cost and maximum and minimum regional official tariffs)

Clinical outcomes

The European Quality of Life instrument (EuroQol-5D-3L; EQ5D) was used to measure health-related quality of life [32, 33]. QALYs were calculated by linearly interpolating baseline and one-year follow-up utility score based on EQ5D Spanish tariffs. CVR (expressed in %) was calculated using the REGICOR function chart based on sex, age, total cholesterol, HDL, diagnosis of diabetes, smoker status and blood pressure [34,35,36]. MHBC, which was the primary outcome of the intervention was defined as a change in at least two unhealthy behaviours. This variable was recorded by the research team in the CRF and, lately, it was dichotomized between change in at least two unhealthy behaviours and no change or change in only one unhealthy behaviour.

Other sociodemographic and clinical variables including participant age, gender, civil status, education level, diagnosis of hypertension, the presence of comorbidities and Body Mass Index (BMI) was also recorded on the CRF.

Statistical analysis

We assumed that the variables with missing values are Missing At Random (MAR). MAR assumption can be made more plausible by collecting more explanatory variables and including them in the analysis, and we have included almost all the possible explanatory variables (excluding duplicate variables, very similar variables and highly correlated variables to avoid collinearity). Imputation was used to deal with missing data. Missing values varied from 0 to 13% at baseline and from 1 to 44% at follow-up. Multiple imputation by chained equations (MICE) using 50 imputed databases was applied to all variables. This number of the database was based on the fraction of missing information. To perform MICE, we used predictive mean matching in continuous variables, logistic regression in dichotomous variables and polytomous regression in categorical variables (more than two categories). Societal perspective included all costs recorded while healthcare perspective included all costs except productivity losses and tobacco costs. Cost-utility in terms of extra cost per QALY gain and cost-effectiveness in terms of extra cost per a one-point reduction in CVR or per MHBC in one extra participant was estimated by obtaining incremental cost-utility (ICUR) and incremental cost-effectiveness ratios (ICER), respectively. ICUR and ICER were calculated as the difference in the cost between the intervention and the control group, divided by the difference in QALYs, the difference in % CVR points and the probability of modifying behaviours. The base-case analysis was an intention-to-treat analysis. Differences in cost and effects were estimated using adjusted generalised linear models with gamma (for QALYs and cost) or Gaussian (CVR) distributions and estimating marginal means using margins STATA command and adjusted logistic regression for behaviour change. These adjustments consisted of baseline cost or effects and those variables that showed statistically significant differences at baseline (i.e., BMI) as was indicated in the study protocol [37]. All analyses clustered participants in PHC centres using the “vce” STATA option. We used bootstrapping with 1000 replications (20 replications in each of the 50 imputed databases) to assess uncertainty and to construct the cost-utility planes and acceptability curves.

We performed six sensitivity analyses: 1) a complete-case analysis (only considering those participants who attended the follow-up visit); 2) an analysis considering mean wage for productivity losses; 3) an analysis considering the maximum regional tariff for each of the healthcare services and 4) the minimum; 5) an analysis adjusted only by baseline costs and effects (not adjusted by BMI) and 6) an analysis using seemingly unrelated regressions. The first four sensitivity analyses were pre-specified [11].

Imputation analyses were performed with R and all other analyses were performed with Stata MP 13.1.

Results

Overall, 3062 participants (1481 in the intervention group) were included in the study. Figure 1 shows the study flowchart and intervention adherence rates. Lost participants in the follow-up assessment were around 22%. Some 41% of intervention participants were adherent to all MHBC interventions (79% to at least one). Table 2 presents the sample characteristics. There were statistically significant differences between groups at baseline in the BMI, with a higher proportion of the control group in the overweight category and a higher proportion of the intervention group in the obese category.

Fig. 1

Flow diagram of clusters and participants through study. PHC, Primary Health Care

Table 2 Sociodemographic and clinical characteristics of the sample

Cost-utility and cost-effectiveness of EIRA intervention

The intervention mean cost, including individual visits, workshops and community activities, was €49.33 per person (minimum €0 and maximum €1188). Table 3 shows each mean cost by group at baseline and follow-up and the unadjusted difference between groups at each point. Table 4 shows unadjusted costs for both groups at baseline and follow-up. The intervention effectively promoted MHBC. There were no statistically significant differences between groups in costs, QALYs or cardiovascular risk in the main analyses. Tables 5 and 6 shows the results of the cost-utility and cost-effectiveness analyses. Unadjusted effects for both groups are detailed in Table 4.

Table 3 Mean group cost at baseline and follow-up and difference between groups at both points

Table 4 Unadjusted cost at baseline and follow-up and effects for intervention and control patients for the main and sensitivity analysis

Table 5 Difference in cost and effects; ICUR and ICER between intervention and control patients for the main and sensitivity analyses based on adjusted models

Table 6 Difference in cost and effects (change in two or three behaviours and cardiovascular risk); ICER between intervention and control patients and Relative Value Index (RVI) for the main and sensitivity analyses based on adjusted models

Usual care dominated (decreased cost and is more effective) the intervention in the cost-utility analysis. When MHBC is considered in the cost-effectivity analysis, ICERs from the societal and healthcare perspectives were €5598 and €3932 per additional change in one patient, respectively. Considering the cardiovascular risk, ICERs from the societal and healthcare perspectives were €6926 and €4864 per one-point reduction in cardiovascular risk, respectively. Figure 2 shows cost-utility and cost-effectiveness planes. Cost-utility planes showed high uncertainty surrounding the ICUR. Most bootstrapped incremental cost-utility pairs fell in the north-west (intervention increased costs and is less effective than usual care) or south-west quadrants (intervention decreased costs and is less effective than usual care) of the cost-utility plane. In terms of cardiovascular risk reduction and MHBC, the intervention fell in the north-east (intervention increased costs and is more effective than usual care) and south-east (intervention decreased costs and is more effective than usual care) quadrants of the cost-utility place, although, in the healthcare perspective, most pairs are distributed over the cost axis (€0). The intervention was cost-saving in 32 and 49% of the pairs from the societal and healthcare perspectives while it was more effective in 9% of the pairs in terms of QALYS; 81% of the pairs in terms of CVR and all pairs in terms of MHBC. Acceptability curves are shown in Supplementary Files.

Fig. 2

Cost–utility and cost-effectiveness of EIRA intervention vs usual care

Sensitivity analysis

Table 5 shows the results of sensitivity analysis. All sensitivity analyses showed similar results to those of the main analyses. The scenarios where the differences in cost were smaller were the complete case and that using seemingly unrelated regressions. The scenario with the largest differences in cost was that considering the mean wage as unit cost for sick leave. In terms of cost-effectiveness, the best scenario for both outcomes was the complete case (both ICER were around €2200 per extra MHBC in one participant or REGICOR reduction), while the worse scenario was that considering the mean wage as unit cost for sick leave.

Table 4 also shows the unadjusted mean cost and effects of the sensitivity analysis.

Discussion

Summary

The cost-effectiveness of the EIRA intervention measured in terms of MHBC remains unclear. However, although the intervention was shown to be no more costly than usual care and it promoted MHBC, the probabilistic analysis showed high uncertainty surrounding cost differences and intervention did not affect quality of life or cardiovascular risk reduction. Based on the results of this economic evaluation, the EIRA intervention should be reformulated before being translated to clinical practice or it should be assessed with a longer follow-up period.

Strengths and limitations

The large, representative sample is the main strength of this study. This was a multisite study evaluating an MHBC intervention implemented in a complex context such as PHC. Participants from 25 PHC centres in 7 Spanish regions were included and this represents one of the first economic evaluations that has been developed under these circumstances. The pragmatism of this trial is one of the key points of its design as it was developed with the aim of an immediate implementation in the PHC system throughout the modification and elimination of potential barriers. We intended to develop a flexible intervention that could be adapted to different PHC settings, and the intervention’s design was based on the results of previous phases of the study. These features led to adherence being measured in a permissive way and the content of the intervention itself in each of the centres was not fully documented. This fact together with a low fidelity of the intervention could have limited our capacity to detect differences between groups [38]. Similarly, not all cost information was gathered using the same protocols (each region has combined electronic health record download, individual clinical record review and/or CRF based on availability) and this may introduce some bias. However, it increased the external validity of the results of the study. The follow-up period may have limited the impact of the intervention in outcomes such as QALYs and CVR reduction considering that intervention is focused on health promotion.

Comparison with existing literature

There were no differences in costs between groups. As suggested previously, health promotion interventions have a very low cost or, at least, a similar cost compared to usual care [7, 8, 39,40,41]. Similarly, the intervention had no effect on QALYs at one-year follow-up. Although QALYs are the standard effect measure in cost-utility analysis, health promotion interventions are not expected to produce improvements in QALYs in the short term. Similar results have been observed in economic evaluations of health promotion interventions in PHC [7, 8, 39,40,41,42]. However, some of these studies showed positive ICURs with a clear dominance of the intervention [7, 40]. Although the effect of these interventions was small (0.01 for QALYS and 80£ for costs [7] or 0.02 for QALYS and €-16 for cost [40]), the uncertainty regarding the cost-effectiveness of the intervention was also small. The ICUR dominance in some of these preventive interventions could be related to the targeted population (obese) [7] or the risk approached (major depression) [40] while the EIRA intervention is focused on health behaviours in a general population sample where differences in QALYs after 1 year is hardly seen.

MHBC was more sensitive to the intervention in the short term. The EIRA intervention presented statistical differences in this outcome and showed a societal ICER of €5600 per one extra patient changing two or three unhealthy behaviours. This ICER was reduced to €3900 when the healthcare perspective was considered. Previous studies showed lower ICERs, up to £986 (€1098 at November 2020), per one extra patient behaviour change [8, 10]. However, most of these interventions only focus on one behaviour. Although previous authors have suggested proposals of transforming unit changes of different outcomes into comparable metrics, currently, there is no national or international threshold in terms of behaviour change to consider an intervention efficient. In any case, the EIRA intervention would seem to exceed this virtual threshold; especially when the national threshold to consider an intervention efficient in terms of QALYs is €20,000 per QALYs [43] and given the difficulty in translating healthy behaviours into gains in QALYs [44]. A suggested alternative to thresholds is the Relative Value Index, being the formula for this index: RVI = (usual care mean costs/usual care mean effects)/ICER)) [45]. A Relative Value Index greater than 1 means that a new intervention would provide better outcomes at a lower incremental cost per outcome than the comparator. However, values below 1 and close to 0, as EIRA intervention shows (taking into account mean cost and effects, in terms of MHBC, in the usual care group) would mean that the additional outcome associated with the new intervention would cost more than the previously “accepted value” of a cost per outcome.

Partially similar results were observed when CVR was considered as the outcome. The EIRA intervention showed a societal ICER of €6900 per one-point reduction in CVR and a healthcare ICER of 4900. In this situation, and considering that usual care already involves preventive protocols, it is very difficult to observe substantial changes in these outcomes, and consequently, CVR in the short-medium term. Furthermore, changes in the medium-long term can be preceded by promotion interventions on healthy lifestyles which have an impact on CVR [46].

The largest effect in CVR and MHBC was observed in the complete-case analysis; this might suggest that higher levels of intervention fidelity would have produced better results. However, this effect is still clearly lower than previous preventive PHC interventions aiming to reduce CVR [47], other related outcomes such as weight [7], or behaviour change [8, 10].

A technical but crucial issue is the model and assumption choice. In this paper, we considered generalized linear models as the main choice due to previous recommendations related to checking non-normality distribution in cost and effects after a visual inspection [37]. However, it is important to emphasise that seemingly unrelated regression, a choice that led to correlate the error terms across regression models in cost and effects but assuming normality, was the second most favourable scenario to the intervention in terms of cost-utility.

Implication for research and practice

In a globalized world, it is increasingly important to develop complex healthcare actions that can be adapted to each patient and implemented in a large number of settings. At this point, developing hybrid trials is a very good option. This is particularly important in the context of PHC where systemic interventions predominate and professionals approach more than one health or risk behaviour. However, researchers should not overlook the importance of monitoring the specific actions in each setting. This would ensure that clear information is available to determine whether these actions are genuinely (cost)effective or not.

Developing cost-effective interventions that promote healthy lifestyles are crucial to support the healthcare system. A healthy population should be an optimal target for these interventions although, due to patient health status, intervention assessment needs to be extended into the medium-long term. Conducting economic models which assess the long-term cost-effectiveness using mortality and QALYS as outcomes would give relevant information for health decision-makers. Similarly, standardizing the use of other generalizable outcomes that could be sensitive to health promotion interventions would help decision making in this field. A healthy population is usually located in very heterogeneous and complex contexts, a fact that complicated the registry and cost definition, key factors for economic evaluations. In this line, efforts should be taken in standardization without leaving the complexity of the context out of consideration [48].

Conclusions

A health promotion PHC intervention such as EIRA effectively impact MHBC in the Spanish context but its efficiency cannot be fully established under current circumstances. The recommendation of this intervention should be conditioned by positive results in the medium-long term clinical assessment or by modification of the intervention.