Skip to main content

Effectiveness of a multiple health-behaviour-change intervention in increasing adherence to the Mediterranean Diet in adults (EIRA study): a randomized controlled hybrid trial

Abstract

Background

The present study describes the effectiveness of a complex intervention that addresses multiple lifestyles to promote healthy behaviours in increasing adherence to the Mediterranean diet (MD). 

Methods

Cluster-randomised, hybrid clinical trial controlled with two parallel groups. The study was carried out in 26 primary Spanish healthcare centres. People aged 45–75 years who presented at least two of the following criteria were included: smoker, low adherence to the MD or insufficient level of physical activity. The intervention group (IG) had three different levels of action: individual, group, and community, with the aim of acting on the behaviours related to smoking, diet and physical activity at the same time. The individual intervention included personalised recommendations and agreements on the objectives to attain. Group sessions were adapted to the context of each healthcare centre. The community intervention was focused on the social prescription of resources and activities performed in the environment of the community of each healthcare centre. Control group (CG) received brief advice given in the usual visits to the doctor’s office. The primary outcome was the change, after 12 months, in the number of participants in each group with good adherence to the MD pattern. Secondary outcomes included the change in the total score of the MD adherence score (MEDAS) and the change in some cardiovascular risk factors.

Results

Three thousand sixty-two participants were included (IG = 1,481, CG = 1,581). Low adherence to the MD was present in 1,384 (93.5%) participants, of whom 1,233 initiated the intervention and conducted at least one individual visit with a healthcare professional. A greater increase (13.7%; 95% CI, 9.9–17.5; p < 0.001) was obtained by IG in the number of participants who reached 9 points or more (good adherence) in the MEDAS at the final visit. Moreover, the effect attributable to the intervention obtained a greater increase (0.50 points; 95% CI, 0.35 to 0.66; p < 0.001) in IG.

Conclusions

A complex intervention modelled and carried out by primary healthcare professionals, within a real clinical healthcare context, achieved a global increase in the adherence to the MD compared to the brief advice.

Trial registration

ClinicalTrials.gov Identifier: NCT03136211. Retrospectively registered on 02/05/2017 https://clinicaltrials.gov/ct2/show/NCT03136211

Peer Review reports

Background

One of the most studied dietary patterns, and with the most accumulated scientific evidence regarding its health benefits, is the Mediterranean Diet (MD). It is the traditional dietary pattern of the countries bordering the Mediterranean Sea, with variations depending on the area due to culinary preferences and sociocultural and religious factors. These are identified as the main characteristics of this diet [1]: 1) High consumption of fruits and vegetables, legumes, nuts and whole grains; 2) Consumption of local, fresh and seasonal food; 3) The use of extra-virgin olive oil as the main source of lipids; 4) Moderate consumption of eggs, fish, shellfish and white meat 5) Frequent but moderate consumption of wine, mainly red, with meals; 6) Low consumption of sweets, red meat, processed meat and dairy products. The Mediterranean Diet has been associated, among others, with a lower risk of suffering from cardiovascular diseases (2,3), with a reduction of total mortality [2], as well as with the reduction of the risk of metabolic syndrome and its components, such as obesity, hypertension and hyperlipidemia [3]. Adherence to the traditional pattern of this diet in southern Europe is progressively declining [4]. This decrease in adherence seems to be related to the increase in the prevalence of obesity, although it is unknown if it is a causal relationship. To this fact must be added the change in several aspects related to food, such as the availability and variety of products, as well as the change in dietary behaviors, such as the intake of soft drinks and fast food [5].

The increase of adherence to the MD has also been a target of multicomponent and multibehavioural interventions. Alonso-Dominguez et al. [6] achieved an increase of 2.2 points in the Mediterranean Diet Adherence Score (MEDAS) after an intervention in people with type 2 diabetes mellitus, which combined heart-healthy walks, the use of a smartphone application and a food workshop, compared to the control group, who only received counseling. However, the results of interventions that only included the use of new technologies have shown a lesser impact [7]. The systematic review by Maderuelo et al. [8] collected studies that included interventions to improve adherence to the MD. In one of these studies (Zazpe et al. [9], PREDIMED study), the two intervention groups, who followed a programme based on motivational strategy, submission of written material and the intake of supplements (olive oil or nuts), increased their MEDAS score by 1.86 and 2.26 points, respectively, whereas the control group, who followed a low-fat diet, only increased this score by 0.46 points. On the other hand, Logan et al. [10] found no differences in adherence to the MD after the intervention among the three study groups (nutritional advice, behavioural changes and control group).

In all the studies mentioned above, adherence to the MD was estimated with a diet quality index, the MEDAS. This is a valid instrument for rapid estimation of adherence to the MD and may be useful in clinical practice. The MEDAS was validated in a large Spanish population and correlated significantly with the corresponding food-frequency questionnaire (FFQ) PREDIMED score (r = 0.52; intraclass correlation coefficient = 0.51) and in the anticipated directions with the dietary intakes reported on the FFQ [11].

The EIRA study has as a novelty the inclusion of a complex intervention to achieve the modification of lifestyles. Complex interventions promote the participation of professionals and citizens throughout the design, execution and analysis of research, which, in turn, increases and improves the transference of results to clinical practice [12]. The EIRA study [13], through a hybrid trial, evaluates, as the main objective, the cost-effectiveness and implementation of a complex intervention that addresses multiple lifestyles (diet, physical activity and smoking) to promote healthy behaviours in a large sample of patients between 45 and 75 years of age attended in primary healthcare. The full trial results were published separately [14, 15]. This manuscript reports the effectiveness of this intervention to increase adherence to the MD.

Methods

Design

This is a cluster-randomised, type 2 hybrid clinical trial controlled with two parallel groups. The protocol of the clinical trial [13] was written and published in compliance with the Recommendations for Interventional Trials (SPIRIT) [16] and the Standards for Reporting Implementation Studies (StaRI) [17].

Study setting

The study was carried out in primary healthcare centres of seven Autonomous Communities of Spain from January 2017 to December 2018. Healthcare in this scope is provided in healthcare centres, which are manned by multidisciplinary teams of physicians, nurses, pediatricians, midwives, social workers and dentists, who carry out activities of health care, health education, health promotion and prevention and activities for the community [18].

Recruitment

The participants were recruited from the health centres through several methods: 1) at the time of the visit as part of usual care; 2) waiting room or admission desk of the healthcare centre; 3) through a person in charge of recruiting participants; 4) posters in the health centres; 5) phone calls to patients who met the selection criteria.

Participants

The EIRA study includes the participation of 26 healthcare centres. The criteria for the selection of the centres were the following: 1) having access to the Internet; 2) having the possibility of carrying out community activities; 3) being located in areas without great cultural and linguistic diversity; and 4) having an active and highly committed professional team. The professionals of the selected healthcare centres participated voluntarily and signed a collaboration commitment to the study.

The study included people between 45 and 75 years of age who presented at least two of the following criteria related to their lifestyles at the time of the screening: 1) smoker; 2) low adherence to the MD (evaluated through two validated questions about the daily consumption of fruits and vegetables [19]); and 3) insufficient level of physical activity (evaluated through the Brief Physical Activity Assessment Tool [20]). The exclusion criteria were as follows: advanced serious illnesses, cognitive impairment, dependence in basic everyday activities, severe mental illness, being included in a long-term home health care program, being under treatment for cancer or in end-of-life care, or not planning to reside in the area during the time that the intervention lasted. The selected participants signed an informed consent before any examination or procedure of the study and conducted two evaluations, i.e., at baseline and at 12 months.

Data collection and management

Recruitment, screening visit and intervention visits, including group sessions, were performed by the healthcare professionals of the participating healthcare centres. The evaluation visits (baseline and 12 months) were conducted by an external unit of healthcare professionals trained in each centre since these activities were not considered to be related to the usual care. An electronic data-collection notebook was designed. The study was managed by coordinators at the central, regional and local levels within each of the participating healthcare centres. Different communication methods, such as meetings and newsletters, were used among the coordinators and managers of the study.

Primary and secondary outcomes of this manuscript

This hybrid trial has the following primary objectives: to evaluate the effectiveness and cost-effectiveness of a complex multiple risk intervention on reducing tobacco use, enhancing adherence to Mediterranean dietary pattern and increasing physical activity level in 12 months to baseline compared with usual care; to assess the effectiveness of an implementation strategy in terms of acceptability, adoption, appropriateness, feasibility, fidelity, implementation cost and penetration.

The primary outcome of this manuscript was the change, after 12 months, in the number of participants in each group with a score equal to or greater than 9 points on the MEDAS, which would indicate good adherence to the MD pattern. Secondary outcomes were the change in the global score of adherence to the MD, the change in the percentage of individuals who positively complied with each of the items of the questionnaire, and the change in weight, blood pressure and laboratory variables included in cardiovascular risk estimation calculators.

Measurement variables and instrument

Adherence to the Mediterranean Diet

This questionnaire was developed and validated by the PREDIMED group [11], and includes 14 questions with two possible answers. Each item was scored with either zero or one point depending on whether the individual met the established recommendations regarding the MD. These recommendations are the following: 1) use of olive oil as the main fat for cooking; 2) daily consumption of at least 4 tablespoons of olive oil; 3) daily intake of at least 2 servings (1 serving = 200 g) of vegetables (at least one of them in a salad or raw); 4) daily consumption of 3 or more fruit pieces (including natural juice); 5) intake of less than one carbonated and/or sugary beverage per day; 6) consumption of less than one serving (100–150 g) of red meat, hamburgers, sausages or processed meat per day; 7) weekly consumption of at least 3 servings (1 serving = 150 g) of legumes; 8) consumption of at least 3 servings of fish or shellfish per week (1 piece or portion dish: 100—150 fish or 4–5 pieces or 200 g of seafood); 9) consumption of less than one serving (12 g) of cream, butter or margarine per day; 10) consumption of 7 or more glasses of wine in the whole previous week; 11) intake of nuts 3 or more times per week (1 serving = 30 g); 12) intake of industrial (non-home-made) pastries less than twice per week; 13) preference for the consumption of chicken, turkey or rabbit meat instead of beef, pork, hamburgers or sausages; and 14) consumption of “sofrito” (sauce made with tomato, garlic, onion and other vegetables to dress rice, pasta, meat and other dishes) 2 or more times per week. The final score range was 0 to 14 points. Although the MEDAS questionnaire does not have an established cut-off point to discern good adherence to the MD, the cut-off point of 9 points or more has frequently been used to indicate good adherence to this dietary pattern [6, 21].

Clinically relevant measures

Other variables were measured, including medication use obtained from medical notes, blood pressure, glucose, weight, height, and laboratory parameters (total serum cholesterol, LDL-cholesterol, HDL-cholesterol, triglycerides). Weight was measured twice at each visit using validated scales with an error of ± 0.1 kg. Blood pressure was measured 3 times in each arm using validated devices (OMRON M10-IT) following the measurement protocol of the European Society of Hypertension [22]. Laboratory tests were performed on fasting for 10–12 h and samples were sent to a central laboratory to be analyzed. The central laboratories all belonged to hospitals of the Spanish Health System and met all the required quality requirements. Cholesterol and triglyceride values were expressed in mg/dL and glycosylated hemoglobin in percentage. A detailed description of the way in which these variables were measured was published with the study protocol [13].

On the first visit, a researcher asked each individual questions to determine the stage of change for each lifestyle studied following the constructs of the Transtheoretical Model by Prochaska et al. [23] that classifies individuals into various stages of health behavior change: Precontemplation: No intention to take action within the next 6 months, Contemplation: Intends to take action within the next 6 months, Preparation: Intends to take action within the next 30 days and has taken some behavioural steps in this direction, Action: Changed overt behaviour for less than 6 months, Maintenance: Changed overt behaviour for more than 6 months, and Termination: No temptation to relapse and 100% confidence.

Assignment of intervention

The assignment of the intervention was performed by healthcare centre and was computer-generated at a central location (IDIAP Jordi Gol, Barcelona, Spain). For each of the seven Autonomous Communities, half of their participating healthcare centres (N = 13) were randomised to the intervention group and the other half (N = 13) were randomised to the control group. Both the investigators conducting the assessments (baseline and 12 months) and the investigators conducting the statistical analyzes were blinded to the intervention. Due to the very characteristics of the intervention, both the participants and the researchers who carried out the interventions could not be blinded to the intervention.

Intervention (only healthcare centres of the intervention group)

The intervention was grounded in the transtheoretical model of behaviour change [24] and was conducted by physicians and nurses of the healthcare centres within their routine of usual care, according to the conceptual framework of the “5 A’s”: Assess, Advise, Agree, Assist, and Arrange follow-up [25]. The intervention was based on the results of the previous phases of the study (pre-clinical, phase I and phase II) [8, 26,27,28,29,30,31,32]. It had three different action levels: individual, group and community. In all these levels, the aim was to act on the behaviours related to smoking, diet and physical activity at the same time, although, depending on the participant, actions were prioritised for one or more of these behaviours.

Individual intervention: the individual intervention level included 2–3 visits of 25–30 min each, with the possibility of conducting one more visit as a reinforcement of the intervention. Depending on the stage of change in which each participant was for each of the behaviours, either very brief (3 min) intervention (participants in pre-contemplation, contemplation and maintenance phase) or specific intervention (participants in preparation and action phase) was provided. The aim of the very brief intervention was to raise awareness of the need for a behavioural change and support the change or help to prevent possible relapses, whereas the specific intervention was aimed at establishing an agreed specific plan for the behavioural change. To guarantee an adequate and standardized measurement of the participants' stage of change in relation to their lifestyles, all the professionals undertook a 20-h online course on motivational interview [33]. Some studies suggest the effectiveness of the Short Message Service-SMS in health promotion interventions, especially in relation to the cessation of tobacco consumption and increasing physical activity, although certain gaps persist and further research on the subject is recommended [34, 35]. The intervention employed information and communication technologies (ICTs), such as websites for the participants, text messaging (in all the stages of change), smartphone applications (only in the preparation and action phases) [7] and other assistive devices like smartwatches and pedometers. The selection of the ICTs was carried out by previous pilot study and the effectiveness of these in previous studies [7]. Its relationship with the theory of change is described in Table 1.

Table 1 Characteristics of nutritional component of the intervention according to the dietary habits stage of change

Group intervention: Two health education workshops focused on healthy diet and physical activity were carried out. These workshops were carried out after the individual intervention and were directed by professionals of the involved centres. They had a duration of 90–120 min and were aimed at strengthening the recommendations given in the individual sessions and providing guidelines to facilitate the practice of physical activity and the adoption of healthy eating behaviours. The group sessions were adapted to the context of each healthcare centre of the participating intervention group. Some examples of workshops were: physical exercise sessions, cooking workshops or preparing seasonal menus.

Community intervention: This intervention was focused on the social prescription [36] of resources and activities performed in the environment of the community of each healthcare centre. Social prescription, also sometimes known as community referral, is a means of enabling health professionals to refer people to a range of local, non-clinical services. The referrals generally, but not exclusively, come from professionals working in primary care settings, for example, general practitioners or practice nurses. In the EIRA study, previously, each centre identified the available resources, as well as the activities with their schedule, duration and frequency. Depending on the possibilities of each participant and other conditioning factors like the work environment and time availability, the activities that best suited each participant were selected. Some examples of these activities were: cooking courses, heart-healthy walks, sport activities, dancing courses and activities, and green physical activity programmes. Its relationship with the theory of change is described in Table 1.

Nutritional component of the intervention: The nutritional intervention was carried out by a person included as staff of each Primary Care Team participating in the study. A specific training in dietary advice and on the Mediterranean diet was provided to the professionals who were in charge of carrying out this intervention in each center. The training lasted 8 h and was imparted by a dietician-nutritionist. Within the individual intervention, the specific section about MD included the following contents: 1) explanation of the concept of MD; 2) reasons for adopting a MD; 3) personalised recommendations about the changes that must be introduced and agreement on the objectives to attain; 4) delivery of informative material summarizing the intervention (leaflets); 5) the possibility of carrying out group workshops; 6) the possibility of conducting community activities; 7) the possibility of joining the SMS messaging programme; 8) the possibility of using ICTs (websites, smartphone applications, etc.). Within the group intervention, the specific section about the MD included health education workshops, cooking workshops and preparing seasonal menus. Community intervention was based on social prescription that included the activities identified in each intervention center. Some examples of these activities were cooking courses or nutrition education sessions to the community. Table 1 includes information on the type of intervention based on the stage of change in nutritional habits.

The specific intervention to address smoking followed the guidelines of motivational interview and included the establishment of a D-day to quit smoking and the submission of written material with follow-up visits at 15 days and 1 month after the D-day. On the other hand, the specific intervention to address physical activity was based on consensus with the participant on a personalised physical activity plan that preferably included community resources or programmes in the healthcare centre itself.

Usual care (healthcare centres of the control group)

The professionals of the control group healthcare centres were requested to integrate the lifestyle recommendations of the Programme of Preventive Activities and Health Promotion [37] into their usual practice. This programme includes protocols about lifestyle recommendations (diet recommendations focusing on the adoption of the MD, physical activity and smoking cessation) and a set of preventive activities for specific groups of patients (i.e., age, sex and risk) based on brief advice for the prevention of cardiovascular diseases, mental diseases and cancer, as well as for the follow-up of general and specific vaccination campaigns. This intervention in the control group differs from the EIRA intervention, since it is a brief, non-intensive and unique intervention.

Ethics approval

The template informed consent forms were reviewed and approved by the Research Ethics Committee of the IDIAP Jordi Gol (approval number P16/025). The study complied with all applicable laws on the protection of personal data. All data collection forms were identified by a coded identification number only to maintain participant confidentiality.

Sample size

A sample size of 3640 participants (1820 for each group), allowing for 30% loss to follow-up, was estimated to have 80% power (at 5% significance level, two-tailed and with an intracluster correlation of 0.01), to detect an absolute difference in a positive change in one or more of the three behaviours of 8% between groups (EIRA intervention and usual care).

Statistical power was estimated for the main outcome variable of this manuscript (percentage of individuals with good adherence to the MD at the end of the study). Accepting an alpha risk of 0.05 and a power of 80% in a bilateral test, a sample of 1481 subjects in the first group (EIRA intervention) and 1581 in the control group was enough to recognize as statistically significant the difference from 42% in the first group to 34% in the second group (statistical power 100%).

Statistical analyses

The statistical analyses were conducted by intention-to-treat. The normality of the variables was assessed using the Kolmogorov–Smirnov test. To address potential biases due to incomplete follow-up and non-response in the surveys, multiple imputation by chained equations (mice function in R software) with 50 imputed datasets was applied to outcomes and covariates [38, 39]. Estimates from each imputed dataset were combined following the rules outlined by Rubin [40]. The categorical variables are expressed as n and percentages, whereas the quantitative variables are expressed as mean and standard deviation. The mean differences between the study groups were evaluated with Student’s t-test, while the intragroup differences were assessed through Student’s t-test for paired data. The relationship between two categorical variables was analysed using the chi-squared test. Analysis of covariance (ANCOVA), with age, sex, center and dietary habits stage of change as covariates, was used to compare the changes between the two groups. For secondary outcomes, changes in physical activity and smoking cessation as covariates were additionally included in the analysis model. For the bilateral contrast of hypotheses, an alpha risk of 0.05 was set as the limit of statistical significance. The data were analysed using the statistical software SPSS for Windows version 25.0. (IBM Corp, Armonk, NY, USA).

Results

Participants and characteristics in the baseline evaluation

A total of 26 Spanish healthcare centres participated (13 IG and 13 CG). One centre of the IG could not recruit any participants for reasons related to external policy and available resources. A total of 4,387 participants were evaluated for eligibility, of whom 532 did not give their consent, 333 had only one unhealthy behaviour and 460 did not attend the baseline assessment visit. Finally, 3,062 participants were included (1,481 in IG and 1,581 in CG) (Fig. 1).

Fig. 1
figure 1

Flow diagram of clusters and participants through study

Table 2 shows the characteristics of the population. The mean age of the participants was 58.0 ± 8.1 years (54.9% women) without differences between the study groups. Moreover, there were no differences in marital status, with a predominance of married/coexisting participants (68.5%), work situation (48.0% employed), or educational level (39.4% with secondary or higher education). However, as is shown in Table 2, there were more IG than CG participants in the stage of preparation for changing dietary habits.

Table 2 Baseline characteristics of the study population

Description of the components of the intervention

Among the 1,481 IG participants, 843 (56.9%) showed co-occurrence of non-adherence to the MD and insufficient physical activity, 136 (9.2%) non-adherence to the MD and smoking and 405 (27.3%) exhibited all 3 behaviors at the same time. Low adherence to the MD was present in 1,384 (93.5%) participants, of whom 1,233 initiated the intervention and conducted at least one individual visit with a healthcare professional of the healthcare centre, in which aspects related to the MD were addressed. More than half of the participants received written material related to the intervention, 313 participants were referred a group session about lifestyles and 113 were referred to community programmes. Among the recommendations for the use of new technologies, 40.5% agreed to receive text messages and only 25.6% received recommendations for the download and use of smartphone applications (Table 3).

Table 3 Description of the EIRA Intervention

Adherence to the MD in the baseline evaluation

No differences were detected in the total score of the questionnaire of adherence to the MD at the baseline evaluation between the study groups, with IG and CG obtaining 6.74 and 6.79 points, respectively. Differences were found in the number of participants who obtained at least 9 points in the questionnaire (IG = 240 (16.2%) vs. CG = 316 (20.0%), (p < 0.05)). Among the 14 recommendations that establish good adherence to the MD, the use of virgin olive oil as the main fat to cook and season foods reached the highest percentage of compliance, with 91.4% in both groups. On the other hand, the items that showed the lowest scores were those related to the weekly consumption of legumes and wine. Three of the fourteen items showed differences in compliance between the study groups, with IG obtaining the highest compliance percentage regarding the intake of olive oil and CG obtaining the highest compliance percentage regarding the daily consumption of carbonated and/or sugary beverages (Table 4).

Table 4 Compliance with each item of the Mediterranean diet adherence screener

Effectiveness of the intervention regarding changes in adherence to the MD

A greater increase (13.7%; 95% CI, 9.9 to 17.5; p < 0.001) was obtained by IG in the number of participants who reached 9 points or more in MEDAS at 12 months. Moreover, the effect attributable to the intervention, after controlling for age, sex, centre and dietary habits stage of change obtained a greater increase (0.50 points; 95% CI, 0.35 to 0.66; p < 0.001) in IG (Table 5). The most relevant effects were observed in the items related to the weekly consumption of nuts, with IG obtaining a greater increase (9.4%; 95% CI, 5.9 to 12.9; p < 0.001) in the number of participants who complied with this recommendation. IG also showed an increase in the items related to the daily consumption of fruit, red and processed meat, the intake of butter, margarine and/or cream, the consumption of carbonated and/or sugary drinks, the weekly consumption of legumes and the weekly consumption of fish or shellfish and pastries.

Table 5 Intervention attributable difference in good adherence and compliance with each item

Effectiveness of the intervention on secondary variables (laboratory and weight variables)

After applying an analysis model controlled for age, sex, centre, stage of change in dietary habits, and change in physical activity and smoking cessation, we observed changes attributable to the intervention in one of the secondary variables studied, which are related to cardiovascular risk factors. There was a greater decrease in systolic blood pressure (-2.4 mmHg; CI 95%, -4.3 to -0.5; p = 0.014). No relevant effects were observed in the lipid profile, weight or the glycated haemoglobin (Table 6).

Table 6 Change in secondary outcomes (laboratory variables and weight) from baseline to 12-month follow-up

Discussion

The main finding of this study is the improvement of adherence to the MD caused by a complex intervention which was conducted within a real clinical context of primary health care by professionals of Spanish healthcare centres. The intervention, which included an individual, group and community approach, was also able to modify other clinical parameters related to the effects of cardiovascular risk factors, like systolic blood pressure.

The MD has become one of the most studied healthy dietary patterns and a target within the improvement of dietary behavior, mainly due to its cardiovascular effects [41, 42]. However, there are few studies focused on improving the adherence to this dietary pattern. The existing studies include very different populations and types of intervention [43,44,45,46]. In this sense, research has been focused on the study of populations at high cardiovascular risk, such as overweight or obese people [47] or people with type 2 diabetes mellitus [6], and thus very few interventions include general adult populations. With respect to the type of intervention, some of these interventions use information and communication technologies, such as websites for the participants, text messaging, smartphone applications [7], and others include additional dietary supplements in the habitual diet with primary components of MD, such as nuts or olive oil [48]. However, these interventions are difficult to implement in usual clinical practice due to their cost. Complex interventions, like that of the EIRA study, are aimed at solving some of these difficulties from their design. In the EIRA study, the intervention was modelled based on the characteristics of the population attended in each healthcare centre, with common elements for all. Another fundamental aspect to understand the nature of complex interventions is that they are performed within a real clinical healthcare context so that the EIRA intervention was part of the daily healthcare job of physicians, nurses, social workers and other professionals like the administration staff of the participating primary healthcare centres, which is an advantage for the implementation of its results.

In terms of public health, the effect attributable to the intervention in terms of increasing adherence to the MD is not very relevant (0.50 points). The meta-analysis by Sofi et al. [2] concluded that a 2-point increase in the MD adherence score was associated with a 10% reduction in cardiovascular disease incidence and mortality, so such a small half-point increase could have a very minor impact. However, very few studies have found relevant differences. The MedLey study, whose intervention consisted of a dietitian-led intervention where all participants consulted the study dietitian fortnightly, received resources including recipes and meal plans, and those in the intervention arm collected study foods representing the MD, achieved an increase of 1.3 points in the adherence questionnaire [43]. While the reseach of Lugones-Sanchez et al. [45] and Gonzalez-Ramirez et al. [44], with interventions based on the use of smartphone applications, achieved very slight increases of 0.37 and 0.40 points, respectively, in the experimental group. The most important results were achieved by the study of Chou et al. [46], which achieved an increase of 2.22 points with an intervention based on game-based learning strategies that included motivation promotion, interactive self-learning, guiding questions and reflection between educators and learners about the progress of the game activity.

However, the effect on the number of people who, after the EIRA intervention, obtained good adherence to the MD (13.7%) is of greater importance. Among the 14 points of which the MEDAS is constructed, significant increases in compliance were achieved in 13. However, in the first one, regarding the use of olive oil as the main fat for cooking, this was not the case. A possible explanation for this finding is that it is the item which already had the highest compliance at baseline (91.4%). It is difficult to know what specific aspects of the intervention may condition these results, but a possible explanation for this finding is that during the individual intervention visit, personalized objectives were established that included the modification of no more than 2 or 3 of the 14 elements present in the MD adherence questionnaire. These objectives were aimed at meeting those aspects of adherence to the MD that were not met at the baseline visit. It is necessary to discuss the influence that some socioeconomic factors may have had on the change in adherence to the MD, especially in Mediterranean populations like that of the EIRA study. There are several papers that have previously analyzed this in greater detail. Absolute change in the MD score was positively associated with female gender, age, higher education, and moderate physical activity [49,50,51]. On the other hand, there is evidence that the recruitment of individuals with high perceived self-efficacy to dietary change, and those who initially follow diets relatively richer in fiber may lead to greater changes in nutritional recommendations [52].

A slight reduction (-2.4 mmHg (CI -4.3 to -0.5)) in systolic blood pressure figures favorable to the IG has been observed. These results are similar to the findings of other recent studies, such as the MedLey study [43]. However, and despite including an adjustment for positive changes in physical activity and smoking cessation in the analysis model, we cannot firmly state that this reduction in systolic blood pressure is a consequence of the change in diet.

Among the main limitations of this study we find the following. In reference to the selection of participating centres, those responsible for the study selected the centres based on a series of circumstances that included areas in which there was not a great cultural and linguistic diversity, and this may represent a possible selection bias that influences the generalization of the results. Second, the assessment of adherence to the MD was carried out through a questionnaire, which, although validated for the reference population, does not guarantee correct adherence as accurately as other nutrient biomarkers can. This study recruited low fruit and vegetable consumers who can still score 9 points or more on MEDAS (i.e., have high adherence to the MD). This may also constitute a possible selection bias. The intervention could have benefited from the direct participation of nutritionists or dieticians in the direct transfer of knowledge of the Mediterranean Diet to the participants, although the professionals involved were trained by a dietitian.

Conclusions

A complex intervention, designed, modelled and carried out by primary healthcare professionals, within a real clinical healthcare context, showed an increase in the percentage of participants that achieve good adherence to the MD compared to the brief advice given in the usual visits to the doctor’s office, although the overall change in the MEDAS was small.

Availability of data and materials

The datasets used and analysed during this study are available from the corresponding author on reasonable request.

References

  1. Bach-Faig A, Berry EM, Lairon D, Reguant J, Trichopoulou A, Dernini S, et al. Mediterranean diet pyramid today Science and cultural updates. Public Health Nutr. 2011;14:2274–84.

    Article  PubMed  Google Scholar 

  2. Sofi F, Macchi C, Abbate R, Gensini GF, Casini A. Mediterranean diet and health status: an updated meta-analysis and a proposal for a literature-based adherence score. Public Health Nutr. 2014;17:2769–82.

    Article  PubMed  Google Scholar 

  3. Kastorini C-M, Milionis HJ, Esposito K, Giugliano D, Goudevenos JA, Panagiotakos DB. The effect of Mediterranean diet on metabolic syndrome and its components: a meta-analysis of 50 studies and 534,906 individuals. J Am Coll Cardiol. 2011;57:1299–313.

    Article  PubMed  CAS  Google Scholar 

  4. Serra-Majem L, Trichopoulou A, Ngo de la Cruz J, Cervera P, García Alvarez A, La Vecchia C, et al. Does the definition of the Mediterranean diet need to be updated? Public Health Nutr. 2004;7:927–9.

    Article  PubMed  Google Scholar 

  5. Jayedi A, Janbozorgi N, Djafarian K, Yekaninejad MS, Shab-Bidar S. Dietary networks identified by Gaussian graphical model and general and abdominal obesity in adults. Nutr J. 2021;20:86.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Alonso-Dominguez R, Garcia-Ortiz L, Patino-Alonso MC, Sanchez-Aguadero N, Gomez-Marcos MA, Recio-Rodriguez JI. Effectiveness of A Multifactorial Intervention in Increasing Adherence to the Mediterranean Diet among Patients with Diabetes Mellitus Type 2: A Controlled and Randomized Study (EMID Study). Nutrients. 2019;11:162.

    Article  PubMed Central  CAS  Google Scholar 

  7. Recio-Rodriguez JI, Agudo-Conde C, Martin-Cantera C, Gonzalez-Viejo MN, Fernandez-Alonso MDC, Arietaleanizbeaskoa MS, et al. Short-Term Effectiveness of a Mobile Phone App for Increasing Physical Activity and Adherence to the Mediterranean Diet in Primary Care: A Randomized Controlled Trial (EVIDENT II Study). J Med Internet Res. 2016;18:e331.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Maderuelo-Fernandez JA, Recio-Rodriguez JI, Patino-Alonso MC, Perez-Arechaederra D, Rodriguez-Sanchez E, Gomez-Marcos MA, et al. Effectiveness of interventions applicable to primary health care settings to promote Mediterranean diet or healthy eating adherence in adults: A systematic review. Prev Med (Baltim). 2015;76(Suppl):S39-55.

    Article  Google Scholar 

  9. Zazpe I, Sanchez-Tainta A, Estruch R, Lamuela-Raventos RM, Schroder H, Salas-Salvado J, et al. A large randomized individual and group intervention conducted by registered dietitians increased adherence to Mediterranean-type diets: the PREDIMED study. J Am Diet Assoc. 2008;108:1134–44 ; discussion 1145.

    Article  PubMed  CAS  Google Scholar 

  10. Logan KJ, Woodside JV, Young IS, McKinley MC, Perkins-Porras L, McKeown PP. Adoption and maintenance of a Mediterranean diet in patients with coronary heart disease from a Northern European population: a pilot randomised trial of different methods of delivering Mediterranean diet advice. J Hum Nutr Diet. 2010;23:30–7.

    Article  PubMed  CAS  Google Scholar 

  11. Schroder H, Fito M, Estruch R, Martinez-Gonzalez MA, Corella D, Salas-Salvado J, et al. A short screener is valid for assessing Mediterranean diet adherence among older Spanish men and women. J Nutr. 2011;141:1140–5.

    Article  PubMed  CAS  Google Scholar 

  12. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Zabaleta-Del-Olmo E, Pombo H, Pons-Vigues M, Casajuana-Closas M, Pujol-Ribera E, Lopez-Jimenez T, et al. Complex multiple risk intervention to promote healthy behaviours in people between 45 to 75 years attended in primary health care (EIRA study): study protocol for a hybrid trial. BMC Public Health. 2018;18:874.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Zabaleta-Del-Olmo E, Casajuana-Closas M, López-Jiménez T, Pombo H, Pons-Vigués M, Pujol-Ribera E, et al. Multiple health behaviour change primary care intervention for smoking cessation, physical activity and healthy diet in adults 45 to 75 years old (EIRA study): a hybrid effectiveness-implementation cluster randomised trial. BMC Public Health. 2021;21:2208.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Aznar-Lou I, Zabaleta-Del-Olmo E, Casajuana-Closas M, Sánchez-Viñas A, Parody-Rúa E, Bolíbar B, et al. Cost-effectiveness analysis of a multiple health behaviour change intervention in people aged between 45 and 75 years: a cluster randomized controlled trial in primary care (EIRA study). Int J Behav Nutr Phys Act. 2021;18:88.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Chan A-W, Tetzlaff JM, Gotzsche PC, Altman DG, Mann H, Berlin JA, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346:e7586.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Pinnock H, Barwick M, Carpenter CR, Eldridge S, Grandes G, Griffiths CJ, et al. Standards for Reporting Implementation Studies (StaRI): explanation and elaboration document. BMJ Open. 2017;7:e013318.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Garcia-Armesto S, Begona Abadia-Taira M, Duran A, Hernandez-Quevedo C, Bernal-Delgado E. Spain: Health system review. Health Syst Transit. 2010;12(1–295):xix–xx.

    Google Scholar 

  19. Bully P, Sanchez A, Grandes G, Pombo H, Arietalenizbeaskoa MS, Arce V, et al. Metric properties of the “prescribe healthy life” screening questionnaire to detect healthy behaviors: a cross-sectional pilot study. BMC Public Health. 2016;16:1228.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Puig-Ribera A, Martin-Cantera C, Puigdomenech E, Real J, Romaguera M, Magdalena-Belio JF, et al. Screening Physical Activity in Family Practice: Validity of the Spanish Version of a Brief Physical Activity Questionnaire. PLoS ONE. 2015;10:e0136870.

    Article  PubMed  PubMed Central  Google Scholar 

  21. García-Conesa M-T, Philippou E, Pafilas C, Massaro M, Quarta S, Andrade V, et al. Exploring the Validity of the 14-Item Mediterranean Diet Adherence Screener (MEDAS): A Cross-National Study in Seven European Countries around the Mediterranean Region. Nutrients. 2020;12(10):2960.

    Article  PubMed Central  Google Scholar 

  22. O’Brien E, Asmar R, Beilin L, Imai Y, Mancia G, Mengden T, et al. Practice guidelines of the European Society of Hypertension for clinic, ambulatory and self blood pressure measurement. J Hypertens. 2005;23:697–701.

    Article  PubMed  Google Scholar 

  23. Prochaska JO, DiClemente CC. Stages and processes of self-change of smoking: toward an integrative model of change. J Consult Clin Psychol. 1983;51:390–5.

    Article  PubMed  CAS  Google Scholar 

  24. Bully P, Sanchez A, Zabaleta-del-Olmo E, Pombo H, Grandes G. Evidence from interventions based on theoretical models for lifestyle modification (physical activity, diet, alcohol and tobacco use) in primary care settings: A systematic review. Prev Med (Baltim). 2015;76(Suppl):S76-93.

    Article  Google Scholar 

  25. Goldstein MG, Whitlock EP, DePue J. Multiple behavioral risk factor interventions in primary care. Summary of research evidence. Am J Prev Med. 2004;27(2 Suppl):61–79.

    Article  PubMed  Google Scholar 

  26. Zabaleta-del-Olmo E, Bolibar B, Garcia-Ortiz L, Garcia-Campayo J, Llobera J, Bellon JA, et al. Building interventions in primary health care for long-term effectiveness in health promotion and disease prevention A focus on complex and multi-risk interventions. Preventive medicine. 2015;76(Suppl):S1-4.

    Article  PubMed  Google Scholar 

  27. Pons-Vigues M, Berenguera A, Coma-Auli N, Pombo-Ramos H, March S, Asensio-Martinez A, et al. Health-care users, key community informants and primary health care workers’ views on health, health promotion, health assets and deficits: qualitative study in seven Spanish regions. Int J Equity Health. 2017;16:99.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Berenguera A, Pons-Vigues M, Moreno-Peral P, March S, Ripoll J, Rubio-Valera M, et al. Beyond the consultation room: Proposals to approach health promotion in primary care according to health-care users, key community informants and primary care centre workers. Heal Expect an Int J public Particip Heal care Heal policy. 2017;20:896–910.

    Google Scholar 

  29. Martin Cantera C, Puigdomenech E, Ballve JL, Arias OL, Clemente L, Casas R, et al. Effectiveness of multicomponent interventions in primary healthcare settings to promote continuous smoking cessation in adults: a systematic review. BMJ Open. 2015;5:e008807.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Sanchez A, Bully P, Martinez C, Grandes G. Effectiveness of physical activity promotion interventions in primary care: A review of reviews. Prev Med (Baltim). 2015;76(Suppl):S56-67.

    Article  Google Scholar 

  31. March S, Torres E, Ramos M, Ripoll J, Garcia A, Bulilete O, et al. Adult community health-promoting interventions in primary health care: A systematic review. Prev Med (Baltim). 2015;76(Suppl):S94-104.

    Article  Google Scholar 

  32. Alvarez-Bueno C, Cavero-Redondo I, Martinez-Andres M, Arias-Palencia N, Ramos-Blanes R, Salcedo-Aguilar F. Effectiveness of multifactorial interventions in primary health care settings for primary prevention of cardiovascular disease: A systematic review of systematic reviews. Prev Med (Baltim). 2015;76(Suppl):S68-75.

    Article  Google Scholar 

  33. Boveda Fontan J. Perula de Torres LA, Campinez Navarro M, Bosch Fontcuberta JM, Barragan Brun N, Prados Castillejo JA [Current evidence on the motivational interview in the approach to health care problems in primary care]. Aten primaria. 2013;45:486–95.

    PubMed  PubMed Central  Google Scholar 

  34. Abroms LC, Whittaker R, Free C, Mendel Van Alstyne J, Schindler-Ruwisch JM. Developing and Pretesting a Text Messaging Program for Health Behavior Change: Recommended Steps. JMIR mHealth uHealth. 2015;3:e107.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Hall AK, Cole-Lewis H, Bernhardt JM. Mobile text messaging for health: a systematic review of reviews. Annu Rev Public Health. 2015;36:393–415.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Bickerdike L, Booth A, Wilson PM, Farley K, Wright K. Social prescribing: less rhetoric and more reality. A systematic review of the evidence. BMJ Open. 2017;7:e013384.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Córdoba García R, Camarelles Guillem F, Muñoz Seco E, Gómez Puente JM, Ramírez Manent JI, San José Arango J, et al. Recomendaciones sobre el estilo de vida. Atención Primaria. 2016;48:27–38. https://doi.org/10.1016/S0212-6567(16)30186-X.

    Article  PubMed  PubMed Central  Google Scholar 

  38. White IR, Royston P, Wood AM. Multiple imputation using chained equations: Issues and guidance for practice. Stat Med. 2011;30:377–99.

    Article  PubMed  Google Scholar 

  39. Lee KJ, Simpson JA. Introduction to multiple imputation for dealing with missing data. Respirology. 2014;19:162–7.

    Article  PubMed  Google Scholar 

  40. Rubin D. Multiple Imputation for Nonresponse in Surveys. Hoboken, NJ, USA: John Wiley & Sons, Inc; 1987.

    Book  Google Scholar 

  41. Cowell OR, Mistry N, Deighton K, Matu J, Griffiths A, Minihane AM, et al. Effects of a Mediterranean diet on blood pressure: a systematic review and meta-analysis of randomized controlled trials and observational studies. J Hypertens. 2021;39:729–39.

    Article  PubMed  CAS  Google Scholar 

  42. Rosato V, Temple NJ, La Vecchia C, Castellan G, Tavani A, Guercio V. Mediterranean diet and cardiovascular disease: a systematic review and meta-analysis of observational studies. Eur J Nutr. 2019;58:173–91.

    Article  PubMed  CAS  Google Scholar 

  43. Murphy KJ, Dyer KA, Hyde B, Davis CR, Bracci EL, Woodman RJ, et al. Long-Term Adherence to a Mediterranean Diet 1-Year after Completion of the MedLey Study. Nutrients. 2022;14(15):3098.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  44. Gonzalez-Ramirez M, Sanchez-Carrera R, Cejudo-Lopez A, Lozano-Navarrete M, Salamero Sánchez-Gabriel E, Torres-Bengoa MA, et al. Short-Term Pilot Study to Evaluate the Impact of Salbi Educa Nutrition App in Macronutrients Intake and Adherence to the Mediterranean Diet: Randomized Controlled Trial. Nutrients. 2022;14(10):2061.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  45. Lugones-Sanchez C, Recio-Rodriguez JI, Agudo-Conde C, Repiso-Gento I, G Adalia E, Ramirez-Manent JI, et al. Long-term Effectiveness of a Smartphone App Combined With a Smart Band on Weight Loss, Physical Activity, and Caloric Intake in a Population With Overweight and Obesity (Evident 3 Study): Randomized Controlled Trial. J Med Internet Res 2022;24:e30416.

  46. Chou C-C, Li Y-J, Wang C-J, Lyu L-C. A mini-flipped, game-based Mediterranean diet learning program on dietary behavior and cognitive function among community-dwelling older adults in Taiwan: A cluster-randomized controlled trial. Geriatr Nurs. 2022;45:160–8.

    Article  PubMed  Google Scholar 

  47. Salas-Salvado J, Diaz-Lopez A, Ruiz-Canela M, Basora J, Fito M, Corella D, et al. Effect of a Lifestyle Intervention Program With Energy-Restricted Mediterranean Diet and Exercise on Weight Loss and Cardiovascular Risk Factors: One-Year Results of the PREDIMED-Plus Trial. Diabetes Care. 2019;42:777–88.

    Article  PubMed  CAS  Google Scholar 

  48. Estruch R, Ros E, Salas-Salvado J, Covas M-I, Corella D, Aros F, et al. Primary prevention of cardiovascular disease with a Mediterranean diet. N Engl J Med. 2013;368:1279–90.

    Article  PubMed  CAS  Google Scholar 

  49. Pribisalić A, Popović R, Salvatore FP, Vatavuk M, Mašanović M, Hayward C, et al. The Role of Socioeconomic Status in Adherence to the Mediterranean Diet and Body Mass Index Change: A Follow-Up Study in the General Population of Southern Croatia. Nutrients. 2021;13(11):3802.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Ruggiero E, Di Castelnuovo A, Costanzo S, Persichillo M, Bracone F, Cerletti C, et al. Socioeconomic and psychosocial determinants of adherence to the Mediterranean diet in a general adult Italian population. Eur J Public Health. 2019;29:328–35.

    Article  PubMed  Google Scholar 

  51. Patino-Alonso MC, Recio-Rodriguez JI, Belio JFM, Colominas-Garrido R, Lema-Bartolome J, Arranz AG, et al. Factors associated with adherence to the Mediterranean diet in the adult population. J Acad Nutr Diet. 2014;114:583–9.

    Article  PubMed  Google Scholar 

  52. Fernandez-Lazaro CI, Toledo E, Buil-Cosiales P, Salas-Salvadó J, Corella D, Fitó M, et al. Factors associated with successful dietary changes in an energy-reduced Mediterranean diet intervention: a longitudinal analysis in the PREDIMED-Plus trial. Eur J Nutr. 2022;61:1457–75.

    Article  PubMed  CAS  Google Scholar 

Download references

Acknowledgements

We want to thank the workers of the following primary healthcare centres and their organisations for participating in this study: El Pla, Montilivi, Sant Martí, and Santa Clara of the Institut Català de la Salut; Casco Viejo, Salburua, Sansomendi and Zaramaga of the Osakidetza-Servicio Vasco de Salud; Garrido Sur, San Esteban de Gormaz, San Juan and Virgen de la Concha of Salud Castilla y León; Olivar de Quinto and Las Palmeritas of the Servicio Andaluz de Salud; Almozara, Las Fuentes Norte, La Jota and Parque Goya of the Servicio Aragonés de Salud; Matamá, Pintor Colmeiro, Teis and Val Miñor of the Servizo Galego de Saúde, and Alcúdia-Es Safrà, Calvià, Manacor and Son Serra-LaVileta of the Servei de Salut de les Illes Balears.

Funding

This study has been funded by the Spanish Ministry of Science and Innovation, Instituto de Salud Carlos III (ISCIII). RD21/0016/0010 is funded by the European Union-Next Generation EU, Facility for Recovery and Resilience (MRR) and PI15/00114, PI15/00565, PI15/00762, PI15/01072, PI15/00896, PI15/01412, PI15/01151, PI15/00519, PI15/01133 is co funded by the European Union. They played no role in the study design, data analysis, reporting results, or the decision to submit the manuscript for publication.

Author information

Authors and Affiliations

Authors

Contributions

EZO, MCC, TLJ and BB conceived the hybrid trial. JIR, JAM, JL, RR, HP EM, MGG, FLM and FRC contributed to the refinement of methodology and local realisation of the study. IGY, LGO and CLS were responsible for the study at the PHC centres in Castilla y Leon. JAM and JIR were responsible for the study at the PHC centres in Castilla y Leon. TLJ was responsible for the sample size calculation, statistical analysis plan, and statistical evaluation. All authors have reviewed the draft critically and suggested revisions, given final approval of the version to be published and agreed to be accountable for all aspects of the study. JIR is the lead author and the manuscript’s guarantor and attests that all listed authors meet authorship criteria. The author(s) read and approved the final manuscript.

Corresponding author

Correspondence to Jose I. Recio-Rodriguez.

Ethics declarations

Ethics approval and consent to participate

This research was performed in accordance with the Declaration of Helsinki. Participants signed an informed consent form before the start of the study. This study was approved by the Research Ethics Committee of the Fundació Institut Universitari Jordi Gol i Gurina (reference number P16/025). All methods were carried out in accordance with relevant guidelines and regulations of the declaration of Helsinki.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Recio-Rodriguez, J.I., Garcia-Ortiz, L., Garcia-Yu, I.A. et al. Effectiveness of a multiple health-behaviour-change intervention in increasing adherence to the Mediterranean Diet in adults (EIRA study): a randomized controlled hybrid trial. BMC Public Health 22, 2127 (2022). https://doi.org/10.1186/s12889-022-14590-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-022-14590-y

Keywords