Next Article in Journal
Rapid Loss of Tidal Flats in the Yangtze River Delta since 1974
Next Article in Special Issue
Discrimination in In-Patient Geriatric Care: A Qualitative Study on the Experiences of Employees with a Turkish Migration Background
Previous Article in Journal
Potential Factors Influencing Repeated SARS Outbreaks in China
Previous Article in Special Issue
Validation of the Brief Thai Version of the Work-Related Quality of Life Scale (Brief THWRQLS)
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Extent of Psychosocial Distress among Immigrant and Non-Immigrant Homecare Nurses—A Comparative cross Sectional Survey

1
Department of Medical Psychology, University Medical Center Hamburg-Eppendorf, Martinistraße 52, 20246 Hamburg, Germany
2
Competence Centre for Epidemiology and Health Services Research for Healthcare Professionals (CVcare), Institute for Health Services Research in Dermatology and Nursing, University Medical Centre Hamburg-Eppendorf, Bethanien-Höfe Eppendorf, Martinistraße 52, 20246 Hamburg, Germany
3
Department of Occupational Health Research, German Social Accident Insurance Institution for the Health and Welfare Services, Pappelallee 33/35/37, 22089 Hamburg, Germany
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2020, 17(5), 1635; https://doi.org/10.3390/ijerph17051635
Submission received: 23 February 2020 / Revised: 27 February 2020 / Accepted: 29 February 2020 / Published: 3 March 2020

Abstract

:
In times of demographic change, most developed countries are increasingly looking to cover the growing domestic demand for healthcare by hiring nurses from abroad. The evidence concerning the health of immigrant care workers is inconsistent since studies report that it is either better or more impaired than that of their non-immigrant counterparts. This study compared the extent of occupational psychosocial stressors and resources affecting immigrant and non-immigrant homecare nurses. The cross-sectional survey was conducted in the homecare nursing service sector in Hamburg. Psychosocial distress, depressive symptomatology, generalized anxiety, somatic symptom burdens, homecare-specific qualitative stressors, as well as resources, have been measured using a standardized questionnaire. There was no significant difference in the extent of psychosocial distress experienced by immigrant and non-immigrant homecare nurses. Somatic symptom burdens most strongly predicted nurses’ psychosocial distress, in general. For immigrant nurses, greater influence and freedom at work, as well as fixed-term employment, was related to increased levels of distress, while age, working full time, and working overtime predicted distress in non-immigrant nurses. A functioning relationship with colleagues and superiors had a declining effect on immigrant nurses’ psychosocial distress, while shift work arrangements benefitted non-immigrant nurses. Even though the extent of psychosocial distress experienced by immigrant and non-immigrant nurses did not significantly differ, the nurse’s individual explanatory model of psychosocial health should be considered in every occupational and political context.

1. Introduction

Providing adequate healthcare to people is a global challenge [1]. A global shortage of healthcare workers is being experienced alongside demographic change, the increase of chronic diseases, as well as migration [2].
The global “Nursing Now” campaign aims to create awareness about the need for more nurses, but also the development of new and innovative types of services in times of a more home-based, people-focused, and more preventive healthcare [3]. According to the World Health Organization, nurses and midwives account for 50% of the current global shortage of health workers, which is forecasted to reach 9 million by 2030 [4]. In 2018, 1.6 million nurses were employed in Germany [5], while calculation scenarios assume a shortage of 260,000 to 430,000 full-time equivalents by 2030 [6]. This is due to an increase of people in need of long-term care concomitant with declining labor resources. Following the European trend of “Aging in place” [7,8,9,10] and, therefore, financially strengthening family care, Germany fosters the priority of outpatient care. This should reduce the increasing demand for nursing care that is carried out by professional nurses [11].
Immigration intensifies the cultural and linguistic diversity, challenging the German healthcare system. The proportion of people with an immigrant background in Germany will rise from 24% in 2017 [12] to 28% in 2030 [13]. The Federal Ministry of Health estimated that 310,000 immigrants were in need of care in 2018, and predicted an increase to 474,000 in 2030 [13].
The profession of nurse is associated with frequent mental and physical stress, having a negative impact on the nurses’ health. This may, in turn, cause nurses to vacate their jobs [14,15,16]. The mobilization of patients or clients in terms, for example, body care (washing the patient’s/client’s body) and time pressure, caused by the rising work intensification, are experienced as particularly stressful. This is followed by administrative tasks, such as care documentation and repeated interruptions of the workflow [17,18]. Homecare nurses are also exposed to specific musculoskeletal stresses, such as moving furniture, to optimize their workplace [19].
Immigrant and minority homecare staff additionally report discrimination and racism at work in terms of a lack of employment opportunities, poor career progression, or poor learning environment [20]. They experience racial discrimination during their contact with patients and their families, but also with doctors, management, and nursing colleagues [21]. Discrimination and racial harassment have a significant negative impact on job satisfaction [22].
Nurses partially compensate their occupational burdens through the inherent diversity of the nursing job, the great scope for action, teamwork, and a strong personal affirmation through their job. A positive and functioning relationship with colleagues and superiors within the institution are further resources [17,18].
Nurses share similar work-related barriers regardless of their ethnic or cultural background. The leading stressor, which hinders a functioning collaboration between nurses, is communication problems due to language barriers with their non-immigrant counterparts. Within a diverse workforce, a different understanding and diverse expectations of nursing quality inside the team can cause conflicts [20].
Studies show that immigrant healthcare workers are in poorer health in the host country than their non-immigrant counterparts and explain this with the often adverse living conditions, such as lower socioeconomic status, being employed in a more hazardous occupation, or affected by unemployment or a disadvantageous housing situation [23]. The German Aging Survey (DEAS) has shown that 29% of immigrants in the second half of their lives in Germany are affected by functional health restrictions compared to 24.4% of non-immigrant workers. Likewise, more than 33% of immigrant workers report mild forms of depressive symptoms compared to 26% of non-immigrant workers, respectively. While immigrants in the second half of their lives in Germany manifest a lower health status compared to non-immigrants, data prove that the living and health status of second-generation immigrants are similar to their non-immigrant counterparts [24]. The “German Health Interview and Examination Survey for Adults” (DEGS) concludes that depressive symptoms are more frequent among male immigrants (10.6%) than non-immigrant males (5%), as well as among female immigrants (15.1% versus 9.1%) compared to female non-immigrants [25]. Despite the lower health status of immigrants, in general, study results show a similar and better health status of second-generation immigrants born in Germany and having at least one parent born abroad [23,24,25].
Summing up, one can say that the data about the health of immigrant healthcare workers in Germany are heterogeneous, comparison data of immigrant and non-immigrant nurses are lacking, while the number of immigrant nurses is expected to rise, which will lead to the further diversification of the healthcare workforce in a number of countries, including Germany.
Based on the transactional model of stress by Lazarus and Folkman (1984) and its adaption to the nursing context, we juxtaposed – for this study’s purpose – immigrant and non-immigrant nurses. Those then are interacting as individual human beings in the work context of homecare nursing. Psychosocial stress emerges, on the one hand, by person-related (e.g., illness) and situation-related stressors (e.g., time pressure), as well as person-related resources (e.g., self-efficacy) and situation-related resources (e.g., team/supervisor support) on the other hand [26,27,28]. Immigrant and non-immigrant homecare nurses share similar stressors in the context of work (e.g., lifting heavy patients, time pressure) and interaction (e.g., unequal treatment) and resources (mutual support, exchanges with colleagues) to master occupational burdens. However, they differ in their explanations on how they perceive those stressors and in their behavior on how they cope with them. This leads to the interdependence of work-related and interaction-related stressors and resources, which, in turn, can affect the collaboration within a cultural and linguistic diverse nursing team, as well as towards superiors and in the intercultural nurse-client relationship [20,21]. The following chart displays the conceptual framework of this study (Figure 1).
There is evidence that immigrant workers are in poorer health than their native counterparts are. The home care sector is a market with increasing demand and increasing linguistic and cultural diversification on the care provider and care recipient side. Studies about the health of migrant care workers, especially those about psychosocial health, are scarce. This study aimed to compare the extent of psychosocial stress experienced by immigrant and non-immigrant homecare nurses. The above-mentioned qualitative differences in the patterns of origin of psychosocial stress had also been quantified in this study to detect possible differences among immigrant and non-immigrant homecare nurses.
High turnover rates in times of lacking workforce resources and an increasing diversification is a serious threat for the provision of nursing care. Since workplace retention is positively correlated with the health of nurses, providing them with a healthy workplace will increase the retention rate [29,30].
The corresponding research questions were:
  • Are immigrant homecare nurses more stressed at work than their non-immigrant colleagues?
  • Which factors predict the psychosocial distress of those nurses?

2. Materials and Methods

2.1. Design

A cross-sectional design was applied.

2.2. Setting and Participants

Data were collected from nurses working in the homecare sector in the federal state of Hamburg in Germany. In 2017, more than 35% of Hamburg’s 1.8 million inhabitants had a migration background, and half of those were German citizens [31]. Hamburg was chosen due to the already existing regional access to the field within the study’s underlying research project [20,21,32]. A total of 11,200 nurses work in the homecare sector in Hamburg—more than two thirds on a part-time basis [33]. In Germany, 1.6 million nurses work in hospitals, in-home healthcare, and nursing homes 226,000 of these nurses are immigrants [13,34]. A statistical power analysis was performed with G*Power 3.0.10 a priori to estimate the sample size. We aimed to compare the extent of psychosocial distress among immigrant and non-immigrant homecare nurses. The primary outcome was the German version of the NCCN Distress Thermometer [35,36]. Based on Cohen’s criteria, a small to medium effect size of d = 0.35 was set in this study. The error was set to alpha = 0.05, the power to 1-ß = 0.8, as well the allocation ratio to 1 due to the comparison between the two groups of nurses. Thus, our proposed sample size was 260; in other words, 130 immigrant nurses and 130 non-immigrant nurses. Based on recent similar studies [37], we estimated response of 30% and so had to distribute at least 870 questionnaires. After mapping every homecare provider in Hamburg to its specific district, the strata were then sorted according to the proportion of people with a migration background in each district. Within those, we randomly selected between four to 17 nursing services and contacted their management by telephone, inviting them to join the survey. The main author also visited some of the services to present the study. Once consent was given, the nursing services’ directors were asked to deliver questionnaire packs that also contained all relevant data privacy explanations. Completed questionnaires were either returned in an anonymous envelope or were personally collected by the main author. Participants’ consent in the study was given by the return of the questionnaire.

2.3. Sample

Due to the different proportion of people with a migration background in each district, the number of delivered questionnaires per district ranged from 89 to 262. After having distributed 870 questionnaires, we received 249 (immigrant nurses: 72, non-immigrant nurses: 177). After discussions within the project team, the proportional randomized stratified sampling approach was continued. Finally, 1110 questionnaires were distributed in 59 nursing services. In total, we received 287 questionnaires (n = 105 immigrant nurses, as well as n = 182 non-immigrant nurses), which corresponded to an overall response rate of 25.4%. The lower response rate among immigrant nurses corresponded with previous related research in this context [38].

2.4. Data Collection

Data were collected from 13 March 2018 until 1 February 2019.

2.5. Measures

2.5.1. Primary Objective

The German version of the NCCN Distress Thermometer [35] was applied to assess psychosocial distress. The original version of the NCCN has been developed by the National Comprehensive Cancer Network (NCCN) in the U.S. to determine the type and extent of existing stress in oncological patients [36]. It consists of a one-item global screener for distress (the Distress Thermometer) and an accompanying problem list. The one-item screener is an 11-point Likert scale ranging from 0 (No distress) to 10 (Extreme distress). Patients indicate their levels of distress over the course of one week before assessment. The accompanying problem list consists of 40 items that detail practical (e.g., childcare, housing, insurance/financial), family (e.g., dealing with children/ with partner, ability to have children), emotional (e.g., fears, loss of interest in usual activities), spiritual (e.g., loss of faith in God), and physical problems (e.g., appearance, bathing/dressing, getting around, sexual, substance use) causing distress. The NCCN problem list is meant for patients to inform their doctor if they are having emotional concerns in the above-mentioned areas. For this study, only the scores from the one-item screener were analyzed since possible emotional concerns causing stress among immigrant and non-immigrant nurses have been qualitatively assessed and discussed elsewhere from this study’s authors [20,21]. With a sensitivity of 97% and a specificity of 41%, the NCCN shows adequate total psychometric properties. Following international recommendations, a person who scores 5 and above is moderately distressed and needs support. The tool is easy to use since it measures distress in a similar way to pain—on a scale of zero to 10 with 10 being the worst [35,36].

2.5.2. Secondary Objectives

Somatic burdens of nurses were assessed using the German version of the Somatic Symptom Scale–8 (SSS-8) [39]. The SSS-8 measures results with a 5-point response option for stomach or bowel problems; back, arm, joints or legs pain; headaches; chest pain or shortness of breath; dizziness; feeling tired or having low energy, and, finally, having trouble sleeping. The sum score can range between 0 to 32 within a pragmatic categorization of none to minimal (0–3), low (4–7), medium (8-–11), high (12–15), and very high (16–32) [39]. Within this study, we applied a binary cut off with >11 for high symptomatic burdens.
Depression was assessed using the Patient Health Questionnaire-9 (PHQ-9) [40]. The PHQ-9 is the depression module of the PRIME-MD (Primary Care Evaluation of Mental Disorders) diagnostic instrument for common mental disorders and scores each of the 9 DSM-IV (Diagnostic and Statistical Manual of Mental Disorders) criteria from 0 (not at all) to 3 (nearly every day). The sum score (range 0 to 27) indicates the degree of depression with scores of ≥5, ≥10, and ≥15, representing mild, moderate, and severe levels of depression, respectively [40]. A score >10 defines the presence of depressive symptomatology [41]. Its sensitivity and specificity reaches 80% and 92%, respectively, [42] with a Cronbach’s alpha of 0.89 [40], and so the PHQ-9 shows good psychometric properties. In this study, the German version was applied [41].
Generalized anxiety was assessed with the Generalized Anxiety Disorder-7 (GAD-7), which measures anxiety symptoms for the two weeks prior to the time of the survey. Based on seven items on a Likert scale from 0 (not at all) to 3 (nearly every day), it can be used to determine the risk of GAD based on the DSM-IV criteria. The sum scale ranges from 0 to 21, and a higher total score reflects more severe symptoms of generalized anxiety disorder. A score of 10 and above is equivalent to a clinical diagnosis of GAD. A sensitivity of 0.89 with a specificity of 0.82 [43] and an internal consistency in the German population of alpha = 0.89 [44] prove good psychometric properties.
Qualitative stressors that are specific to the home care nursing context were measured against the BGW-miab (Berufsgenossenschaft für Gesundheitsdienst und Wohlfahrtspflege-Mitarbeiterbefragung. Those are: taking care of the same patients on a daily basis, the confrontation with suffering and death of patients, and caring for patients with dementia or other psychiatric illnesses. Response options range from 0 (“Not at all”) to 4 (“Yes, exactly”) [45]. The internal consistency is robust, with a Cronbach’s alpha = 0.75. For further analysis, each strain item is dichotomized in “existing” and “non-existing” [46].
The Copenhagen Psychosocial Questionnaire (COPSOQ) measures psychosocial factors and work strain across all occupational sectors. The German version of the COPSOQ contains 85 items comprised of 26 scales [47]. Since the COPSOQ’s scales can be queried individually in questionnaires, only three scales of interest were used: influence and freedom at work, relationships with your colleagues and your superiors, as well as one question whether one’s work is recognized and appreciated by the management [48]. The instrument shows robust scale reliability with Cronbach’s alpha between 0.58 and 0.92 [49]. All items are answered on a five-point Likert scale, each added by the item “I have no superior/no colleagues” that is treated as a missing value once ticked.
Discrimination at work was assessed with an adapted version of the “ALLBUS—Allgemeine Bevölkerungsumfrage der Sozialwissenschaften” survey [50]. This German General Social Survey collects recent data about attitudes, behavior, and social structure of the population in Germany. For the purpose of this study, nurses were asked about, for example, occupational discrimination in terms of payment, career progression, or application, as well as the possible reasons; the answer option was “yes” or “no”.
The collection of sociodemographic data (e.g., age, sex, marital status, children) was guided by the recommendations for epidemiological studies [51], as well as the study on Adult Health in Germany (DEGS) [52]. To assess the migration background, we applied the minimum indicator set for recording migration status [53]. Additionally, professional and educational level, income status, belonging to a religious community, and use and command of foreign languages were collated.

2.6. Analysis

The sample was divided into two groups: immigrant nurses and non-immigrant nurses. T-test was applied to analyze differences in interval scale variables and Chi-square tests to test differences in categorical scale variables. Since the latter test was applied repeatedly, the Bonferroni test was used for statistical significance. Hierarchical regression analyses were stepwise performed for each group to identify a possible impact of the above-mentioned secondary objectives affecting psychosocial distress as the primary objective (Figure 2). Missing data were handled with the expectation-maximization algorithm. Multicollinearity was not suspected, with all variance inflation factors (VIFs) being <2. Data analysis was carried out with SPSS 22.

3. Results

3.1. Sample Characteristics

More immigrant nurses were female compared to non-immigrant nurses, χ² (1) = 5.68, p = 0.017 (Table 1). Immigrant nurses were significantly younger than non-immigrant nurses, t (285) = −3.09, p = 0.002. Professional status differed significantly among both groups in terms of a higher proportion of registered general non-immigrant nurses versus a higher amount of lower qualified immigrant nursing assistants and trained nurses, χ² (4) = 16.22, p = 0.003. Significantly more immigrant nurses were married, while more non-immigrant nurses were divorced, χ² (5) = 16.22, p = 0.006. Non-immigrant nurses were employed in non-commercial operated services significantly more often, χ² (2) = 9.85, p = 0.007, while more immigrant nurses could not name what kind of service operator they work for. There was no significant difference between immigrant and non-immigrant nurses regarding weekly working time. There was a significant difference between both groups in terms of a higher proportion of immigrant nurses with fixed-term contracts, χ² (1) = 3.97, p = 0.046. Concerning German as a first language, the difference was significant within both groups, χ² (3) = 201.04, p = 0.

3.2. Basic Characteristics of the Primary and Secondary Objectives

Immigrant nurses perceived psychosocial distress to a higher (M = 5.65, SD = 2.17) but not significantly different extent than non-immigrant nurses (M = 5.57, SD = 2.45), with t (285) = 0.284, p = 0.777. (Table 2). There was no significant difference between immigrant (M = 8.43, SD = 4.76) and non-immigrant nurses (M = 8.20, SD = 4.87) regarding somatic symptom burden, t (285) = 0.388, p = 0.698. Concerning depressive symptomatology, immigrant nurses showed higher values (M = 6.86, SD = 5.31) compared to their non-immigrant counterparts (M = 6.67, SD = 5.35), while they did not significantly differ, t (285) = 0.295, p = 0.771.
There was no statistical difference concerning general anxiety between both groups, t (285) = 0.713, p = 0.477, even though immigrant nurses scored higher M = 5.83, SD = 4.80 compared to M = 5.41, SD = 4.66. Concerning influence and freedom at work, immigrant (M = 49.95, SD = 27.70) and non-immigrant nurses (M = 51.14, SD = 21.81) did not differ significantly, t (179) = −0.376, p = 0.707. Immigrant nurses scored higher on the item “relationships with colleagues and superior” (M = 67.53, SD = 25.03) than their colleagues (M = 62.76, SD = 24.04), but also significantly different, t (285) = 1.596, p = 0.111. Immigrant nurses were more likely to feel appreciated by the management (M = 64.67, SD = 27.88) than their non-immigrant colleagues (M = 57.34; SD = 30.55) with t (285) = 2.021, p = 0.044.

3.3. Distribution of Groups according to Cut-Off Criteria of the Primary and the Main Secondary Outcomes

At 52.4% and 52.7%, respectively, there was no significant difference regarding the number of immigrant and non-immigrant nurses under noticeable psychosocial distress, χ² (1) = 0.004, p = 0.952 (Table 3). A total of 27.6% of immigrant nurses reported a high symptomatic burden compared to 24.7% of their non-immigrant counterparts, while there was no significant difference between both groups χ² (1) = 0.291, p = 0.589.
A total of 21.9% of immigrant nurses and 21.4% of non-immigrant nurses showed a depressive symptomatology without a significant difference χ² (1) = 0.009, p = 0.925.
A total of 18.1% of immigrant nurses reported generalized anxiety compared to 15.4% of their non-immigrant colleagues but did not differ significantly from each other χ² (1) = 0.357, p = 0.550.
The 32.4% of immigrant and 31.3% of non-immigrant nurses reported having been discriminated at work within the last 24 months without a significant difference χ² (1) = 0.035, p = 0.852. Nearly 60% of the immigrant and non-immigrant nurses who reported discrimination felt discriminated in the context of payment, 21% concerning career advancement, and nearly 65% with respect to the distribution of responsibilities. A total of 77.8% of the immigrant nurses and 72% of the non-immigrant nurses could not specify the reason for the perceived discrimination. More than 10% of nurses in both groups felt discriminated due to their age, 15% of immigrant nurses due to their origin, ancestry, or skin color, and 14% of non-immigrant nurses due to their family responsibilities and 12% due to their sexual identity.
In the context of qualitative stressors that are typical in the homecare context, non-immigrant nurses (74.7%) felt more burdened by daily taking care of same patients than immigrant nurses (63.8%), but didn’t differ significantly χ² (1) = 3.832, p = 0.050. Significantly more immigrant (51.4%) than non-immigrant nurses (35.7%) reported feeling burdened by the confrontation with suffering and dying of patients in the daily care context, χ² (1) = 6.774, p = 0.009. More immigrant (65.7%) than non-immigrant nurses (56.1%) felt strained from caring for patients with dementia or other psychiatric disorders, though both groups did not significantly differ χ² (1) = 2.043, p = 0.153.

3.4. Predictors for Psychosocial Distress

Somatic burden most strongly predicted increased levels of psychosocial distress among immigrant nurses (β = 0.388, p = 0, R2 = 0.254), as well as non-immigrant nurses (β = 0.389, p = 0, R2 = 0.394) (Table 4). Age (β = 0.229, p = 0.002, R2 = 0.092) and full-time employment (β = 0.208, p = 0.009, R2 = 0.092) also predicted an increase of psychosocial distress among non-immigrant nurses, followed by working overtime (β = 0.163, p = 0.008, R2 = 0.394) and anxiety (β = 0.199, p = 0.008, R2 = 0.394).
On the other hand, shift work predicted decreased levels of psychosocial distress among non-immigrant nurses (β = −0.130, p = 0.043, R2 = 0.394).
Further significant predictors for increasing psychosocial distress among immigrant nurses were influence and freedom at work (β = 0.252, p = 0.036, R2 = 0.254) and being employed on a fixed-term basis (β = 0.214, p = 0.018, R2 = 0.254). A functioning relationship with colleagues and supervisors most strongly predicted a decrease in psychosocial distress (β = −0.287, p = 0.039, R2 = 0.254) among immigrant nurses.

4. Discussion

To our knowledge, this was the first study to raise the question of whether immigrant home care nurses are more stressed at work than their non-immigrant colleagues are, and to analyze potential factors, predicting the psychosocial distress of those nurses. We found no significant difference in the psychosocial health-related outcomes among immigrant and non-immigrant homecare nurses. Therefore, immigrant home care nurses in Germany seemed not to be more stressed than non-immigrant nurses. However, the level of stress was high in both groups, and influencing factors on stress differed in both groups to a certain extent.
The comparison of the data with the general population showed that the psychosocial health of this study’s nurses was affected to a high extent. With that said, 25% of this study’s nurses reported depressive symptomatology compared to 7% of the general population [25]. Depressive symptoms were more common among immigrants than non-immigrants in Germany, while less male immigrant nurses showed noticeable depressive symptomatology compared to 21% of their male non-immigrant counterparts under study [25].
Immigrant and non-immigrant nurses reported a lower extent of support by their colleagues and superiors but a higher influence and freedom at work compared to home care nurses, in general, in a similar study [54]. The nurses, in this present study, perceived that their work was being appreciated to a far lower extent than employees, in general, in Germany, while immigrant nurses felt more likely appreciated by their supervisors than do non-immigrant nurses [55].
About one-third of the nurses reported acts of discrimination at work regardless of their ethnic background. Between 2014 and 2015, nearly one-third of the German population reported having been discriminated against, and nearly 50% of those experienced discrimination at their workplace. Age, sexual identity, religion, and ethnic ancestry are the most frequent factors for discrimination [56]. Our data confirmed that age was a leading characteristic of discrimination regardless of ethnic origin, while ethnic origin was the leading discriminatory factor against immigrant nurses.
The extent of the qualitative stressors (BGWmiab) for homecare nurses’ in the present study confirmed the average extent of homecare nurses in Germany. However, in our study, immigrant nurses were more affected. Caring for patients with dementia or other psychiatric illnesses leads to a higher burden compared to nurses, in general, in Germany [57]. Immigrant nurses scored significantly higher than non-immigrant nurses regarding work appreciation by the management. Even though it is evident that experiences of appreciation have a positive effect on job satisfaction and job attitude [58], appreciation did not significantly predict any decrease in psychosocial distress.
More than half of this study’s migrant nurses felt burdened by the confrontation with suffering or dying of patients compared to about a third of non-immigrant nurses. The way how an individual deals with bereavement and grief is influenced by the norms of her or his cultural identity [59]. Cultural dominance and its association with loss and grief through generations can particularly affect migrant and minority people. Migration and acculturation are likely to influence cultural beliefs, world views, and common practices [60]. This may explain why dealing with suffering and dying patients is experienced to a higher extent as burdensome among migrants. However, this burden had a significant effect on psychosocial distress neither among migrant nor on non-immigrant nurses.
Somatic burden most strongly predicted increased levels of psychosocial distress among migrant nurses, as well as non-immigrant nurses. The negative impact of somatic burdens on psychosocial health but also the inverse relationship has been reported in various studies [61,62,63].
Older age was significantly related to psychosocial distress among non-immigrant nurses but not among immigrant nurses, whereas the relationship was negative but not significant. Various studies have reported that the correlation between age and psychosocial stress can either be positive [64,65,66] or negative [67,68,69]. Responsibilities, such as caring for family members or having financial liabilities, like paying off loans, explain higher levels of stress among younger people [64]. On the other hand, prolonged life expectancy can be related to facing more health-related stressors, thus leading to higher levels of perceived stress [70,71].
A functioning relationship with colleagues and supervisors most strongly predicted a decrease in psychosocial distress among immigrant nurses. The longer immigrant nurses were employed at their current employer, the more likely they were to report a positive relationship. Collegial solidarity has a positive effect on organizational commitment, teamwork, working climate, job satisfaction, and inter-hierarchical communication [72], while a good relationship between leaders and staff members promotes mental health and prevents stress [73]. Sharing commonalities, especially for those with a migration background [20,21], could explain this effect among immigrant nurses.
Shift work had a protective effect on the levels of psychosocial distress of non-immigrant nurses. This was inconsistent with most of the previous research, as shift work is connected with obesity, depression, and sleep disturbances [74,75]. However, West and colleagues argued that shift work allows nurses to be more flexible in terms of arranging personal and family duties but also taking care of their own mental hygiene in terms of doing sports and physical activities [76].
Surprisingly, but consistent with previous research in similar disciplines [73,77], a higher extent of influence and freedom at work led to higher levels of psychosocial distress among migrant nurses. Higher levels of qualification or being in a leadership position moderated this relationship. Immigrant nurses with lower qualifications reported a lower extent of influence, while immigrant nurses in leadership positions reported higher levels of influence.
Immigrant nurses felt distressed by fixed-term contractual employment relationships. Even though immigrant and non-immigrant nurses did not differ significantly from each other regarding the proportion of full- or part-time employment, this effect could be explained by societal influences. Immigrant care workers are overrepresented in fixed-term employment relationships [78,79]. The insecurity concerning not knowing how to set up one’s own future of that of their families can have a negative impact on satisfaction and lead to stress [80,81].
The high amount of homecare nurses suffering from somatic burdens, psychosocial distress, depressive symptomatology, and generalized anxiety requires action. Since homecare-nursing takes mostly place “on the move”, behavioral health promotion activities should be designed for the specific circumstances of this setting. There are plenty of lifestyle interventions aiming at improving nurses’ occupational health, which can either solely rely on educational approaches but also being implemented on an organizational level [82]. Most of the following interventions’ efficacy has been proven in randomized controlled trials. Worksite interventions like providing nurses a treadmill at work or Wii system, walking meetings, or health coaching via text messages [83] show a positive effect on nurses’ physical activity. Musculoskeletal complaints that often emerged from psychosocial stressors in the nursing context can be significantly reduced by a combination of coaching interventions, focusing on enabling better strategies for coping and physiotherapy [84]. Interventions that lead to a significant reduction of stress are based on mindfulness/meditation techniques [85], educational approaches like stress and coping behavior techniques [86], light therapy [87], or physical activities like yoga or walking. Depression and anxiety can be significantly reduced by the mindfulness‑based cognitive therapy [88] or education-based interventions [89] or relaxation methods (e.g., feet bath [90], music [90], music-based relaxation [91]).
In our study, nurses reported low levels of appreciation by supervisors and mutual support from colleagues. Toode et al. (2011) explained that these experiences negatively affected nurses’ job motivation and their ability to cope with stress and so they spoke for allowing nurses to exchange with colleagues and supervisors [92]. Additionally, Hunt (2007) stated that making an organization highly performing and its workforce effective, managers and supervisors are advised to value individuals regardless of their ethnic, racial, or cultural background [93].
Reports of discrimination require further actions like detabooing discrimination and all its forms. The nursing personnel must become aware of the severely negative effects of discrimination on the individual’s health, and supervisors have to become competent in evaluating situations as critical and then setting limits to get possible threats under control to the favor of their employees. Corresponding qualification measures are available [94].
We found no significant difference in the extent of psychosocial distress among immigrant and non-immigrant nurses. This could imply that there is no need for special lifestyle interventions for reducing stress and corresponding hazardous threats for each of both groups of nurses. Nevertheless, our data showed and confirmed previous research in that way that both groups differed in stressors and resources associated with distress [20,37]. More efforts are needed on interactional, as well as organizational level, to raise the nurses’, their supervisors’, as well as the clients’ awareness for respecting the individuality of nurses.
The focus of our study was on ambulatory care; however, nursing is not the only industry depending on migrant workers, e.g., agriculture [95]. Therefore, our results might be applicable to these industries as well.

Strengths and Limitations

Nurses who rate their own health as good might not have participated in this survey that strongly focuses on psychosocial burdens. The low response rate might have led to an overestimation of the symptoms. The group of non-immigrant nurses was overrepresented in our study, and this affected the accuracy of the comparison between both groups. These limitations mentioned it should still be kept in mind that a response rate of 25% is not unusual, and meaning conclusions can still be derived [96]. In future comparative studies, the lower response of immigrant nurses should be considered in the sampling approach by, e.g., oversampling. The documentation of the care process is an integral part of a nurse’s daily work, and the nurse is obliged to document client and care-related issues in the German language. Having said that, this might have led some migrant nurses with limited linguistic competence who were initially interested in participating in revoking their intention, and this could imply an underrepresentation of those nurses. Cross-sectional studies do not allow causal relationships, and thus, the measured outcomes in this study are merely associated with psychosocial distress. In this study, we collected health-related data from nurses working in the homecare sector in the federal state of Hamburg, Germany. While the sample was representative in terms of, e.g., qualification levels, gender, age, and migration background for this specific setting, the results did represent immigrant and non-immigrant nurses neither in Germany, in general, nor nurses in other care-related settings like stationary care. The sociodemographic data showed some significant differences among both groups of nurses under study (e.g., gender, civil status, operated by services, fixed-term contracts). The division of the sample into immigrant and non-immigrant nurses could have led to an underestimation of possible effects among the differences.
This study also has its distinct strengths: A proportional randomized stratified sampling approach had been applied to recruit nursing services in the different districts in Hamburg, which contributed to the representativity of this study’s sample. The applied scales for measuring outcomes related to psychosocial health were widely recognized in psychosomatic healthcare. This allowed an initial assessment of the extent of psychosocial stress and its corresponding factors among immigrant and non-immigrant nurses.

5. Conclusions

The extent of psychosocial distress experienced by immigrant and non-immigrant homecare nurses did not significantly differ. However, both groups reported far higher levels of psychosocial distress, depressive symptomatology, generalized anxiety, and somatic burdens than the German general population.
In the homecare sector, nurses were confronted with specific musculoskeletal stressors, such as moving and handling household objects, to gain access to patients in their domestic environment (e.g., non-height adjustable beds), or other typical homecare-related stressors, such as time pressure due to, e.g., traffic jams. Those factors could additionally affect the nurses’ somatic burdensome occupation.
Age was a significant predictor for increased psychosocial distress among non-immigrant nurses. In times of an aging society and nursing workforce, as well as increasing demand for adequate health- and nursing-care but decreasing numbers of qualified nurses, the healthcare system relied on their available and very well-trained nurses. Having said that, nursing managers or supervisors are advised to regularly check their nurses’ psychosocial stress levels to identify any change compared to the last examination. This could be beneficial to the retention of nurses within their home care service providers.
A higher level of influence and freedom at work was related to higher levels of psychosocial distress among immigrant nurses. Immigrant nurses in leadership positions, such as team leader, might benefit from more and continuous internal, as well as external managerial support and training. The negative effect of working overtime on the psychosocial health of non-immigrant nurses confirmed the current blatant lack of nurses.
In times of an increasingly diverse nursing workforce, those responsible in health and nursing care on a macro-, meso-, and micro level should carefully consider the individual explanatory model of psychosocial health of nurses with diverse ethnic and cultural backgrounds.

Author Contributions

Conceptualization, B.S., A.N., and M.M.; methodology, B.S. and M.M.; formal analysis, B.S.; investigation, B.S. and M.M.; data curation, B.S.; writing—original draft preparation, B.S.; writing—review and editing, B.S., A.N., and M.M.; supervision, M.M.; project administration, B.S. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the INSTITUTION FOR STATUTORY ACCIDENT INSURANCE AND PREVENTION IN THE HEALTH AND WELFARE SERVICES (BGW). Grant recipient was Dr. Mike Mösko. Home page: www.bgw-online.de. The funds are provided by a non-profit organization that is part of the social security system in Germany. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Conflicts of Interest

The authors declare that no conflict of interest exist that could affect the present study. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results

Ethical Approval

Ethical approval was obtained from the ethics commission of the Hamburg Medical Council (application “Antrag PV5440”) prior to the data collection phase. Ärztekammer Hamburg, Weidestraße 122 b, 22083 Hamburg.

References

  1. World Health Organization. Walk the Talk: The Health for All Challenge 2019. Available online: https://www.who.int/news-room/events/detail/2019/05/19/default-calendar/walk-the-talk-the-health-for-all-challenge-2019 (accessed on 28 October 2019).
  2. All-Party Parliamentary Group (APPG) on Global Health. Triple Impact. How Developing Nursing Will Improve Health, Promote Gender Equality and Support Economic Growth. Available online: https://www.who.int/hrh/com-heeg/digital-APPG_triple-impact.pdf (accessed on 12 September 2019).
  3. Nursing Now. Why Nursing Now? Available online: https://www.nursingnow.org/what-we-do/ (accessed on 12 September 2019).
  4. World Health Organization. Nursing and Midwifery. Key Facts. Available online: https://www.who.int/news-room/fact-sheets/detail/nursing-and-midwifery (accessed on 9 September 2019).
  5. Statistik der Bundesagentur für Arbeitrbeit. Berichte: Blickpunkt Arbeitsmarkt—Arbeitsmarktsituation im Pflegebereich. Available online: https://statistik.arbeitsagentur.de/Statischer-Content/Arbeitsmarktberichte/Berufe/generische-Publikationen/Altenpflege.pdf (accessed on 12 September 2019).
  6. Rothgang, H.; Müller, R.; Unger, R. Themenreport Pflege 2030: Was Ist zu Erwarten—Was Ist zu Tun? Bertelsmann Stiftung: Gütersloh. 2012. Available online: http://www.bertelsmann-stif-tung.de/fileadmin/files/BSt/Publikationen/GrauePublikatio-nen/GP_Themenreport_Pflege_2030.pdf (accessed on 12 September 2019).
  7. Gomes, B.; Calanzani, N.; Curiale, V.; McCrone, P.; Higginson, I.J. Effectiveness and cost-effectiveness of home palliative care services for adults with advanced illness and their caregivers. Cochrane Database Syst. Rev. 2013, 6. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Mestheneos, E. Aging in Place in the European Union. International Federation on Ageing. Glob. Ageing Issues Action 2011, 7, 7. Available online: https://www.ifa-fiv.org/wp-content/uploads/global-ageing/7.2/7.2.full.pdf (accessed on 12 September 2019).
  9. Shepperd, S.; Goncalves-Bradley, D.C.; Straus, S.E.; Wee, B. Hospital at home: Home-based end-of-life care. Cochrane Database Syst. Rev. 2016, 2. [Google Scholar] [CrossRef] [PubMed]
  10. TNS Opinion & Social. Health and Long-Term Care in the European Union. Special Eurobarometer 283/Wave 67.3. Available online: http://ec.europa.eu/commfrontoffice/publicopinion/archives/ebs/ebs_283_en.pdf (accessed on 12 September 2019).
  11. Social Code Book 11. § 3 Vorrang der Häuslichen Pflege. Priority of Home Care Act. Elftes Buch Soziale Pflegeversicherung. Book XI, Social Care. Version. 6.5.2019, I 646. Gesetze im Internet, Ministry of Justice—Bundesministerium der Justiz, Germany. Available online: https://www.gesetze-im-internet.de/sgb_11/__3.html (accessed on 12 September 2019).
  12. Statistisches Bundesamt. Migration und Integration. Bevölkerung in Privathaushalten nach Migrationshintergrund und Altersgruppen. Available online: https://www.destatis.de/DE/Themen/Gesellschaft-Umwelt/Bevoelkerung/Migration-Integration/Tabellen/migrationshintergrund-alter.html (accessed on 13 September 2019).
  13. Thum, M.; Delkic, E.; Kemnitz, A.; Kluge, J.; Marquardt, G.; Motzek, T.; Nagl, W.; Zwerschke, P. Auswirkungen des Demografischen Wandels im Einwanderungsland Deutschland. Studie im Auftrag der Abteilung Wirtschafts- und Sozialpolitik der Friedrich-Ebert-Stiftung. Available online: https://library.fes.de/pdf-files/wiso/11612.pdf (accessed on 13 September 2019).
  14. Kozak, A. Muskel-Skelett-Erkrankungen und Beschwerden bei Beschäftigten in Gesundheits- und Pflegeberufen: Kumulative Dissertation zu Häufigkeiten, Risiken und Interventionsmöglichkeiten; Universitätsklinikum Hamburg Eppendorf: Hamburg, Germany, 2017. [Google Scholar]
  15. Harling, M. Der Bedarf an Prävention und Gesundheitsförderungsmaßnahmen bei Beschäftigten in Pflegeberufen. Validierung der Nurse-Work Instability Scale, 4th ed.; Tredition GmbH: Hamburg, Germany, 2014. [Google Scholar]
  16. Freitag, S. The Impact of Stressful Postures on the Physical Workload in Nursing; KTH Royal Institute of Technology: Stockholm, Sweden, 2014. [Google Scholar]
  17. Braun, B.; Müller, R.; Timm, A. Gesundheitliche Belastungen, Arbeitsbedingungen und Erwerbsbiographien von Pflegekräften im Krankenhaus. Eine Untersuchung vor dem Hintergrund der DRG-Einführung. Available online: http://www.barmer-gek.de/barmer/web/Portale/Presseportal/Subportal/Infothek/Studien-und-Reports/GEK-Schriftenreihe-Gesundheitsanalyse/Berufsleben-Gesundheit/PDF-Pflegekraefte-im-Krankenhaus-32,property=Data.pdf (accessed on 13 September 2019).
  18. Braun, B.; Müller, R. Arbeitsbelastungen und Berufsausstieg bei Krankenschwestern. Pflege Ges. 2005, 3, 131–144. Available online: https://dg-pflegewissenschaft.de/wp-content/uploads/2017/06/PG-3-2005-Braun.pdf (accessed on 16 September 2019).
  19. Szeto, G.P.Y.; Wong, K.T.; Law, K.Y.; Lee, E.W.C. A study of spinal kinematics in community nurses performing nursing tasks. Int. J. Ind. Ergon. 2013, 43, 203–209. [Google Scholar] [CrossRef]
  20. Schilgen, B.; Handtke, O.; Nienhaus, A.; Mösko, M. Work-related barriers and resources of migrant and autochthonous homecare nurses in Germany: A qualitative comparative study. Appl. Nurs. Res. 2019, 46, 57–66. [Google Scholar] [CrossRef]
  21. Schilgen, B.; Nienhaus, A.; Handtke, O.; Schulz, H.; Mösko, M. Health situation of migrant and minority nurses: A systematic review. PLoS ONE 2017, 12. [Google Scholar] [CrossRef] [Green Version]
  22. Shields, M.A.; Price, S.W. Racial harassment, job satisfaction and intentions to quit: Evidence from the British nursing profession. Economica 2002, 69, 31. [Google Scholar] [CrossRef] [Green Version]
  23. Razum, O.; Zeeb, H.; Meesmann, U.; Schenk, L.; Bredehorst, M.; Brzoska, P.; Dercks, T.; Glodny, S.; Menkhaus, B.; Salaman, R.; et al. Migration und Gesundheit. Schwerpunktbericht der Gesundheitsberichterstattung des Bundes. Available online: https://www.gbe-bund.de/pdf/migration.pdf (accessed on 16 September 2019).
  24. Klaus, D.; Baykara-Krumme, H. Die Lebenssituationen von Personen in der zweiten Lebenshälfte mit und ohne Migrationshintergrund. In Altern im Wandel: Zwei Jahrzehnte Deutscher Alterssurvey (DEAS); Mahne, K., Ed.; Deutsches Zentrum für Altersfragen (DZA): Berlin, Germany, 2016. [Google Scholar]
  25. Rommel, A.; Saß, A.C.; Born, S.; Ellert, U. Die gesundheitliche Lage von Menschen mit Migrationshintergrund und die Bedeutung des sozioökonomischen Status. Erste Ergebnisse der Studie zur Gesundheit Erwachsener in Deutschland (DEGS1). Bundesgesundheitsblatt 2015, 58, 10. [Google Scholar]
  26. Bamberg, E.; Keller, M.; Wohlert, C.; Zeh, A. BGW-Stresskonzept. Das arbeitspsychologische Stressmodell. 2006 Berufsgenossenschaft für Gesundheitsdienst und Wohlfahrtspflege (BGW). Available online: https://www.bgw-online.de/SharedDocs/Downloads/DE/Medientypen/Wissenschaft-Forschung/BGW08-00-000_Stresskonzept_Das_arbeitspsychologische_Stressmodell_Download.pdf?__blob=publicationFile (accessed on 25 February 2020).
  27. Goh, Y.W.; Sawang, S.; Oei, T.P.S. The Revised Transactional Model (RTM) of Occupational Stress and Coping: An Improved Process Approach. Aust. N. Z. J. Organ. Psychol. 2012, 3, 13–20. [Google Scholar] [CrossRef] [Green Version]
  28. Lazarus, R.S.; Folkman, S. Stress, Appraisal, and Coping; Springer Publishing Company, Inc.: New York, NY, USA, 1984. [Google Scholar]
  29. Brooks Carthon, J.M.; Nguyen, T.-H.; Chittams, J.; Park, E.; Guevara, J. Measuring success: Results from a national survey of recruitment and retention initiatives in the nursing workforce. Nurs. Outlook 2014, 62, 259–267. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Cohen, J.; Stuenkel, D.; Nguyen, Q. Providing a Healthy Work Environment for Nurses: The Influence on Retention. J. Nurs. Care Qual. 2009, 24, 308–315. [Google Scholar] [CrossRef] [PubMed]
  31. Statistikamt Nord. Bevölkerung mit Migrationshintergrund in den Hamburger Stadtteilen Ende 2017. Available online: https://www.statistik-nord.de/zahlen-fakten/hamburger-melderegister/dokumentenansicht/bevoelkerung-mit-migrationshintergrund-in-den-hamburger-stadtteilen-ende-2017-60606/ (accessed on 1 October 2019).
  32. Schilgen, B.; Savcenko, K.; Nienhaus, A.; Mösko, M. Arbeitsplatzbezogene Belastungen und Ressourcen von ausländischen 24-Stunden-Betreuungskräften in deutschen Privathaushalten—Eine qualitative Studie. Gesundheitswesen 2020, 82, 196–201. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Statistikamt Nord. Personal der Ambulanten Pflegedienste in Hamburg 2017. Available online: https://www.statistik-nord.de/zahlen-fakten/gesundheit-pflege/pflege/dokumentenansicht/personal-der-ambulanten-pflegedienste-in-hamburg-2017-61024/ (accessed on 1 October 2019).
  34. Bundesagentur für Arbeit. Arbeitsmarktberichterstattung. Arbeitsmarktsituation im Pflegebereich. Available online: https://statistik.arbeitsagentur.de/Statischer-Content/Arbeitsmarktberichte/Berufe/generische-Publikationen/Altenpflege.pdf (accessed on 1 October 2019).
  35. Mehnert, A.; Müller, D.; Lehmann, C.; Koch, U. Die deutsche Version des NCCN Distress Thermometers. Empirische Prüfung eines Screening-Instruments zur Erfassung psychosozialer Belastung bei Krebspatienten. Z. Psychiatr. Psychol. Psychother. 2006, 54, 213–223. [Google Scholar] [CrossRef]
  36. The National Comprehensive Cancer Network® (NCCN®). NCCN Distress Thermometer and Problem List. Version 2.2018, 02/23. Available online: https://www.nccn.org/patients/resources/life_with_cancer/pdf/nccn_distress_thermometer.pdf32 (accessed on 18 February 2020).
  37. Ulusoy, N.; Wirth, T.; Lincke, H.J.; Nienhaus, A.; Schablon, A. Psychosoziale Belastungen und Beanspruchungen in der Altenpflege: Vergleich zwischen Pflegekräften mit und ohne Migrationshintergrund. Z. Gerontol. Geriatr. 2019, 52, 589–597. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Dingoyan, D.; Schulz, H.; Mösko, M. The willingness to participate in health research studies of individuals with Turkish migration backgrounds: Barriers and resources. Eur. Psychiatr. 2012, 27, S4–S9. [Google Scholar] [CrossRef]
  39. Gierk, B.; Kohlmann, S.; Kroenke, K.; Spangenberg, L.; Zenger, M.; Brähler, E.; Löwe, B. The Somatic Symptom Scale–8 (SSS-8): A Brief Measure of Somatic Symptom Burden. JAMA Intern. Med. 2014, 174, 399–407. [Google Scholar] [CrossRef] [Green Version]
  40. Kroenke, K.; Spitzer, R.L.; Williams, J.B. The PHQ-9: Validity of a brief depression severity measure. J. Gen. Intern. Med. 2001, 16, 606–613. [Google Scholar] [CrossRef]
  41. Löwe, B.; Kroenke, K.; Herzog, W.; Grafe, K. Measuring depression outcome with a brief self-report instrument: Sensitivity to change of the Patient Health Questionnaire (PHQ-9). J. Affect. Disord. 2004, 81, 61–66. [Google Scholar] [CrossRef]
  42. Gilbody, S.; Richards, D.; Brealey, S.; Hewitt, C. Screening for depression in medical settings with the Patient Health Questionnaire (PHQ): A diagnostic meta-analysis. J. Gen. Intern. Med. 2007, 22, 1596–1602. [Google Scholar] [CrossRef] [Green Version]
  43. Wild, B.; Eckl, A.; Herzog, W.; Niehoff, D.; Lechner, S.; Maatouk, I.; Schellberg, D.; Brenner, H.; Muller, H.; Löwe, B. Assessing generalized anxiety disorder in elderly people using the GAD-7 and GAD-2 scales: Results of a validation study. Am. J. Geriatr. Psychiatr. 2014, 22, 1029–1038. [Google Scholar] [CrossRef] [PubMed]
  44. Löwe, B.; Decker, O.; Muller, S.; Brahler, E.; Schellberg, D.; Herzog, W.; Herzberg, P.Y. Validation and standardization of the Generalized Anxiety Disorder Screener (GAD-7) in the general population. Med. Care 2008, 46, 266–274. [Google Scholar] [CrossRef] [PubMed]
  45. Berufsgenossenschaft für Gesundheitsdienst und Wohlfahrtspflege (BGW). Psychische Belastung und Beanspruchung. BGW Personalbefragung für die Altenpflege, Krankenpflege und Behindertenhilfe. Available online: https://www.bgw-online.de/SharedDocs/Downloads/DE/Medientypen/BGW%20Broschueren/BGW08-00-110_Mitarbeiterbefragung_Download.pdf;jsessionid=5154984A76225AFA45ACA7852AE3EFB2?__blob=publicationFile (accessed on 2 October 2019).
  46. Nickel, S.; Kersten, M. Psychometrische Prüfung des Fragebogens zur Psychischen Belastung in der Stationären Altenpflege (“miab”). Available online: https://www.bgw-online.de/DE/Arbeitssicherheit-Gesundheitsschutz/Grundlagen-Forschung/GPR-Medientypen/Downloads/BGW08-00-114-Bericht-miab-stat-Altenpflege_Download.pdf?__blob=publicationFile (accessed on 3 October 2019).
  47. Freiburger Forschungsstelle für Arbeitswissenschaften. Ausgangspunkt: Belastungen und Beanspruchungen bei der Arbeit. Available online: https://www.copsoq.de/was-ist-copsoq/inhalt-des-copsoq/ (accessed on 4 October 2019).
  48. Freiburger Forschungsstelle für Arbeitswissenschaften. Survey on Psychosocial Factors in the Workplace. Available online: https://www.copsoq.de/assets/Uploads/German-version-COPSOQ-en-download.pdf (accessed on 4 October 2019).
  49. Nübling, M.; Stößel, U.; Hasselhorn, H.-M.; Michaelis, M.; Hofmann, F. Methoden zur Erfassung psychischer Belastungen. Erprobung eines Messinstrumentes (COPSOQ). Schriftenreihe Bundesanstalt Arbeitsschutz Arbeitsmedizin 2005, 2, 2014. Available online: https://www.copsoq.de/assets/pdf/BUCH-coposq-dt-baua-2005-Fb1058.pdf (accessed on 4 October 2019).
  50. GESIS—Leibnitz Institute for the Social Sciences. ALLBUS—Allgemeine Bevölkerungsumfrage der Sozialwissenschaften. Available online: https://www.gesis.org/allbus/allbus (accessed on 4 October 2019).
  51. Jöckel, C.; Babitsch, K.H.; Bellach, B.; Bloomfield, B.M.; Hoffmeyer-Zlotnik, K.; Winkler, J.; Wolf, C. Messung und Quantifizierung soziodemographischer Merkmale in epidemiologischen Studien. In RKI-Schriften 1/1998. Messung Soziodemographischer Merkmale in der Epidemiologie; Ahrens, W., Bellach, B.-M., Jöckel, K.-H., Eds.; MMV Medizin: München, Germany, 1998; pp. 7–38. [Google Scholar]
  52. Gosswald, A.; Lange, M.; Kamtsiuris, P.; Kurth, B.M. DEGS: German Health Interview and Examination Survey for Adults. A nationwide cross-sectional and longitudinal study within the framework of health monitoring conducted by the Robert Koch Institute. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz 2012, 55, 775–780. [Google Scholar] [CrossRef] [PubMed]
  53. Schenk, L.; Bau, A.M.; Borde, T.; Butler, J.; Lampert, T.; Neuhauser, H.; Razum, O.; Weilandt, C. A basic set of indicators for mapping migrant status. Recommendations for epidemiological practice. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz 2006, 49, 853–860. [Google Scholar] [CrossRef]
  54. Gregersen, S.; Dulon, M.; Nienhaus, A.; Nübling, M. Psychosoziale Arbeitsbelastungen in der Pflege—Vergleich verschiedener Pflegegruppen mit anderen Berufsgruppen. In Gefährdungsprofile. Unfälle und Arbeitsbedingte Erkrankungen in Gesundheitsdienst und Wohlfahrtspflege, 2nd ed.; Nienhaus, A., Ed.; Ecomed MEDIZIN: Landsberg am Lech, Germany, 2010; Volume 2, pp. 113–128. [Google Scholar]
  55. Nübling, M.; Lincke, H.-J.; Schröder, H.; Knerr, P.; Gerlach, I.; Laß, I. Gewünschte und erlebte Arbeitsqualität. Abschlussbericht der repräsentativen Befragung im Auftrag des Bundesministeriums für Arbeit und Soziales (BMAS). Available online: https://www.bmas.de/DE/Service/Medien/Publikationen/Forschungsberichte/Forschungsberichte-Arbeitsmarkt/forschungsbericht-fb-456.html (accessed on 25 October 2019).
  56. Beigang, S.; Fetz, K.; Kalkum, D.; Otto, M. Diskriminierungserfahrungen in Deutschland. Ergebnisse einer Repräsentativ- und einer Betroffenenbefragung. Available online: http://www.antidiskriminierungsstelle.de/SharedDocs/Downloads/DE/publikationen/Expertisen/Expertise_Diskriminierungserfahrungen_in_Deutschland.pdf?__blob=publicationFile&v=4 (accessed on 26 October 2019).
  57. Leimer, D.; Gerisch, S.; Sondermann, D. Pflege Bewegt. Ein Arbeitsfähigkeitsmodell zur Belastungsreduzierung in der Altenpflege. Ergebnisbericht. Analysen-Maßnahmen-Evaluierung im Zeitraum 2011 bis 2014. Available online: https://www.bagfw-esf.de/fileadmin/user_upload/ESF/Projekte_FB_2/5_P_174_Ergebnisbericht.pdf (accessed on 26 October 2019).
  58. Elfering, A.; Gerhardt, C.; Grebner, S.; Müller, U. Exploring Supervisor-Related Job Resources as Mediators between Supervisor Conflict and Job Attitudes in Hospital Employees. Saf. Health Work 2017, 8, 19–28. [Google Scholar] [CrossRef] [Green Version]
  59. Smid, G.E.; Groen, S.; de la Rie, S.M.; Kooper, S.; Boelen, P.A. Toward Cultural Assessment of Grief and Grief-Related Psychopathology. Psychiatr. Serv. 2018, 69, 1050–1052. [Google Scholar] [CrossRef]
  60. Bhugra, D. Cultural identities and cultural congruency: A new model for evaluating mental distress in immigrants. Acta Psychiatr. Scand. 2005, 111, 84–93. [Google Scholar] [CrossRef]
  61. Freimann, T.; Pääsuke, M.; Merisalu, E. Work-Related Psychosocial Factors and Mental Health Problems Associated with Musculoskeletal Pain in Nurses: A Cross-Sectional Study. Pain Res. Manag. 2016, 2016, 9361016. [Google Scholar] [CrossRef] [Green Version]
  62. Gierk, B.; Kohlmann, S.; Hagemann-Goebel, M.; Löwe, B.; Nestoriuc, Y. Monitoring somatic symptoms in patients with mental disorders: Sensitivity to change and minimal clinically important difference of the Somatic Symptom Scale—8 (SSS-8). Gen. Hosp. Psychiatr. 2017, 48, 51–55. [Google Scholar] [CrossRef]
  63. Kuby, A.K.; Lowe, B.; Fabisch, A.B.; Piontek, K.; Harter, M.; Konig, H.H.; Shedden-Mora, M.C. Predictors of Seeking Psychotherapy in Primary Care Patients with High Somatic Symptom Burden. Behav. Med. 2019, 45, 231–239. [Google Scholar] [CrossRef] [PubMed]
  64. O’Hea, E.L.; Monahan, B.R.; Cutillo, A.; Person, S.D.; Grissom, G.; Boudreaux, E.D. Predictors of psychological distress and interest in mental health services in individuals with cancer. J. Health Psychol. 2016, 21, 1145–1156. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  65. Scott, S.B.; Jackson, B.R.; Bergeman, C.S. What contributes to perceived stress in later life? A recursive partitioning approach. Psychol. Aging 2011, 26, 830–843. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  66. Diehl, M.; Hay, E.L. Risk and resilience factors in coping with daily stress in adulthood: The role of age, self-concept incoherence, and personal control. Dev. Psychol. 2010, 46, 1132–1146. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  67. Cohen, S.; Janicki-Deverts, D. Who’s Stressed? Distributions of Psychological Stress in the United States in Probability Samples from 1983, 2006, and 20091. J. Appl. Soc. Psychol. 2012, 42, 1320–1334. [Google Scholar] [CrossRef]
  68. Hughes, R.B.; Taylor, H.B.; Robinson-Whelen, S.; Nosek, M.A. Stress and women with physical disabilities: Identifying correlates. Women Health Issues 2005, 15, 14–20. [Google Scholar] [CrossRef]
  69. Stone, A.A.; Schwartz, J.E.; Broderick, J.E.; Deaton, A. A snapshot of the age distribution of psychological well-being in the United States. Proc. Natl. Acad. Sci. USA 2010, 107, 9985–9990. [Google Scholar] [CrossRef] [Green Version]
  70. Marengoni, A.; Angleman, S.; Melis, R.; Mangialasche, F.; Karp, A.; Garmen, A.; Meinow, B.; Fratiglioni, L. Aging with multimorbidity: A systematic review of the literature. Ageing Res. Rev. 2011, 10, 430–439. [Google Scholar] [CrossRef]
  71. Osmanovic-Thunström, A.; Mossello, E.; Åkerstedt, T.; Fratiglioni, L.; Wang, H.-X. Do levels of perceived stress increase with increasing age after age 65? A population-based study. Age Ageing 2015, 44, 828–834. [Google Scholar] [CrossRef] [Green Version]
  72. Kilic, E.; Altuntas, S. The effect of collegial solidarity among nurses on the organizational climate. Int. Nurs. Rev. 2019, 66, 356–365. [Google Scholar] [CrossRef]
  73. Stuber, F.; Seifried-Dubon, T.; Rieger, M.A.; Zipfel, S.; Gundel, H.; Junne, F. Investigating the Role of Stress-Preventive Leadership in the Workplace Hospital: The Cross-Sectional Determination of Relational Quality by Transformational Leadership. Front. Psychiatr. 2019, 10, 622. [Google Scholar] [CrossRef] [PubMed]
  74. Wyse, C.A.; Celis Morales, C.A.; Graham, N.; Fan, Y.; Ward, J.; Curtis, A.M.; Mackay, D.; Smith, D.J.; Bailey, M.E.S.; Biello, S.; et al. Adverse metabolic and mental health outcomes associated with shiftwork in a population-based study of 277,168 workers in UK. Ann. Med. 2017, 49, 411–420. [Google Scholar] [CrossRef] [PubMed]
  75. Caruso, C.C. Negative impacts of shiftwork and long work hours. Rehabil. Nurs. 2014, 39, 16–25. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  76. West, S.; Mapedzahama, V.; Ahern, M.; Rudge, T. Rethinking shiftwork: Mid-life nurses making it work! Nurs. Inq. 2012, 19, 177–187. [Google Scholar] [CrossRef]
  77. Skakon, J.; Kristensen, T.S.; Christensen, K.B.; Lund, T.; Labriola, M. Do managers experience more stress than employees? Results from the Intervention Project on Absence and Well-being (IPAW) study among Danish managers and their employees. Work 2011, 38, 103–109. [Google Scholar] [CrossRef]
  78. Lamura, G.; Chiatti, C.; Barbabella, F.; Di Rosa, M. Filling the Gap in Long-Term Professional Care through Systematic Migration Policies. Synthesis Report. Available online: http://ec.europa.eu/social/main.jsp?catId=1024&langId=en (accessed on 27 October 2019).
  79. Organisation for Economic Cooperation and Development (OECD). International Migration Outlook 2009. SOPEMI 2009. Special Focus: Managing Labour Migration beyond the Crisis. Available online: http://dx.doi.org/10.1787/migr_outlook-2009-en (accessed on 27 October 2019).
  80. Helbling, L.; Kanji, S. Job Insecurity: Differential Effects of Subjective and Objective Measures on Life Satisfaction Trajectories of Workers Aged 27–30 in Germany. Soc. Indic. Res. 2018, 137, 1145–1162. [Google Scholar] [CrossRef] [Green Version]
  81. Vahle-Hinz, T. Stress in nonregular work arrangements: A longitudinal study of task- and employment-related aspects of stress. J. Occup. Health Psychol. 2016, 21, 415–431. [Google Scholar] [CrossRef]
  82. Stanulewicz, N.; Knox, E.; Narayanasamy, M.; Shivji, N.; Khunti, K.; Blake, H. Effectiveness of Lifestyle Health Promotion Interventions for Nurses: A Systematic Review. Int. J. Environ. Res. Public Health 2019, 17, 17. [Google Scholar] [CrossRef] [Green Version]
  83. Tucker, S.; Farrington, M.; Lanningham-Foster, L.M.; Clark, M.K.; Dawson, C.; Quinn, G.J.; Laffoon, T.; Perkhounkova, Y. Worksite Physical Activity Intervention for Ambulatory Clinic Nursing Staff. Workplace Health Saf. 2016, 64, 313–325. [Google Scholar] [CrossRef]
  84. Becker, A.; Angerer, P.; Müller, A. The prevention of musculoskeletal complaints: A randomized controlled trial on additional effects of a work-related psychosocial coaching intervention compared to physiotherapy alone. Int. Arch. Occup. Environ. Health 2017, 90, 357–371. [Google Scholar] [CrossRef]
  85. Pipe, T.B.; Bortz, J.J.; Dueck, A.; Pendergast, D.; Buchda, V.; Summers, J. Nurse Leader Mindfulness Meditation Program for Stress Management: A Randomized Controlled Trial. JONA J. Nurs. Adm. 2009, 39, 130–137. [Google Scholar] [CrossRef] [PubMed]
  86. Hersch, R.K.; Cook, R.F.; Deitz, D.K.; Kaplan, S.; Hughes, D.; Friesen, M.A.; Vezina, M. Reducing nurses’ stress: A randomized controlled trial of a web-based stress management program for nurses. Appl. Nurs. Res. 2016, 32, 18–25. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  87. Leppämäki, S.; Partonen, T.; Piiroinen, P.; Haukka, J.; Lönnqvist, J. Timed bright-light exposure and complaints related to shift work among women. Scand. J. Work Environ. Health 2003, 29, 22–26. [Google Scholar] [CrossRef]
  88. Lan, H.K.; Subramanian, P.; Rahmat, N.; Kar, P.C. The effects of mindfulness training program on reducing stress and promoting well-being among nurses in critical care units. Aust. J. Adv. Nurs. 2014, 31, 22–31. [Google Scholar]
  89. Pipe, T.B.; Buchda, V.L.; Launder, S.; Hudak, B.; Hulvey, L.; Karns, K.E.; Pendergast, D. Building Personal and Professional Resources of Resilience and Agility in the Healthcare Workplace. Stress Health 2012, 28, 11–22. [Google Scholar] [CrossRef] [PubMed]
  90. Onishi, K.; Tsujikawa, M.; Inoue, K.; Yoshida, K.; Goto, S. The effect of complementary therapy for hospital nurses with high stress. Asia-Pac. J. Oncol. Nurs. 2016, 3, 272–280. [Google Scholar] [CrossRef]
  91. Ploukou, S.; Panagopoulou, E. Playing music improves well-being of oncology nurses. Appl. Nurs. Res. 2018, 39, 77–80. [Google Scholar] [CrossRef]
  92. Toode, K.; Routasalo, P.; Suominen, T. Work motivation of nurses: A literature review. Int. J. Nurs. Stud. 2011, 48, 246–257. [Google Scholar] [CrossRef]
  93. Hunt, B. Managing equality and cultural diversity in the health workforce. J. Clin. Nurs. 2007, 16, 2252–2259. [Google Scholar] [CrossRef]
  94. Nienhaus, A.; Drechsel-Schlund, C.; Schambortski, H.; Schablon, A. Gewalt und Diskriminierung am Arbeitsplatz. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz 2016, 59, 88–97. [Google Scholar] [CrossRef] [Green Version]
  95. Caffaro, F.; Bagagiolo, G.; Micheletti Cremasco, M.; Cavallo, E. Participatory Ergonomic Design of a Safety Training Tool for Migrant Workers in Agriculture. Chem. Eng. Trans. 2017, 58, 25–30. [Google Scholar] [CrossRef]
  96. Haber, N.; Fargnoli, M.; Sakao, T. Integrating QFD for product-service systems with the Kano model and fuzzy AHP. Total Qual. Manag. Bus. Excell. 2018, 1–26. [Google Scholar] [CrossRef]
Figure 1. A theoretical framework for the study.
Figure 1. A theoretical framework for the study.
Ijerph 17 01635 g001
Figure 2. Flow chart of analysis. SSS-8: Somatic Symptom Scale, PHQ-9: Patient Health Questionnaire, GAD-7: Generalized Anxiety Disorder, BGW-miab: Berufsgenossenschaft für Gesundheitsdienst und Wohlfahrtspflege – Mitarbeiterbefragung, COPSOQ: Copenhagen Psychosocial Questionnaire, ALLBUS: Allgemeine Bevölkerungsumfrage der Sozialwissenschaften, DEGS: Study on Adult Health in Germany (Studie zur Gesundheit Erwachsener in Deutschland), NCCN: National Comprehensive Cancer Network Distress Thermometer.
Figure 2. Flow chart of analysis. SSS-8: Somatic Symptom Scale, PHQ-9: Patient Health Questionnaire, GAD-7: Generalized Anxiety Disorder, BGW-miab: Berufsgenossenschaft für Gesundheitsdienst und Wohlfahrtspflege – Mitarbeiterbefragung, COPSOQ: Copenhagen Psychosocial Questionnaire, ALLBUS: Allgemeine Bevölkerungsumfrage der Sozialwissenschaften, DEGS: Study on Adult Health in Germany (Studie zur Gesundheit Erwachsener in Deutschland), NCCN: National Comprehensive Cancer Network Distress Thermometer.
Ijerph 17 01635 g002
Table 1. Sociodemographic data of the total sample.
Table 1. Sociodemographic data of the total sample.
Immigrant NursesNon-Immigrant Nurses
TotalN = 105N = 182
Gender
Female *85.773.6
Age
Mean (SD)43.7 (11.84)48.11 (11.37)
Professional status
Registered general nurse *26.741.8
Nursing assistant *10.54.4
Geriatric nurse31.435.7
Nursing auxiliary18.113.2
Semi-skilled *13.34.9
Civil status
Single24.822.5
Married *54.335.2
In cohabitation8.616.5
Separated1.94.4
Divorced *8.620.3
Widowed1.91.1
Operated by services
Private-commercial59.059.9
Non-commercial *12.424.2
Don’t know *28.615.9
Weekly working time
Full time (>35 h)41.943.4
Part-time (15–35 h)49.549.5
Part-time (<15 h)4.85.5
Other3.81.6
Type of contract
Permanent contract80.087.4
Fixed-term contract *20.012.6
First language
German *19.098.9
German + other *23.81.1
Other *49.50
More than two other *7.60
Data is % or Mean (SD), * p < 0.05.
Table 2. Comparison between immigrant and non-immigrant nurses regarding mean scale values.
Table 2. Comparison between immigrant and non-immigrant nurses regarding mean scale values.
Migrant NursesNon-Immigrant NursestdfP
NCCN5.65 ± 2.175.57 ± 2.450.2842850.777
SSS-88.43 ± 4.768.20 ± 4.870.3882850.698
PHQ-96.86 ± 5.316.67 ± 5.350.2922850.771
GAD-75.83 ± 4.805.41 ± 4.660.7132850.477
COPSOQ
Influence and freedom at work49.95 ± 27.7051.14 ± 21.81−0.3761790.707
Relationship with colleagues and superior67.53 ± 25.0362.76 ± 24.041.5962850.111
Work appreciated by the management64.67 ± 27.8857.34 ± 30.552,0212850.044 *
Comparison between two group means: t-test, * p < 0.05, Data is Means, NCCN: National Comprehensive Cancer Network Distress Thermometer, SSS-8: Somatic Symptom Scale, PHQ-9: Patient Health Questionnaire, GAD-7: Generalized anxiety disorder, COPSOQ: Copenhagen Psychosocial Questionnaire, df: Degree of Freedom.
Table 3. Comparison between immigrant and non-immigrant nurses: the proportion of nurses meeting the cut-off criteria.
Table 3. Comparison between immigrant and non-immigrant nurses: the proportion of nurses meeting the cut-off criteria.
Immigrant NursesNon-Immigrant Nursesχ²dfSig.φ
NCCN52.452.70.00410.9520.952
SSS-827.624.70.29110.5890.589
PHQ-921.921.40.00910.9250.925
GAD-718.115.40.35710.5500.550
ALLBUS32.431.30.03510.8520.852
BGW-miab
Daily taking care of the same patients63.874.73.83210.0500.050
Confrontation with suffering and dying of patients51.435.76.77410.009 **0.009
Caring for patients with dementia or other psychic diseases65.756.12.04310.1530.153
Comparison between two groups: Chi-Square test, ** p < 0.01, Data is %, NCCN: National Comprehensive Cancer Network Distress Thermometer, SSS-8: Somatic Symptom Scale, PHQ-9: Patient Health Questionnaire, GAD-7: Generalized anxiety disorder, ALLBUS: Allgemeine Bevölkerungsumfrage der Sozialwissenschaften, BGW-miab: Berufsgenossenschaft für Gesundheitsdienst und Wohlfahrtspflege - Mitarbeiterbefragung.
Table 4. Predictors for psychosocial distress.
Table 4. Predictors for psychosocial distress.
Immigrant Nurses (N = 105)Non-immigrant Nurses (N = 182)
tβtβtβtβtβtβ
Step 1
Age−0.339−0.034−0.111−0.011−0.406−0.0372.9270.214 **3.1080.229 **1.9150.124
Gender−0.145−0.014−0.579−0.061−0.350−0.0330.5070.0370.3310.0241.6680.103
Step 2
Fulltime 0.2470.0270.5530.055 2.6400.208 **2.5460.166 *
Working overtime 0.0680.6560.7990.073 2.0810.151 *2.6690.163 **
Shift work 1.1180.1130.8810.085 0.2200.016−2.035−0.130 *
Another language than German spoken with clients 0.2410.0240.6200.058 1.8270.1311.4070.084
Fixed−term contract 2.3970.239 *2.4030.214 * 0.2090.0150.4410.027
Registered/Geriatric nurse −0.403−0.0440.2660.027 1.2760.0971.4910.097
Leadership position −0.127−0.0140.0810.008 0.0580.005−0.249−0.018
Step 3
Influence and freedom at work (COPSOQ) 2.1280.252 * −1.281−0.092
Relationship with colleagues and superior (COPSOQ) −2.099−0.287 * 0.0400.003
Work appreciated by the management (COPSOQ) 0.1770.021 −0.384−0.031
Daily taking care of the same patients (BGWmiab) 0.4980.055 −0.712−0.056
Confronted with suffering/dying patients (BGWmiab) 0.2590.028 −0.170−0.012
Caring for patients with dementia/psychic diseases (BGWmiab) 0.8990.097 0.2830.022
Discrimination (ALLBUS) 0.2720.029 0.3800.026
Depressive symptomatology (PHQ−9) −0.994−0.154 0.2970.029
Generalized anxiety (GAD-7) 1.2670.192 2.0050.199 *
Somatic symptom burdens (SSS-8) 2.9170.388 ** 4.6180.389 **
R2 −0.018 −0.011 0.254 0.036 0.092 0.394
ΔR2 0.001 0.075 0.314 ** 0.047 * 0.090 * 0.321 **
Independent variables (step 2) were dummy coded: Yes = 1, No = 0. Dependent variable: psychosocial distress. Hierarchical multiple regression analysis, * p < 0.05, ** p < 0.01.

Share and Cite

MDPI and ACS Style

Schilgen, B.; Nienhaus, A.; Mösko, M. The Extent of Psychosocial Distress among Immigrant and Non-Immigrant Homecare Nurses—A Comparative cross Sectional Survey. Int. J. Environ. Res. Public Health 2020, 17, 1635. https://doi.org/10.3390/ijerph17051635

AMA Style

Schilgen B, Nienhaus A, Mösko M. The Extent of Psychosocial Distress among Immigrant and Non-Immigrant Homecare Nurses—A Comparative cross Sectional Survey. International Journal of Environmental Research and Public Health. 2020; 17(5):1635. https://doi.org/10.3390/ijerph17051635

Chicago/Turabian Style

Schilgen, Benjamin, Albert Nienhaus, and Mike Mösko. 2020. "The Extent of Psychosocial Distress among Immigrant and Non-Immigrant Homecare Nurses—A Comparative cross Sectional Survey" International Journal of Environmental Research and Public Health 17, no. 5: 1635. https://doi.org/10.3390/ijerph17051635

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop