Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Common oxytocin polymorphisms interact with maternal verbal aggression in early infancy impacting blood pressure at age 5-6: The ABCD study

  • Laetitia J. C. A. Smarius ,

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Project administration, Writing – original draft, Writing – review & editing

    laetitiasmarius@online.nl

    Affiliations Department of Public Health, Amsterdam Public Health Research Institute, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands, Academic Center for Child and Adolescent Psychiatry de Bascule, Amsterdam, The Netherlands, Department of Child and Adolescent Psychiatry, VU University Medical Center, Amsterdam, The Netherlands

  • Thea G. A. Strieder,

    Roles Conceptualization, Funding acquisition, Writing – review & editing

    Affiliation Arkin Institute for Mental Health, Amsterdam, The Netherlands

  • Theo A. H. Doreleijers,

    Roles Funding acquisition, Resources, Supervision, Writing – review & editing

    Affiliation Department of Child and Adolescent Psychiatry, VU University Medical Center, Amsterdam, The Netherlands

  • Tanja G. M. Vrijkotte,

    Roles Data curation, Funding acquisition, Methodology, Supervision, Writing – review & editing

    Affiliation Department of Public Health, Amsterdam Public Health Research Institute, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands

  • M. H. Zafarmand,

    Roles Data curation, Funding acquisition, Methodology

    Affiliation Department of Public Health, Amsterdam Public Health Research Institute, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands

  • Susanne R. de Rooij

    Roles Methodology, Supervision, Validation, Writing – review & editing

    Affiliations Department of Public Health, Amsterdam Public Health Research Institute, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands, Department of Clinical Epidemiology, Biostatistics and Bio-informatics, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands

Abstract

Early life stress has been shown to contribute to alterations in biobehavioral regulation. Genetic make-up, especially related to social sensitivity, might affect the child’s vulnerability to these alterations. This study examined whether maternal verbally aggressive behavior in early infancy interacts with oxytocin polymorphisms in changing resting cardiovascular outcomes at age 5–6. In the Amsterdam-Born-Children-and-their-Development-(ABCD)-study, a large prospective, observational, population-based birth cohort, maternal verbally aggressive behavior was assessed in the 13th postnatal week (range 11–25 weeks, SD 2 weeks) by a questionnaire (maternal self-report). Indicators of resting cardiac autonomic nervous system activity (sympathetic drive by pre-ejection period, parasympathetic drive by respiratory sinus arrhythmia), heart rate, and blood pressure were measured at age 5–6 years. Data on oxytocin receptor gene polymorphisms rs53576, rs2268498 and oxytocin polymorphisms rs2740210, rs4813627, were collected (N = 966 included). If the child was carrier of the rs53576 GG variant, exposure to maternal verbally aggressive behavior (10.6%) was associated with increased systolic blood pressure at age 5–6 (B = 4.9 mmHg,95% CI[2.2;7.7]). If the child was carrier of the rs2268498 TT/TC variant, exposure to maternal verbally aggressive behavior was associated with increased systolic blood pressure at age 5–6 (B = 3.0 mmHg,95%CI[1.0:5.0]). No significant interactions of maternal verbally aggressive behavior with oxytocin gene polymorphisms on heart rate or cardiac autonomic nervous system activity were found. In conclusion, oxytocin receptor gene polymorphisms may partly determine a child’s vulnerability to develop increased systolic blood pressure after being exposed to maternal verbally aggressive behavior in early infancy.

Introduction

Infancy is a highly critical period for brain development. During the first months of life, essential brain structures are evolving and in basic structures synaptogenesis is accelerating [1]. Exposure to a single, but substantial, stressor during this early period might impact brain development and programming of the stress systems significantly. For instance, maternal report of interparental conflict has been positively associated with infants' activation in brain regions related to emotion processing and stress regulation (anterior cingulate cortex, caudate nucleus (part of dorsal striatum), hypothalamus, and thalamus) in response to the sound of their mothers’ angry voice at age 6–12 months [2], implying programming effects. Of note, between 2–4 months of age, synaptogenesis in the striatum is most rapid and total gray matter volume of the striatum reaches adult size at about 4 months of age [1], emphasizing the potential impact of stress exposure in this period of life.

Maternal verbally aggressive behavior in early infancy can be considered a profound early life stressor, as soothing maternal behavior would be more appropriate at this young age. We have recently shown that exposure to maternal verbally aggressive behavior at the age of 3 months is associated with increased systolic blood pressure (SBP) at age 5–6 years [3]. However, some children might be more vulnerable to maternal verbally aggressive behavior than others. Differences in vulnerability or resilience to stress are related to protective environmental factors, including parental and non-parental support, and differences in genetic profile [4]. The extent to which maternal verbally aggressive behavior in infancy is perceived as stressful and thereby potentially affects cardiovascular outcomes, might partly depend on the infant’s genetic make-up.

Single nucleotide polymorphisms (SNPs) in the oxytocin (OXT) gene and in the oxytocin receptor (OXTR) gene are potential candidates for gene-environment (GxE) interaction due to their differential associations with social sensitivity. Oxytocin is a neuropeptide, predominantly expressed in magnocellular neurons in the hypothalamic paraventricular (PVN) and supraoptic (SON) nuclei [5], which has key functions in childbirth, maternal behavior, social behavior and cardioprotection. Cardioprotective activities of oxytocin are lowering of blood pressure (BP), parasympathetic neuromodulation, anti-inflammatory activity and vasodilatation [6,7]. In adults, oxytocin has been shown to be involved in emotion recognition [8] and mentalizing, which is the ability to represent mental states of oneself and others [9]. An important component of mentalizing is ‘seeing leads to knowing’, a prerequisite of the development of empathic abilities present in non-human primates [10]. Although infants do not have complete mentalizing and empathic abilities yet, naturally occurring variations in social sensitivity due to OXT and OXTR gene polymorphisms may affect the infant’s perception of the social environment.

A number of different OXT and OXTR polymorphisms associated with social sensitivity, such as facial emotion recognition or vocalizing, could be relevant in the context of maternal verbally aggressive behavior. At first, a SNP located in the third intron of the OXTR gene, rs53576, involving a guanine (G) to adenine (A) substitution, has been associated with diminished prosocial features. Individuals with the GG genotype (i.e. the absence of the polymorphism or wild type) display beneficial prosocial traits including enhanced trust, self-esteem and empathic abilities [11]. Recently, the rs53576 G-allele has been associated with increased amygdala responsiveness to emotional facial expressions [12], implicating a higher level of arousal, if exposed to emotional facial expressions. Interestingly, young adult GG carriers were demonstrated to be more sensitive to the social stressor of rejection as indicated by increased stress reactivity of BP and cortisol levels [13]. Because G-carriers are potentially more socially sensitive, this may render them more vulnerable to a negative social stressor. The second OXTR polymorphism of interest is rs2268498, upstream variant 2KB, located in the promoter region of the OXTR gene. T-allele carriers, both the wild homozygote and the heterozygote type, have been shown to perform better at facial emotion recognition [14] and seem to have higher self-reported empathy [15,16], compared to C-allele carriers.

Additionally, two particular OXT polymorphisms, rs2740210, located in the 3′ flanking region, upstream variant 2KB, and rs4813627, located 56kb downstream the OXT gene, have been found associated with the duration of maternal infant-directed vocalizing, a measure of maternal engagement [17]. It is not known what the function of these polymorphisms is in infants, but it could be hypothesized that rs2740210 and rs4813627 are related to infant’s social sensitivity.

Ample evidence has shown that stressful experiences early in life can increase the risk of cardiovascular health problems and diseases in later life through programming of the biobehavioral response to stress, with altered activity of the stress systems, including the hypothalamic-pituitary-adrenal axis and the autonomic nervous system [18,19,20,21]. In line with the findings from the McQuaid et al. study[13], we hypothesize that individuals carrying OXTR and OXT SNPs enhancing social sensitivity are more vulnerable to a negative social stressor and display increased stress responses programming biobehavioural regulation with adverse cardiovascular consequences on the long term. Therefore, we aimed to test whether our previously demonstrated association between exposure to maternal verbally aggressive behavior in early infancy and increased SBP in children at age 5–6 [3] is moderated by OXTR and OXT SNPs. In addition, we included the cardiovascular outcomes heart rate (HR) and resting autonomic nervous system (ANS) activity at age 5–6. We expected that infants carrying OXTR rs53576 GG or rs2268498 T-allele, who are more apt at recognizing facial emotions, experience more stress in response to maternal verbally aggressive behavior and display more adverse cardiovascular outcomes at age 5–6, compared to infants carrying respectively GA/AA or CC variants. Additionally, we explored whether carriers of one of the different variants of OXT rs2740210 or rs4813627 are more or less vulnerable to adverse cardiovascular outcomes after experiencing maternal verbally aggressive behavior in infancy, compared to carriers of the other variant. As these OXT variants were only investigated in mothers and shown to be associated with maternal duration of vocalizing, of which it is not known which duration is related to social sensitivity, we did not hypothesize beforehand which allele of OXT rs2740210 or rs4813627 would be the risk allele for social sensitivity. Our hypotheses are visualized in Fig 1.

Results

Subjects’ characteristics

The characteristics of both the mothers and the children are presented in Table 1. Of the 966 included children, 102 (10.6%) had been exposed to maternal verbally aggressive behavior at the age of 3 months (mean 13th week, range 11–25 weeks, SD 2 weeks). Compared to children not exposed to maternal verbally aggressive behaviour, exposed children were slightly taller, had a mother who reported more postnatal depressive symptoms, less pleasure in infant care and more physically aggressive behaviour. When the children were 5–6, their mothers reported more depressive symptoms, more parenting stress, and more often used an authoritarian parenting style, compared to the mothers from the non-exposed children.

thumbnail
Table 1. Characteristics of 966 native Dutch women and their children according to maternal verbally aggressive behavior in early infancy (N = 102).

https://doi.org/10.1371/journal.pone.0216035.t001

Maternal verbally aggressive behavior in infancy and child’s OXTR and OXT genotype variants

Maternal verbally aggressive behavior in infancy was not associated with any OXTR and OXT genotype variant of the infant (Table 2).

thumbnail
Table 2. OXTR and OXT genotype variants according to maternal verbally aggressive behavior, BP, resting HR and Cardiac ANS activity in sitting position.

https://doi.org/10.1371/journal.pone.0216035.t002

Child’s OXTR, OXT genotype variants and cardiovascular outcomes at age 5–6

Genotype variant rs2268498 TC was associated with an increase in SBP of 1.9 mmHg (F = 8.819; p = 0.003) and in HR of 2.3 bpm (F = 8.529; p = 0.004) compared to the homozygote rs2268498 TT (wild type) variant. Genotype variant rs2740210 AA was associated with a larger pre-ejection period (PEP) of 2.8 msec (F = 4.644; p = 0.032) compared to the rs2740210 CC (wild type) variant. Genotype variants rs53576 and rs4813627 were not associated with cardiovascular outcomes (Table 2).

Maternal verbally aggressive behavior in infancy and child’s cardiovascular outcomes at age 5–6

Maternal verbally aggressive behavior in infancy was associated with a higher SBP after adjustment for sex, height and age (Model 1) (B = 2.1 mmHg, 95% CI [0.4;3.8]) at age 5–6. Adjustment for potential confounding factors (Model 2) only slightly attenuated the association (B = 2.0 mmHg, 95% CI [0.2; 3.8]). Maternal verbally aggressive behavior in infancy was not associated with diastolic blood pressure (DBP), HR, PEP or respiratory sinus arrhythmia (RSA) at age 5–6.

Child’s OXTR and OXT genotype variants, maternal verbally aggressive behavior in infancy and cardiovascular outcomes at age 5–6

In line with our hypotheses, some interactions were shown to be significant, indicating that the association between maternal verbally aggressive behavior and blood pressure was dependent on the genotype. First, carriers of rs53576GG having experienced maternal verbally aggressive behavior in infancy, showed an increased SBP of 4.9 mmHg (95% CI 2.2; 7.7) at the age of 5–6 (Fig 2A), compared to unexposed carriers of rs53576 GG (p-value for interaction = 0.012). Secondly, carriers of rs2268498 TT/TC having experienced maternal verbally aggressive behavior in infancy, showed an increased SBP of 3.0 mmHg (95% CI 1.0; 5.0) at the age of 5–6 (Fig 2B), compared to unexposed carriers of rs2268498 TT/TC (p-value for interaction = 0.021). Carriers of rs2268498 CC having experienced maternal verbally aggressive behavior in infancy showed a decrease in DBP of -3.9 mmHg (CI -7.4;-0.4), compared to unexposed carriers of rs2268498 CC (p-value for interaction = 0.021) at the age of 5–6 (Fig 2C). Other interactions were not statistically significant (S1 Table).

thumbnail
Fig 2.

A. Systolic blood pressure according to maternal verbally aggressive behavior, stratified by rs53576. B. Systolic blood pressure according to maternal verbally aggressive behavior, stratified by rs2268498. C. Diastolic blood pressure according to maternal verbally aggressive behavior, stratified by rs2268498.

https://doi.org/10.1371/journal.pone.0216035.g002

Discussion

Our study shows novel evidence suggesting that OXTR gene variants might influence the vulnerability to develop increased SBP at age 5–6, after exposure to maternal verbally aggressive behavior in early infancy. Confirming our hypothesis, we found evidence for gene- environment interaction of OXTR polymorphisms rs53576 and rs2268498, both of which have previously been associated with facial emotion recognition [12,14]. Our findings of rs53576 are in line with a retrospective study on childhood maltreatment and adult emotional dysregulation, in which carriers of rs53576 GG were at risk for increased emotional dysregulation when exposed to three or more categories of childhood abuse. On the contrary, A-allele carriers were suggested to be resilient against the effects of severe childhood adversity [22]. In our study, exposed A-allele carriers also seemed resilient to increases in SBP. We found no significant gene-early environment interaction with respect to the OXT gene variants rs2740210 and rs4813627, and maternal verbally aggressive behavior in infancy in increasing SBP at age 5–6, although the non-significant interactions were in the same direction (S2A Fig and S2B Fig).

In contrast to our hypothesis, we found neither evidence for interaction of OXTR nor OXT gene variants with exposure to maternal verbally aggressive behavior in early infancy in increasing DBP, HR, or altering resting ANS activity at the age of 5–6. Associations might only start showing after exposure to multiple early life stressors, comparable to the study of Pretty et al. [23], in which four or more adverse childhood experiences were positively associated with HR. In line with this study, the combination of adverse life events and chronic stress has been shown to be associated with altered cardiac ANS activity, measured by heart rate variability (HRV) [24]. Another explanation for our null findings could be that we measured the children in rest. Differences in HR and ANS activity are much more likely to show when the system is stressed. In interpretation of null findings on DBP, it is important to consider that BP reactivity through an increase in adrenergic cardiac contractility will be measurable in SBP and not in DBP. Importantly, in children, SBP reactivity but not DBP or HR reactivity has been shown to predict carotid intima–media thickness, an index of diffuse subclinical atherosclerosis [25].

An unexpected finding was a decrease in DBP of -3.9 mmHg in carriers of OXTR variant rs2268498 CC (homozygote recessive type/ non risk allele) having experienced maternal verbally aggressive behavior in infancy. Although the exposed risk allele carriers display increased DBP, as compared to the exposed non-risk allele carriers, the DBP of the exposed risk allele carriers is comparable to the DBP of the non-exposed infants (and therefore not increased in absolute terms). Nonetheless, our findings could be interpreted being in the direction of the hypothesis: within infants exposed to maternal verbal aggression, those with risk genotype rs2268498 TT/TC display increased DBP as compared to non-risk-carriers rs2268498 CC.

As yet, no literature exists on possible differences in BP, HR and ANS activity directly due to presence or absence of OXT and OXTR polymorphisms. In our study, some genotype variants showed direct effects on cardiovascular outcomes. Replication is needed of both the direct effect of rs2268498 on SBP and HR and the direct effect of rs2740210 on PEP in order to further study the function of these SNPs in cardiovascular regulation.

Our finding of OXTR variant rs2268498 related to vulnerability to increases in SBP after a context of early life stress is highly novel. Our results suggest that an infant’s genetic requisites of better facial emotion recognition, and higher social sensitivity, increases the vulnerability of the exposed child to an increase in SBP at age 5–6. Interestingly, from an evolutionary perspective, OXTR variants rs53576 GG (the wild type) and rs2268498 TT/TC, being more sensitive to the social environment, might create more cardiac output to support a necessary fight or flight response, an adequate environmental adaptation. However, an increased SBP in the long term carries a cardiovascular health risk. Since BP has been shown to track into adulthood, with tracking coefficients larger for SBP than DBP [26], the demonstrated increases of 3.0–4.9 mmHg in SBP at age 5–6 in the normal population can be considered large and clinically relevant in the future. Moreover, elevated BP in children has been shown to be associated with hypertensive target-organ damage [27].

Strengths and limitations

Strengths of this study are the large population-based birth cohort, the prospective study design, the extensive data collection from early infancy onwards and BP, HR and ANS measurements according to a standardized protocol. Importantly, we were able to control for a large number of potentially confounding stressors, such as maternal physical aggressive behavior in infancy and authoritarian parenting style at age 5–6. We specifically excluded participants with previously known physiological variables of influence on the ANS and BP such as preterm birth, which is associated with increased sympatho-adrenal activity in childhood [28].

Based on literature on sample size, statistics and selection of SNPs in genetic epidemiologic studies [2932], a maximum of four SNPs were selected for investigation. These four SNPs have previously been associated with either recognition of facial emotions or vocalizing and have a MAF> 0.25. As maternal verbally aggressive behavior did not differ between responders and non-responders (those who did not participate at age 5–6), respectively 10.6% and 9.2% (p = 0.177), possible selection bias is estimated to be limited. Importantly, the genotype variants did not vary across the exposed and non-exposed infants. Therefore no population stratification was present. Also, time of day of measurements did not differ between the genotypes.

Maternal verbally aggressive behavior was considered present if speaking angrily had been present twice or more, at the infant’s age of 3 months. This definition of maternal verbally aggressive behavior seems quite narrow, but, at the same time, encloses all from only twice to frequent exposure to maternal verbally aggressive behavior in early infancy. Face validity of maternal self-reported verbally aggressive behavior will depend on maternal self-reflection. In our study, we did not have information on maternal self-reflection. Therefore, we could not include this covariate in our analyses. Importantly, self-reflection can be influenced by depressive symptoms in a way that it could lead to overestimation of behavior. However, we do not expect mothers to overestimate verbally aggressive behavior. On the contrary, possible social desirability could lead to underestimation of the true frequency of maternal verbally aggressive behavior. Importantly, self-report is the only way to measure verbally aggressive behavior, as continuous observation of the mother-infant dyad is not feasible. In our analyses we did adjust for maternal depressive symptoms both in infancy and at age 5–6. A limitation is that the distinction between temporary, frequent or persistent maternal verbally aggressive behavior to the infant, thus creating chronic stress in the first years, could not be made based on our data. Due to small numbers we were not able to investigate a possible dose-response relationship. Also, we could not assess the possible contribution of paternal aggressive behavior. We suspect that experience of simultaneous other adverse events will probably increase the gene-environment interaction effect.

Although the study population was large, the numbers of subjects in various groups in the studied interactions was fairly small (40 exposed children with OXTR rs53576 GG (wild type); 19 exposed children with OXTR rs2268498 CC (homozygote recessive type); 44 exposed children OXT rs2740210 CC (wild type); 30 exposed children with OXT rs4813627 GG (wild type)). In order to follow the recommendations of Keller (2014) to properly control for potential confounders [33] we additionally checked whether adding sex*G and sex*E to the complete model would change the results. The p-values for interaction of the SNPs and maternal verbal aggression in association to SBP minimally changed, and remained significant (rs53576* verbal aggression: p = 0.016 (instead of 0.012); rs2268498* verbal aggression: p = 0.026 (instead of 0.021). We aimed to replicate the results in an independent cohort, but, as far as we know, no other cohort study exists in which both maternal verbally aggressive behaviour at the age of 3 months and blood pressure at age 5 were assessed. Nevertheless, this is an exploratory analysis and our findings on gene-environment interaction by OXTR polymorphisms should be replicated in independent samples.

Furthermore, gene-environment interaction of OXTR or OXT polymorphisms could differ between boys and girls. Indeed, evidence of sex differences exists in brain structure, function, and neurotransmission [34] as well as stress-reactivity [35]. Unfortunately, our study was underpowered for sex-stratified interaction analyses. Of note, it is unknown whether the selected SNPs in our study have similar or overlapping functions and the small numbers hindered investigation of gene-gene interactions.

Potential underlying mechanisms

Exposed carriers of risk alleles enhancing social sensitivity are suggested to be vulnerable to an increase in SBP at age 5–6. These infants might have experienced higher stress levels than non-risk allele carriers. These physiological stress levels could have induced programming of biobehavioral systems by affecting the developing brain, ultimately impacting the child’s SBP at age 5–6.

A first mechanism explaining our findings could be a direct effect of the gene- environment interaction on programming of OXT levels. In a retrospective study, multiple stressful early life events have been linked to reduced OXT levels in the Cerebro Spinal Fluid (CSF) [36], suggesting a programming effect which in itself might increase SBP. Although the functional effects of OXTR or OXT polymorphisms on receptor binding and OXT levels are not known, OXTR polymorphisms might affect programming of density and regional distribution of the OXTR by epigenetic mechanisms, and thereby differentially affect OXT levels and consequently oxytocinergic cardioprotection. Importantly, early life experiences might alter sensitivity to both oxytocin and vasopressin systems [37] through epigenetic modification. Notably, OXTR is coupled to Gq, activating the same intracellular pathways as arginine-vasopressin receptor (AVPR)1a and AVPR1b [38]. Some evidence exists on the formation of heterodimers between these three receptors [39], which all three are simulated by vasopressin [40] and potentially impact BP.

Secondly, striatal volume may be differentially affected by exposure to stress in early life depending on whether the child is a risk-carrier or not. The striatum consists of the ventral striatum (nucleus accumbens and olfactory tubercle) and dorsal striatum (caudate nucleus and putamen) and is activated by unexpected or intense stimuli [41]. Between 2–4 months, synaptogenesis in the striatum is most rapid and total gray matter volume of the striatum reaches adult size at about age 4 months already [1]. Stress during this early period might have distinct programming effects, which could impact cardiovascular outcomes in children. Interestingly, in the context of childhood maltreatment, rs53576 GG homozygotes, carriers of risk alleles enhancing social sensitivity, display a strong gray matter reduction of bilateral ventral striatum with increasing Childhood Trauma Questionnaire (CTQ) scores as adults [12], implying programming effects. It is plausible that a gray matter reduction of the ventral striatum will affect its functionality. Indeed, a decrease of reward dependence has been found present more often in G-allele carriers, being socially sensitive, who had been exposed to early life adverse events [12].

Finally, programming of striatal systems, such as the renin-angiotensin system (RAS) and dopaminergic system could differ between the risk and the non-risk carriers. Major components of the RAS, a BP regulator, have been shown to exist in striatal astrocytes and microglial cells [42]. Hyperactivation of RAS has been shown to exacerbate oxidative stress and microglial inflammatory response and to contribute to progression of dopaminergic degeneration in animal models. A decrease in dopaminergic activity has been shown to induce compensatory upregulation of local RAS function in both dopaminergic neurons and glia cells [43], hereby accelerating hyperactivation. Increased stress reactivity in exposed carriers of risk alleles enhancing social sensitivity may induce local RAS hyperactivation. Ultimately, SBP might be increased by these programming effects. Moreover, local dopaminergic activity might be altered. Interestingly, after exposure to early life stress (induced by repeated parental separation) a programming effect on increased striatal Dopamine Active Transporter (DAT) availability has been shown in rats [44]. In line with the evidence that increased striatal DAT availability precedes hypertension in rats [45], a possible increase in striatal DAT availability due to programming effects might impact BP in the child at age 5–6 as well. Of course, early neglect in rats is not fully comparable to the stressor of maternal verbally aggressive behavior in infants.

Essentially, in rs53576 G-carriers only, peripheral oxytocin level has been negatively correlated with striatal DAT availability [46]. This specific difference between rs53576 variants might be causing an additional difference between carriers and non-carriers of the risk allele. Although speculative, G-carriers might not be able to lower an increased SBP due to programming effects in several systems.

Concluding, maternal verbally aggressive behavior may be an important early life stressor with negative impact on cardiovascular health later in life. Infant’s variation of OXTR related genes are suggested to be a significant factor of vulnerability to increases in SBP at age 5–6. Future studies may address whether the GxE interactions we demonstrated, can be replicated in larger birth cohort studies, in adolescence and adulthood, whether differences between boys and girls exist and whether other cardiovascular outcomes are affected when stress is induced. Finally, studies of possible genetic overlapping functions are needed to further explore the relevance of these promising genetic markers.

Methods

Participants

The study sample is part of a large prospective, observational, population-based multiethnic birth cohort, the Amsterdam Born Children and their Development (ABCD) study, which started in 2003. Extensive information about the cohort and procedures regarding data collection has been published elsewhere [47]. Data were processed anonymously. Approval of the ABCD study was obtained from local ethical committee (Institution name Academic Medical Hospital, approval number MEC 02/39#02.17.392). Approval of the ABCD-Genetic Enrichment (ABCD-GE) study, a sub-study of 1192 Dutch children, was obtained from the Medical Ethical Committees of the Academic Medical Hospital in Amsterdam. For the ABCD-GE study an opt out procedure was followed. All participating mothers gave written informed consent for themselves and their children.

Between January 2003 and March 2004, all pregnant women living in Amsterdam were asked to participate in the ABCD study during their first prenatal visit to an obstetric care provider (general practitioner, midwife, or gynecologist). Of the 12373 women approached, 8266 women filled out the pregnancy questionnaire (mean gestational age: 15.7 weeks (SD 3.5) (response rate: 67%)). A total of 6735 women gave permission for follow-up. Three months after birth, 5131 women filled out the infancy questionnaire. For the questionnaire at the child’s age of 5–6, addresses of 6161 mothers were retrieved; 4488 mothers returned the questionnaire. Attrition in this follow-up number was due to withdrawal, unknown address, infant or maternal death. Multiple births were excluded from the cohort preceding the third phase. The health check at 5–6 years consisted of various health measurements in 3287 children aged 5–6 years (2008–2010; mean age 5.7 years +- 0.5 SD). For the ABCD-Genetic Enrichment (ABCD-GE) study, blood of the child was collected from a simple finger prick during the 5-year health check-up in 1192 children of Dutch descent. DNA was extracted from the dried blood spots. Data on all three measurements (pregnancy, infancy, and early childhood) had to be available to be included in the present study. We excluded preterm births (gestational age < 37 weeks) and congenital diseases (N = 966 included). The flow chart of participants included in the present study is shown in Fig 3.

Maternal verbally aggressive behavior in infancy

Maternal verbally aggressive behavior was assessed by a maternal self-report questionnaire completed in the 13th week after birth (range 11–25 weeks, SD 2 weeks). Maternal verbally aggressive behavior was assessed using a question about the frequency of speaking angrily to the infant on a six-point scale: ‘Have you ever spoken angrily to your baby in order to diminish the crying?’ The histogram of the answers to this question is shown in S1 Fig. The score was dichotomized [speaking angrily (frequency < = 1 or > = 2)]. Maternal verbally aggressive behavior was considered present if speaking angrily to the infant had been present twice or more. This cut-off was chosen in order to make a distinction between speaking angrily to the infant by accident, versus twice or more often [3].

Child cardiac autonomic nervous system activity, blood pressure, and heart rate at age 5–6

Cardiac ANS activity was assessed at the age 5 health check, using the VU University Ambulatory Monitoring System (VU-AMS, version 5fs, TD-FPP, Amsterdam, the Netherlands). Reliability and validity aspects and recording methodology of the VU-AMS have been described previously [48]. The system records three lead electro cardiograms (ECG) and four lead impedance cardiograms (ICG) (Ultratrace Diagnostic ECG with wet gel; ConMed Corporation, Utica, New York, United States of America). In brief, ECG and respiratory activity were recorded between 8:30 am and 15:00 pm in sitting and supine positions, during which no conversation took place. RR-interval time series were analyzed during 4 minutes. Mean heart rate (HR) was 85.5 bpm (60 sec/85.5 = 0.7 sec for RR-interval). All R-peaks in the ECG were checked and R-peak markers were moved, inserted or deleted. The software automatically marked inspirations and expirations in the respiratory signals, which were manually checked. No edits were necessary [48].

Respiratory Sinus Arrhythmia (RSA), a time domain index of Heart Rate Variability (HRV) in the respiratory frequency range, was automatically obtained as derivate of parasympathetic nervous system activity. RSA was taken as the peak valley estimation (pvRSA) which was obtained automatically by subtracting the shortest inter beat interval during HR acceleration in the inspirational phase from the longest inter beat interval during deceleration in the expirational phase. Decreased parasympathetic activity is indicated by a shorter RSA. Pre-ejection period (PEP) is a measure of sympathetic activity. PEP can reliably be measured in children [49]. PEP is the time interval between the onset of the ventricular depolarization (Q wave onset in the ECG) and the time of opening of the aortic valves (B point in the ICG) and was scored manually in large-scale ensemble averages of the impedance cardiograms. Decreased sympathetic activity is indicated by a longer PEP [50]. To obtain the mean value of the HR, the mean HR across the experimental conditions was used, excluding the period during which BP was measured.

Children’s BP was measured twice both in supine and sitting position after a test reading and 5 minutes of rest. BP was measured with the automatic oscillometric method, using the Omron 705 IT (Omron Healthcare Inc., Cannockburn, IL, USA) with a small cuff (arm circumference 17–22 cm) on the non-dominant arm. When either the systolic (SBP) or diastolic pressure (DBP) differed more than 10 mmHg between the two measurements, a third measurement was taken (17%). The average of the two measurements closest together was used in the supine and sitting position. For this study we used PEP, RSA, HR and BP in sitting position.

Genotyping

The finger prick yielded fasting capillary blood samples for DNA extraction. Subsequently, the DNA samples were genotyped, using the Illumina Human Core Exom Beadchip (Illumina, San Diego, CA, USA). The Illumina Human Core Exom Beadchip includes over 540,000 genetic markers. Before imputation, SNPs were excluded if they had high levels of missing data (SNP call rate < 95%, strong departures from Hardy-Weinberg equilibrium (HWE) (P<1 x 106), or low minor allele frequencies (MAF) (<1%). Moreover, if mismatch in heterozygosity, gender or relatedness existed, individuals were excluded. Genetic markers were imputed using the IMPUTE2 software and the 1000 Genomes References Panel (phase 1 release v3, build 37). Genotypes for the SNPs of interest were extracted from the imputed GWAS data set. The final number of SNPs was 277,644. The total of SNPs after imputation was 27,448,454. The mean quality of the imputed genotypes (r2) of the 4 SNPs included in this study (rs53576, rs2268498, rs2740210, and rs4813627) was 0.82, ranging from 0.75 to 0.87 (Table 3). Using PLINK, none of the selected SNPs were in pair-wise linkage disequilibrium (R2 = 0.31 and 0.28 for rs53576/rs2268498 and rs2740210/rs4813627, respectively).

thumbnail
Table 3. Oxytocin polymorphism variants and imputation quality.

https://doi.org/10.1371/journal.pone.0216035.t003

Covariates

The following child characteristics during infancy were included from youth health care services: sex, birth weight, and gestational age. Excessive infant crying was assessed by questionnaire. Excessive infant crying was considered present if mothers estimated their infant to cry for three or more hours per 24 hour day on average in the 13th week after birth (range 11–25 weeks, SD 2 weeks) (best approximation of the Wessel’s criteria) [51].

The following maternal characteristics were included during pregnancy: age, parity (0 or > = 1), cohabitation status (single or living together with partner), and level of education (years after primary school). During infancy, maternal depressive symptoms, maternal physically aggressive behavior and maternal smoking at home were included. Maternal postnatal depressive symptoms were measured using the Center for Epidemiologic Studies Depression Scale (CES-D) [52]. The summed scores were analyzed continuously. Pleasure in infant care was measured using five questions on a four point scale (very true, true, not true, not true at all): ‘I feel very good taking care of my baby?’; ‘I feel very satisfied taking care of my baby?’; ‘I feel happy taking care of my baby?’; ‘I am fed up taking care of my baby?’; ‘I really enjoy taking care of my baby?’ The summed scores were analyzed continuously. Maternal physically aggressive behavior consisted of three behaviors on a six-point scale, which were dichotomized [cloth on mouth (frequency 0 or > = 1), slapping (frequency 0 or > = 1), and shaking baby (frequency 0 or > = 1)]. These three behaviors were summed scored as maternal physically aggressive behavior, and analyzed continuously. Maternal smoking at home during infancy was either present or absent (yes or no).

Additionally the following characteristics were included: maternal pre-pregnancy BMI (kg/m2) and preexistent hypertension (yes or no). Pregnancy-induced hypertension (yes or no) was available by combining data from the questionnaire and the Dutch Perinatal Registration (PRN, www.perinatreg.nl) and classified in accordance with the guidelines of the International Society for the Study of Hypertension in Pregnancy (www.isshp.com). Paternal hypertension and family (maternal or paternal) hypertension were derived from a questionnaire previously described elsewhere [53].

Covariates at age 5 included the exact age of the child at the 5–6 years health check and time of day when measurements were taken. The height and weight of the child were measured from which BMI was calculated. Authoritarian parenting style was measured by the 12-items subscale of the short version of the Parenting Styles and Dimensions Questionnaire (PSDQ) [54] and analyzed continuously. Maternal parenting stress was measured by nine items on attachment derived from the 123-items of the ‘Nijmeegse Ouderlijke Stress Index’ (NOSI-K) [55] and was analyzed continuously. Maternal depressive symptoms at age 5 were measured by the depression severity subscale of the Depression Anxiety Stress Scales (DASS 21) [56] and were analyzed continuously. Whether the child was being raised in an intact family (yes or no) was assessed by one item from the questionnaire filled out at age 5–6.

Statistical analyses

All variables were inspected for outliers and checked on normality. Descriptive statistics were used to describe maternal and child characteristics. Associations between these characteristics and maternal verbally aggressive behavior were tested using analysis of variance for continuous variables and Chi square tests for categorical variables. Associations between the different polymorphisms and maternal verbally aggressive behavior, SBP, DBP, HR, RSA and PEP were tested using analysis of variance for continuous variables and Chi square tests for categorical variables. The associations of maternal verbally aggressive behavior and ANS, BP and HR were analyzed by means of multivariable linear regression analysis. Potential confounders were selected a priori from Table 2 and included in the regression model by using a forced- entry method. We selected covariates associated with maternal verbally aggressive behavior as possible confounders. After initial testing in a crude univariate model, or a minimally adjusted model for sex, age and height of the child (model 1), the following covariates were added to a fully adjusted model (model 2): postnatal depressive symptoms, pleasure in infant care, maternal physically aggressive behavior in infancy, authoritarian parenting style, maternal depression and parenting stress (NOSI-K) at the child age of 5–6. Interaction terms of maternal verbally aggressive behavior and polymorphism variant of OXTR rs53576 (GG vs. GA/AA) or rs2268498 (TT/TC vs. CC) and maternal verbally aggressive behavior and OXT rs2740210 (CC vs. CA/AA) or rs4813627 (GG vs GA/AA) were added to the fully adjusted models to test interaction in risk alleles. Additionally, the data were stratified into two groups (presence or absence of OXTR risk alleles according to the hypothesis or OXT wild type or not) and analyzed separately according to the above model. The statistical analyses were performed by IBM SPSS Statistics software version 20.0 (IBM Corp, Armonk, NY, USA). The significance level we used in the study was 5%.

Supporting information

S1 Fig. Frequency of speaking angrily.

Frequency of speaking angrily = ‘Have you ever spoken angrily to your baby in order to diminish the crying?’ (1 = no; 2 = 1 time; 3 = 2 times; 4 = 3 times; 5 = 4 times; 6 = 5 times or more). Maternal verbally aggressive behavior was considered present if speaking angrily to the infant had been present twice or more.

https://doi.org/10.1371/journal.pone.0216035.s001

(TIF)

S2 Fig.

(a) Systolic blood pressure (mmHg) according to maternal verbally aggressive behavior, stratified by rs2740210. Carriers of rs2740210 CA/AA exposed to maternal verbally aggressive behavior in early infancy have a higher SBP of 3.9 mmHg (95%CI 1.2;6.6) than unexposed carriers of rs2740210 CA/AA (p-value for interaction = 0.135). (b) Systolic blood pressure (mmHg) according to maternal verbally aggressive behavior, stratified by rs4813627. Carriers of rs4813627 GA/AA exposed to maternal verbally aggressive behavior in early infancy have a higher SBP of 2.8 mmHg (95%CI 0.7;4.9) than unexposed carriers of rs4813627 GA/AA (p-value for interaction = 0.193).

https://doi.org/10.1371/journal.pone.0216035.s002

(ZIP)

S1 Table. Differences in heart rate, blood pressure and resting ANS at age 5–6 years between children exposed to maternal verbally aggressive behavior in infancy and non-exposed children, stratified for presence or absence of oxytocin genetic risk variants.

Model 1: adjusted for sex, height and age of the child; Model 2: Model 1, additionally adjusted for maternal depressive symptoms, pleasure in infant care, maternal physical aggression in infancy, authoritarian parenting style, maternal depressive symptoms and parenting stress (NOSI-K) at the child’s age of 5–6. *Interaction between maternal verbal aggressive behavior in infancy and oxytocin polymorphism *<0.05; **<0.01; ***<0.001

https://doi.org/10.1371/journal.pone.0216035.s003

(PDF)

Acknowledgments

We acknowledge the large contribution and involvement of all participating mothers and children of the ABCD study.

References

  1. 1. Huttenlocher PR, de Courten C. The development of synapses in striate cortex of man. Hum. Neurobiol. 1987; 6:1–9. pmid:3583840
  2. 2. Graham AM, Fisher PA, Pfeifer JH. What sleeping babies hear: a functional MRI study of interparental conflict and infants' emotion processing. Psychol Sci. 2013; 24:782–789. pmid:23538912
  3. 3. Smarius LJCA Strieder TGA, Doreleijers TAH, Vrijkotte TGM, de Rooij SR. Maternal verbally aggressive behavior in early infancy is associated with blood pressure at age 5–6. J Dev Orig Health Dis. 2018;1:1–7.
  4. 4. Bowes L, Jaffee SR. Biology, genes, and resilience: toward a multidisciplinary approach. Trauma Violence Abuse. 2013;14:195–208. pmid:23649831
  5. 5. Kiss A, Mikkelsen JD. Oxytocin-anatomy and functional assignments: a minireview. Endocr. Regul. 2005;39:97–105. pmid:16468232
  6. 6. Feldman R. Oxytocin and social affiliation in humans. Horm Behav. 2012;61:380–391. pmid:22285934
  7. 7. Gutkowska J, Jankowski M, Antunes-Rodrigues J. The role of oxytocin in cardiovascular regulation. Braz J Med Biol Res. 2014;47:206–214. pmid:24676493
  8. 8. Shahrestani S, Kemp AH, Guastella AJ. The impact of a single administration of intranasal oxytocin on the recognition of basic emotions in humans: a meta-analysis. Neuropsychopharmacology. 2013; 38:1929–1936. pmid:23575742
  9. 9. Domes G, Heinrichs M, Michel A, Berger C, Herpertz SC. Oxytocin improves "mind-reading" in humans. Biol Psychiatry. 2007;61:731–733. pmid:17137561
  10. 10. Tomasello M, Call J Hare B. Chimpanzees understand psychological states—the question is which ones and to what extent. Trends Cogn Sci. 2003;7:153–156. pmid:12691762
  11. 11. Gong P, Fan H, Liu J, Yang X, Zhang K, Zhou X. Revisiting the impact of OXTR rs53576 on empathy: A population-based study and a meta-analysis. Psychoneuroendocrinology. 2017;80:131–136. pmid:28343138
  12. 12. Dannlowski U, Kugel H, Grotegerd D, Redlich R, Opel N, Dohm K, et al. Disadvantage of Social Sensitivity: Interaction of Oxytocin Receptor Genotype and Child Maltreatment on Brain Structure. Biol Psychiatry. 2016;80:398–405. pmid:26858213
  13. 13. McQuaid RJ, McInnis OA, Matheson K, Anisman H. Distress of ostracism: oxytocin receptor gene polymorphism confers sensitivity to social exclusion. Soc Cogn Affect Neurosci. 2015;10:1153–1159. pmid:25564674
  14. 14. Melchers M, Montag C, Markett S, Reuter M. Relationship between oxytocin receptor genotype and recognition of facial emotion. Behav Neurosci. 2013;127:780–787. pmid:24128365
  15. 15. Melchers M, Montag C, Markett S, Niazy N, Groß-Bölting J, Zimmermann J, et al. The OXTR gene, implicit learning and social processing: Does empathy evolve from perceptual skills for details? Behav Brain Res. 2017;329:35–40. pmid:28442360
  16. 16. Christ CC, Carlo G, Stoltenberg SF. Oxytocin Receptor (OXTR) Single Nucleotide Polymorphisms Indirectly Predict Prosocial Behavior Through Perspective Taking and Empathic Concern. J Pers. 2016;84:204–213. pmid:25403479
  17. 17. Mileva-Seitz V, Steiner M, Atkinson L, Meaney MJ, Levitan R, Kennedy JL, et al. Interaction between oxytocin genotypes and early experience predicts quality of mothering and postpartum mood. PLoS One. 2013; 8:e61443. pmid:23637833
  18. 18. Loria AS, Ho DH, Pollock JS. A mechanistic look at the effects of adversity early in life on cardiovascular disease risk during adulthood. Acta Physiologica (Oxf). 2014; 210:277–287.
  19. 19. Murphy MO, Cohn DM, Loria AS. Developmental origins of cardiovascular disease: Impact of early life stress in humans and rodents. Neuroscience and Biobehavioral Reviews. 2017;74:453–465. pmid:27450581
  20. 20. Phillips DI. Programming of the stress response: a fundamental mechanism underlying the long-term effects of the fetal environment? J Intern Med. 2007; 26:453–60.
  21. 21. Heim CM, Entringer S, Buss C. Translating basic research knowledge on the biological embedding of early-life stress into novel approaches for the developmental programming of lifelong health. Psychoneuroendocrinology. 2018: Dec 12.
  22. 22. Bradley B, Westen D, Mercer KB, Binder EB, Jovanovic T, Crain D, et al. Association between childhood maltreatment and adult emotional dysregulation in a low-income, urban, African American sample: moderation by oxytocin receptor gene. Dev Psychopathol. 2011; 23:439–452. pmid:23786688
  23. 23. Pretty C, O'Leary DD, Cairney J, Wade TJ. Adverse childhood experiences and the cardiovascular health of children: a cross-sectional study. BMC Pediatrics. 2013;13: 208. pmid:24344611
  24. 24. Lampert R, Tuit K, Hong KI, Donovan T, Lee F, Sinha R. Cumulative stress and autonomic dysregulation in a community sample. Stress. 2016;19:269–279. pmid:27112063
  25. 25. Roemmich JN, Lobarinas CL, Joseph PN, Lambiase MJ, Archer Iii FD, Dorn J. Cardiovascular reactivity to psychological stress and carotid intima-media thickness in children. Psychophysiology. 2009;46:293–299. pmid:19207200
  26. 26. Chen X, Wang Y. Tracking of blood pressure from childhood to adulthood: a systematic review and meta-regression analysis. Circulation. 2008;117:3171–3180. pmid:18559702
  27. 27. Falkner B, De Loach S, Keith SW, Gidding SS. High risk blood pressure and obesity increase the risk for left ventricular hypertrophy in African-American adolescents. J Pediatr. 2013;162:94–100. pmid:22817908
  28. 28. Johansson S, Norman M, Legnevall L, Dalmaz Y, Lagercrantz H, Vanpee M. Increased catecholamines and heart rate in children with low birth weight: perinatal contributions to sympathoadrenal overactivity. Journal of Internal Medicine. 2007; 261:480–487. pmid:17444887
  29. 29. Sharma S, Powers A, Bradley B, Ressler KJ. Gene × Environment Determinants of Stress- and Anxiety-Related Disorders. Annual Rev Psychol. 2016;67:239–261. pmid:26442668
  30. 30. Stenzel SL, Ahn J, Boonstra PS, Gruber SB, Mukherjee B. The impact of exposure-biased sampling designs on detection of gene-environment interactions in case-control studies with potential exposure misclassification. Eur J Epidemiol. 2015;30:413–423. pmid:24894824
  31. 31. Stringer S, Cerrone KC, van den Brink W, van den Berg JF, Denys D, Kahn RS, et al. A guide on gene prioritization in studies of psychiatric disorders. Int J Methods Psychiatr Res. 2015;24:245–256. pmid:26230968
  32. 32. Kraft P, Aschard H. Finding the missing gene-environment interactions. Eur J Epidemiol. 2015;30:353–553. pmid:26026724
  33. 33. Keller MC. Gene × environment interaction studies have not properly controlled for potential confounders: the problem and the (simple) solution. Biol Psychiatry. 2014;75:18–24. pmid:24135711
  34. 34. Cosgrove KP, Mazure CM, Staley JK. Evolving knowledge of sex differences in brain structure, function, and chemistry. Biol Psychiatry. 2007;62:847–855. pmid:17544382
  35. 35. Solomon MB, Herman JP. Sex differences in psychopathology: of gonads, adrenals and mental illness. Physiol Behav. 2009;97:250–258. pmid:19275906
  36. 36. Heim C, Young LJ, Newport DJ, Mletzko T, Miller AH, Nemeroff CB. Lower CSF oxytocin concentrations in women with a history of childhood abuse. Mol Psychiatry. 2009;14:954–958. pmid:18957940
  37. 37. Cushing BS, Kramer KM. Mechanisms underlying epigenetic effects of early social experience: the role of neuropeptides and steroids. Neurosci Biobehav Rev. 2005; 29:1089–1105. pmid:16099507
  38. 38. Alexander SP, Benson HE, Faccenda E, Pawson AJ, Sharman JL, Spedding M, et al. The Concise Guide to Pharmacology 2013/14: G Protein-Coupled Receptors. Br J Pharmacol. 2013;170:1459–1581. pmid:24517644
  39. 39. Cottet M, Albizu L, Perkovska S, Jean-Alphonse F, Rahmeh R, Orcel H, et al. Past, present and future of vasopressin and oxytocin receptor oligomers, prototypical GPCR models to study dimerization processes. Curr. Opin. Pharmacol. 2009;10:59–66. pmid:19896898
  40. 40. Russell JA. Bench-to-bedside review: Vasopressin in the management of septic shock. Crit. Care. 2011;15:226. pmid:21892977
  41. 41. Volman SF, Lammel S, Margolis EB, Kim Y, Richard JM, Roitman MF, et al. New insights into the specificity and plasticity of reward and aversion encoding in the mesolimbic system. Journal of Neuroscience. 2013;33:17569–17576. pmid:24198347
  42. 42. Garrido-Gil P, Rodriguez-Perez AI, Fernandez-Rodriguez P, Lanciego JL, Labandeira-Garcia JL. Expression of angiotensinogen and receptors for angiotensin and prorenin in the rat and monkey striatal neurons and glial cells. Brain Struct Funct. 2017;222:2559–2571. pmid:28161727
  43. 43. Labandeira-García JL, Garrido-Gil P, Rodriguez-Pallares J, Valenzuela R, Borrajo A, Rodríguez-Perez AI. Brain renin-angiotensin system and dopaminergic cell vulnerability. Front Neuroanat. 2014;8:67. pmid:25071471
  44. 44. Kunzler J, Braun K, Bock J. Early life stress and sex-specific sensitivity of the catecholaminergic systems in prefrontal and limbic regions of Octodon degus. Brain Struct Funct. 2015;220:861–868. pmid:24343570
  45. 45. Watanabe Y, Fujita M, Ito Y, Okada T, Kusuoka H, Nishimura T. Brain dopamine transporter in spontaneously hypertensive rats. J Nucl Med. 1997;38:470–474. pmid:9074541
  46. 46. Chang WH, Lee IH, Chen KC, Chi MH, Chiu NT, Yao WJ, et al. Oxytocin receptor gene rs53576 polymorphism modulates oxytocin-dopamine interaction and neuroticism traits-a SPECT study. Psychoneuroendocrinology. 2014;47:212–220. pmid:25001970
  47. 47. Van Eijsden E, Vrijkotte TGM, Gemke RJBJ, van der Wal MF. Cohort Profile: The Amsterdam Born Children and their Development (ABCD) study. International Journal of Epidemiology. 2011;40:1176–1186. pmid:20813863
  48. 48. Van Dijk AE, van Lien R, van Eijsden M, Gemke RJ, Vrijkotte TG, de Geus EJ. Measuring cardiac autonomic nervous system (ANS) activity in children. Journal of Visualized Experiments. 2013;74:e50073.
  49. 49. Riese H, Groot PF, van den Berg M, Kupper NH, Magnee EH, Rohaan EJ, et al. Large-scale ensemble averaging of ambulatory impedance cardiograms. Behavior Research Methods, Instruments, & Computers. 2003;35:467–477.
  50. 50. Quigley KS, Stifter CA. A comparative validation of sympathetic reactivity in children and adults. Psychophysiology. 2006;43:357–365. pmid:16916431
  51. 51. Smarius LJ, Strieder TG, Loomans EM, Doreleijers TA, Vrijkotte TG, Gemke RJ, et al. Excessive infant crying doubles the risk of mood and behavioral problems at age 5: evidence for mediation by maternal characteristics. European Child and Adolescent Psychiatry. 2017;26:293–302. pmid:27422707
  52. 52. Knight RG, Williams S, McGee R, Olaman S. Psychometric properties of the Centre for Epidemiologic Studies Depression Scale (CES-D) in a sample of women in middle life. Behaviour research and therapy. 1997;35:373–380. pmid:9134792
  53. 53. Van Dijk A E, van Eijsden M, Stronks K, Gemke R J, Vrijkotte TG. Prenatal stress and balance of the child's cardiac autonomic nervous system at age 5–6 years. PLoS One. 2012;7: e30413. pmid:22272345
  54. 54. Robinson CC, Mandleco B, Olsen SF, Hart CH. The Parenting Styles and Dimensions Questionnaire (PSDQ). In: Perlmutter BF, Touliatos J, Holden GW,Editors, Handbook of family measurement techniques. Thousand Oaks, Sage, London. 2001. p. 319–321.
  55. 55. De Brock AJLL, Vermulst AA, Gerris JRM, Abidin RR, In Dutch: ‘Nijmeegse Ouderlijke Stress Index’ (NOSI)/ Parenting Stress Index. 1992.
  56. 56. Henry JD, Crawford JR. The short-form version of the Depression Anxiety Stress Scales (DASS-21): construct validity and normative data in a large non-clinical sample. The British Journal of clinical psychology/ the British Psychological Society. 2005;44:227–239.