Hostname: page-component-848d4c4894-x24gv Total loading time: 0 Render date: 2024-05-10T01:43:01.531Z Has data issue: false hasContentIssue false
  • English
  • Français

Heart rate (variability) and the association between relational peer victimization and internalizing symptoms in elementary school children

Published online by Cambridge University Press:  29 April 2019

Pia Behnsen ,
Joanne Marieke Buil ,
Susanne Koot ,
Anja Huizink  and
Pol van Lier
Pia Behnsen*
Affiliation:
Department of Clinical, Neuro- and Developmental Psychology, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
Joanne Marieke Buil
Affiliation:
Department of Clinical, Neuro- and Developmental Psychology, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
Susanne Koot
Affiliation:
Department of Clinical, Neuro- and Developmental Psychology, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
Anja Huizink
Affiliation:
Department of Clinical, Neuro- and Developmental Psychology, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, Netherlands School of Health & Education, University of Skövde, Skövde, Sweden
Pol van Lier
Affiliation:
Department of Clinical, Neuro- and Developmental Psychology, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
*
Author for correspondence: Pia Behnsen, Department of Clinical, Neuro- and Developmental Psychology, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Van der Boechorststraat 1, 1081 BTAmsterdam, Netherlands; E-mail: p.m2.behnsen@vu.nl.
Get access Rights & Permissions [Opens in a new window]

Abstract

Relational victimization typically emerges first during the elementary school period, and has been associated with increased levels of internalizing symptoms in children. Individual differences in autonomic nervous system functioning have been suggested as a potential factor linking social stressors and internalizing symptoms. The aim of this study was therefore to examine whether heart rate and heart rate variability mediated the association between relational victimization and internalizing symptoms in 373 mainstream elementary school children. Children were assessed in 2015 (T0; Grades 3–5, M age = 9.78 years, 51% boys) and reassessed in 2016 (T1). Heart rate and heart rate variability were assessed during a regular school day at T1. A multi-informant (teacher and peer report) cross-time measure of relational victimization, and a multi-informant (self- and teacher report) measure of internalizing problems at T1 was used. Results showed that heart rate variability, but not heart rate, mediated the association between relational victimization and internalizing symptoms. This study provides tentative support that in children from a general population sample, a psychobiological factor may mediate the association of relational victimization with internalizing symptoms.

Keywords

autonomic nervous systemchildreninternalizing symptomsrelational victimization
Type
Regular Articles
Information
Development and Psychopathology , Volume 32 , Issue 2 , May 2020 , pp. 521 - 529
Copyright
Copyright © Cambridge University Press 2019

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Asparouhov, T., & Muthen, B. (2012). General random effect latent variable modeling: Random subjects, items, contexts, and parameters. Paper presented at the annual meeting of the National Council on Measurement in Education, Vancouver, British Columbia.Google Scholar
Baron, R. M., & Kenny, D. A. (1986). The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51, 1173–1179. doi:10.1037//0022-3514.51.6.1173CrossRefGoogle ScholarPubMed
Beauchaine, T. P. (2001). Vagal tone, development, and Gray's motivational theory: Toward an integrated model of autonomic nervous system functioning in psychopathology. Development and Psychopathology, 13, 183–214. doi:10.1017/s0954579401002012CrossRefGoogle ScholarPubMed
Beauchaine, T. P., Gatzke-Kopp, L., & Mead, H. K. (2007). Polyvagal theory and developmental psychopathology: Emotion dysregulation and conduct problems from preschool to adolescence. Biological Psychology, 74, 174–184. doi:10.1016/j.biopsycho.2005.08.008CrossRefGoogle Scholar
Beauchaine, T. P., & Thayer, J. F. (2015). Heart rate variability as a transdiagnostic biomarker of psychopathology. International Journal of Psychophysiology, 98, 338–350. doi:10.1016/j.ijpsycho.2015.08.004CrossRefGoogle ScholarPubMed
Behnsen, P., Buil, M., Koot, S., Huizink, A., & van Lier, P. (2018). Classroom social experiences in early elementary school relate to diurnal cortisol levels. Psychoneuroendocrinology, 87, 1–8. doi:10.1016/j.psyneuen.2017.09.025CrossRefGoogle ScholarPubMed
Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588–597. doi:10.1037//0033-2909.88.3.588CrossRefGoogle Scholar
Bernardi, L., Valle, F., Coco, M., Calciati, A., & Sleight, P. (1996). Physical activity influences heart rate variability and very-low-frequency components in Holter electrocardiograms. Cardiovascular Research, 32, 234–237. doi:10.1016/0008-6363(96)0008-8CrossRefGoogle ScholarPubMed
Berntson, G. G., & Cacioppo, J. T. (2004). Heart rate variability: Stress and psychiatric conditions. In Malik, M. & Camm, A. J. (Eds.), Dynamic electrocardiography (pp. 57–64). New York: Blackwell.CrossRefGoogle Scholar
Björkqvist, K., Lagerspetz, K. M., & Kaukiainen, A. (1992). Do girls manipulate and boys fight? Developmental trends in regard to direct and indirect aggression. Aggressive Behavior, 18, 117–127.3.0.CO;2-3>CrossRefGoogle Scholar
Carskadon, M. A., & Acebo, C. (1993). A self-administered rating scale for pubertal development. Journal of Adolescent Health, 14(3), 190–195. doi:10.1016/1054-139x(93)90004-9CrossRefGoogle ScholarPubMed
Chandola, T., Heraclides, A., & Kumari, M. (2010). Psychophysiological biomarkers of workplace stressors. Neuroscience & Biobehavioral Reviews, 35, 51–57. doi:10.1016/j.neubiorev.2009.11.005CrossRefGoogle ScholarPubMed
Chorpita, B. F., Yim, L., Moffitt, C., Umemoto, L. A., & Francis, S. E. (2000). Assessment of symptoms of DSM-IV anxiety and depression in children: A revised child anxiety and depression scale. Behaviour Research and Therapy, 38, 835–855. doi:10.1016/s0005-7967(99)00130-8CrossRefGoogle ScholarPubMed
Coie, J. D., Dodge, K. A., & Kupersmidt, J. B. (1990). Peer group behavior and social status. Peer Rejection in Childhood, 17. doi:10.2307/1130747Google Scholar
Craig, W. M. (1998). The relationship among bullying, victimization, depression, anxiety, and aggression in elementary school children. Personality and Individual Differences, 24, 123–130. doi:10.1016/s0191-8869(97)00145-1CrossRefGoogle Scholar
Crick, N. R., & Bigbee, M. A. (1998). Relational and overt forms of peer victimization: A multiinformant approach. Journal of Consulting and Clinical Psychology, 66, 337–347. doi:10.1037//0022-006x.66.2.337CrossRefGoogle ScholarPubMed
Crick, N. R., & Grotpeter, J. K. (1996). Children's treatment by peers: Victims of relational and overt aggression. Development and Psychopathology, 8, 367–380. doi:10.1017/s0954579400007148CrossRefGoogle Scholar
Currie, C., Zanotti, C., Morgan, A., Currie, D., DeLooze, M., Roberts, C., … Barnekow, V. (2012). Social determinants of health and well-being among young people. Health Behaviour in School-aged Children (HBSC) study: International report from the 2009/2010 survey. Health Policy for Children and Adolescents, No. 6. Copenhagen, Denmark: WHO Regional Office for Europe.Google Scholar
De Geus, E. J., & Van Doornen, L. J. (1996). Ambulatory assessment of parasympathetic/sympathetic balance by impedance cardiography. In Fahrenberg, J. & Myrtek, M. (Eds.), Ambulatory assessment: Computer-assisted psychological and psychophysiological methods in monitoring and field studies (pp. 141–163). Ashland, OH: Hogrefe & Huber.Google Scholar
De Geus, E. J., Willemsen, G. H., Klaver, C. H., & van Doornen, L. J. (1995). Ambulatory measurement of respiratory sinus arrhythmia and respiration rate. Biological Psychology, 41, 205–227. doi:10.1016/0301-0511(95)05137-6CrossRefGoogle ScholarPubMed
De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A., Burgers, D. E., & Rabinowitz, J. (2015). The validity of the multi-informant approach to assessing child and adolescent mental health. Psychological Bulletin, 141, 858. doi:10.1037/a0038498CrossRefGoogle ScholarPubMed
de Wilde, A., Koot, H. M., & van Lier, P. A. (2016). Developmental links between children's working memory and their social relations with teachers and peers in the early school years. Journal of Abnormal Child Psychology, 44, 19–30. doi:10.1007/s10802-015-0053-4CrossRefGoogle ScholarPubMed
Dieleman, G. C., Huizink, A. C., Tulen, J. H., Utens, E. M., Creemers, H. E., van der Ende, J., & Verhulst, F. C. (2015). Alterations in HPA-axis and autonomic nervous system functioning in childhood anxiety disorders point to a chronic stress hypothesis. Psychoneuroendocrinology, 51, 135–150. doi:10.1016/j.psyneuen.2014.09.002CrossRefGoogle ScholarPubMed
Dietrich, A., Riese, H., Sondeijker, F. E., Greaves-Lord, K., van Roon, A. M., Ormel, J., … Rosmalen, J. G. (2007). Externalizing and internalizing problems in relation to autonomic function: A population-based study in preadolescents. Journal of the American Academy of Child & Adolescent Psychiatry, 46, 378–386. doi:10.1097/chi.0b013e31802b91eaCrossRefGoogle ScholarPubMed
El-Sheikh, M., Harger, J., & Whitson, S. M. (2001). Exposure to interparental conflict and children's adjustment and physical health: The moderating role of vagal tone. Child Development, 72, 1617–1636. doi:10.1111/1467-8624.00369CrossRefGoogle ScholarPubMed
Erasmus, M. C. (2000). Problem behavior at school interview. Unpublished manuscript, Rotterdam, the Netherlands: Erasmus, MC, Department of Child and Adolescent Psychiatry.Google Scholar
Galeev, A. R., Igisheva, L. N., & Kazin, E. M. (2002). Heart rate variability in healthy six- to sixteen-year-old children. Human Physiology, 28, 428–432. doi:10.1203/00006450-198408000-00075CrossRefGoogle ScholarPubMed
Gini, G., Card, N. A., & Pozzoli, T. (2018). A meta-analysis of the differential relations of traditional and cyber-victimization with internalizing problems. Aggressive Behavior, 44, 185–198. doi:10.1002/ab.21742CrossRefGoogle ScholarPubMed
Hastings, P. D., Nuselovici, J. N., Utendale, W. T., Coutya, J., McShane, K. E., & Sullivan, C. (2008). Applying the polyvagal theory to children's emotion regulation: Social context, socialization, and adjustment. Biological Psychology, 79, 299–306. doi:10.1016/j.biopsycho.2008.07.005CrossRefGoogle Scholar
Hinnant, J. B., & El-Sheikh, M. (2009). Children's externalizing and internalizing symptoms over time: The role of individual differences in patterns of RSA responding. Journal of Abnormal Child Psychology, 37, 1049–1055. doi:10.1007/s10802-009-9341-1CrossRefGoogle ScholarPubMed
Jarrin, D. C., McGrath, J. J., Poirier, P., Séguin, L., Tremblay, R. E., Montplaisir, J. Y., … Séguin, J. R. (2015). Short-term heart rate variability in a population-based sample of 10-year-old children. Pediatric Cardiology, 36, 41–48. doi:10.1007/s00246-014-0962-yCrossRefGoogle Scholar
Kagan, J., Snidman, N., Zentner, M., & Peterson, E. (1999). Infant temperament and anxious symptoms in school age children. Development and Psychopathology, 11, 209–224. doi:10.1017/s0954579499002023CrossRefGoogle ScholarPubMed
Kario, K. (2010). Morning surge in blood pressure and cardiovascular risk: evidence and perspectives. Hypertension, 56(5), 765–773. doi:10.1161/hypertensionaha.110.157149CrossRefGoogle Scholar
Kraemer, H. C., Measelle, J. R., Ablow, J. C., Essex, M. J., Boyce, W. T., & Kupfer, D. J. (2003). A new approach to integrating data from multiple informants in psychiatric assessment and research: Mixing and matching contexts and perspectives. American journal of psychiatry, 160(9), 1566–1577. doi:10.1176/appi.ajp.160.9.1566CrossRefGoogle Scholar
Ladd, G. W., & Kochenderfer-Ladd, B. (2002). Identifying victims of peer aggression from early to middle childhood: Analysis of cross-informant data for concordance, estimation of relational adjustment, prevalence of victimization, and characteristics of identified victims. Psychological Assessment, 14, 74. doi:10.1037/1040-3590.14.1.74CrossRefGoogle ScholarPubMed
Leadbeater, B. J., & Hoglund, W. L. G. (2009). The effects of peer victimization and physical aggression on changes in internalizing from first to third grade. Child Development, 80, 843–859. doi:10.1111/j.1467-8624.2009.01301.xCrossRefGoogle Scholar
Lenard, Z., Studinger, P., Mersich, B., Kocsis, L., & Kollai, M. (2004). Maturation of cardiovagal autonomic function from childhood to young adult age. Circulation, 110, 2307–2312.CrossRefGoogle ScholarPubMed
Marsh, H. W., Hau, K. T., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentlers (1999) findings. Structural Equation Modeling, 11, 320–341. doi:10.1207/s15328007sem1103_2CrossRefGoogle Scholar
McHugh, B., Dawson, N., Scrafton, A., & Asen, E. (2010). “Hearts on their sleeves”: The use of systemic biofeedback in school settings. Journal of Family Therapy, 32, 58–72. doi:10.1111/j.1467-6427.2009.00486.xCrossRefGoogle Scholar
McLaughlin, K. A., Hatzenbuehler, M. L., & Hilt, L. M. (2009). Emotion dysregulation as a mechanism linking peer victimization to internalizing symptoms in adolescents. Journal of Consulting and Clinical Psychology, 77, 894. doi:10.1037/a0015760CrossRefGoogle ScholarPubMed
Mendle, J., Leve, L. D., Van Ryzin, M., & Natsuaki, M. N. (2014). Linking childhood maltreatment with girls' internalizing symptoms: early puberty as a tipping point. Journal of research on adolescence, 24(4), 689–702. doi:10.1111/jora.12075CrossRefGoogle ScholarPubMed
Michels, N., Sioen, I., Clays, E., De Buyzere, M., Ahrens, W., Huybrechts, I., … De Henauw, S. (2013). Children's heart rate variability as stress indicator: Association with reported stress and cortisol. Biological Psychology, 94, 433–440. doi:10.1016/j.biopsycho.2013.08.005CrossRefGoogle ScholarPubMed
Miller, G. E., Chen, E., & Zhou, E. S. (2007). If it goes up, must it come down? Chronic stress and the hypothalamic-pituitary-adrenocortical axis in humans. Psychological Bulletin, 133, 25–45. doi:10.1037/0033-2909.133.1.25CrossRefGoogle ScholarPubMed
Monk, C., Kovelenko, P., Ellman, L. M., Sloan, R. P., Bagiella, E., Gorman, J. M., & Pine, D. S. (2001). Enhanced stress reactivity in paediatric anxiety disorders: Implications for future cardiovascular health. International Journal of Neuropsychopharmacology, 4, 199–206. doi:10.1017/s146114570100236xCrossRefGoogle ScholarPubMed
Munoz, M. L., van Roon, A., Riese, H., Thio, C., Oostenbroek, E., Westrik, I., … Snieder, H. (2015). Validity of (ultra-) short recordings for heart rate variability measurements. PLoS One, 10(9). doi:10.1371/journal.pone.0138921CrossRefGoogle ScholarPubMed
Murray-Close, D. (2013). Psychophysiology of adolescent peer relations: I. Theory and research findings. Journal of Research on Adolescence, 23, 236–259. doi:10.1111/j.1532-7795.2012.00828.xCrossRefGoogle Scholar
Murray-Close, D., Crick, N. R., Tseng, W. L., Lafko, N., Burrows, C., Pitula, C., & Ralston, P. (2014). Physiological stress reactivity and physical and relational aggression: The moderating roles of victimization, type of stressor, and child gender. Development and Psychopathology, 26, 589–603. doi:10.1017/s095457941400025xCrossRefGoogle ScholarPubMed
Muthen, L. K., & Muthen, B. O. (1998). Mplus [Computer software]. Los Angeles: Author.Google Scholar
Natsuaki, M. N., Klimes-Dougan, B., Ge, X., Shirtcliff, E. A., Hastings, P. D., & Zahn-Waxler, C. (2009). Early pubertal maturation and internalizing problems in adolescence: Sex differences in the role of cortisol reactivity to interpersonal stress. Journal of Clinical Child and Adolescent Psychology, 38, 513–524. doi:10.1080/15374410902976320CrossRefGoogle ScholarPubMed
Neumann, A., Van Lier, P. A., Frijns, T., Meeus, W., & Koot, H. M. (2011). Emotional dynamics in the development of early adolescent psychopathology: A one-year longitudinal study. Journal of Abnormal Child Psychology, 39, 657–669. doi:10.1007/s10802-011-9509-3CrossRefGoogle ScholarPubMed
Newman, M. L. (2014). Here we go again: Bullying history and cardiovascular responses to social exclusion. Physiology & Behavior, 133, 76–80. doi:10.1016/j.physbeh.2014.05.014CrossRefGoogle ScholarPubMed
Petersen, A. C., Crockett, L., Richards, M., & Boxer, A. (1988). A self-report measure of pubertal status: Reliability, validity, and initial norms. Journal of Youth and Adolescence, 17, 117–133. doi:10.1007/bf01537962CrossRefGoogle ScholarPubMed
Pittig, A., Arch, J. J., Lam, C. W., & Craske, M. G. (2013). Heart rate and heart rate variability in panic, social anxiety, obsessive–compulsive, and generalized anxiety disorders at baseline and in response to relaxation and hyperventilation. International Journal of Psychophysiology, 87, 19–27. doi:10.1016/j.ijpsycho.2012.10.012CrossRefGoogle ScholarPubMed
Polanczyk, C., Rohde, L., Moraes, R., Ferlin, E., Leite, C., & Ribeiro, J. P. (1998). Sympathetic nervous system representation in time and frequency domain indices of heart rate variability. European Journal of Applied Physiology and Occupational Physiology, 79, 69–73. doi:10.1007/s004210050475CrossRefGoogle ScholarPubMed
Porges, S. W. (2001). The polyvagal theory: Phylogenetic substrates of a social nervous system. International Journal of Psychophysiology, 42, 123–146. doi:10.1016/s0167-8760(01)00162-3CrossRefGoogle ScholarPubMed
Porges, S. W. (2005). The role of social engagement in attachment and bonding. Attachment and bonding, 33–54.Google Scholar
Porges, S. W. (2007). The polyvagal perspective. Biological Psychology, 74, 116–143. doi:10.1016/j.biopsycho.2006.06.009CrossRefGoogle ScholarPubMed
Preacher, K. J., & Hayes, A. F. (2004). SPSS and SAS procedures for estimating indirect effects in simple mediation models. Behavior research methods, instruments, & computers, 36(4), 717–731. doi:10.3758/bf03206553CrossRefGoogle ScholarPubMed
Prinstein, M. J., Cheah, C. S., & Guyer, A. E. (2005). Peer victimization, cue interpretation, and internalizing symptoms: Preliminary concurrent and longitudinal findings for children and adolescents. Journal of Clinical Child and Adolescent Psychology, 34, 11–24. doi:10.1207/s15374424jccp3401_2CrossRefGoogle ScholarPubMed
Rose, A. J., & Rudolph, K. D. (2006). A review of sex differences in peer relationship processes: Potential trade-offs for the emotional and behavioral development of girls and boys. Psychological Bulletin, 132, 98–112. doi:10.1037/0033-2909.132.1.98CrossRefGoogle ScholarPubMed
Scarpa, A., & Raine, A. (1997). Psychophysiology of anger and violent behavior. Psychiatric Clinics of North America, 20, 375–394. doi:10.1016/S0193-953X(05)70318-XCrossRefGoogle ScholarPubMed
Sijtsema, J. J., Van Roon, A. M., Groot, P. F. C., & Riese, H. (2015). Early life adversities and adolescent antisocial behavior: The role of cardiac autonomic nervous system reactivity in the TRAILS study. Biological Psychology, 110, 24–33. doi:10.1016/j.biopsycho.2015.06.012CrossRefGoogle ScholarPubMed
Sinnreich, R., Kark, J. D., Friedlander, Y., Sapoznikov, D., & Luria, M. H. (1998). Five minute recordings of heart rate variability for population studies: Repeatability and age–sex characteristics. Heart, 80, 156–162. doi:10.1136/hrt.80.2.156CrossRefGoogle ScholarPubMed
Spear, L. P. (2009). Heightened stress responsivity and emotional reactivity during pubertal maturation: Implications for psychopathology. Development and Psychopathology, 21, 87–97. doi:10.1017/s0954579409000066CrossRefGoogle ScholarPubMed
Statistics Netherlands (2001). Survey Working Population 2001 (Enquête Beroepsbevolking 2001).Google Scholar
Tanaka, H., Monahan, K. D., & Seals, D. R. (2001). Age-predicted maximal heart rate revisited. Journal of the American College of Cardiology, 37, 153–156. doi:10.1016/s0735-1097(00)01054-8CrossRefGoogle ScholarPubMed
Umetani, K., Singer, D. H., McCraty, R., & Atkinson, M. (1998). Twenty-four hour time domain heart rate variability and heart rate: Relations to age and gender over nine decades. Journal of the American College of Cardiology, 31, 593–601. doi:10.1016/s0735-1097(97)00554-8CrossRefGoogle ScholarPubMed
Vaillancourt, T., Hymel, S., & McDougall, P. (2013). The biological underpinnings of peer victimization: Understanding why and how the effects of bullying can last a lifetime. Theory Into Practice, 52, 241–248. doi:10.1080/00405841.2013.829726CrossRefGoogle Scholar
van der Wal, M. F., de Wit, C. A. M., & Hirasing, R. A. (2003). Psychosocial health among young victims and offenders of direct and indirect bullying. Pediatrics, 111, 1312–1317. doi:10.1542/peds.111.6.1312CrossRefGoogle Scholar
van Dijk, A. E., van Lien, R., van Eijsden, M., Gemke, R. J., Vrijkotte, T. G., & de Geus, E. J. (2013). Measuring cardiac autonomic nervous system (ANS) activity in children. Journal of Visualized Experiments, 74, 50073. doi:10.3791/50073Google Scholar
van Lier, P. A. C., Vitaro, F., Barker, E. D., Brendgen, M., Tremblay, R. E., & Boivin, M. (2012). Peer victimization, poor academic achievement, and the link between childhood externalizing and internalizing problems. Child Development, 83, 1775–1788. doi:10.1111/j.1467-8624.2012.01802.xCrossRefGoogle ScholarPubMed
Veenstra, R., Lindenberg, S., Oldehinkel, A. J., de Winter, A. F., Verhulst, F. C., & Ormel, J. (2005). Bullying and victimization in elementary schools: A comparison of bullies, victims, bully/victims, and uninvolved preadolescents. Developmental Psychology, 41, 672–682. doi:10.1037/0012-1649.41.4.672CrossRefGoogle ScholarPubMed
Will, G. J., van Lier, P. A., Crone, E. A., & Güroğlu, B. (2016). Chronic childhood peer rejection is associated with heightened neural responses to social exclusion during adolescence. Journal of Abnormal Child Psychology, 44, 43–55. doi:110.1007/s10802-015-9983-0CrossRefGoogle ScholarPubMed
Williams, K. D., Forgas, J. P., & Von Hippel, W. (2013). The social outcast: Ostracism, social exclusion, rejection, and bullying. London: Psychology Press.Google Scholar
Williams, R. L. (2000). A note on robust variance estimation for cluster-correlated data. Biometrics, 56, 645–646. doi:10.1111/j.0006-341x.2000.00645.xCrossRefGoogle ScholarPubMed
Zwierzynska, K., Wolke, D., & Lereya, T. S. (2013). Peer victimization in childhood and internalizing problems in adolescence: A prospective longitudinal study. Journal of Abnormal Child Psychology, 41, 309–323. doi:10.1007/s10802-012-9678-8CrossRefGoogle ScholarPubMed