Skip to main content
SpringerLink
Log in

Examining Implementation and Sustainability of Positive Behavior Support in Child Care Centers

  • Original Paper
  • Published:
Child & Youth Care Forum Aims and scope Submit manuscript

Abstract

Background

This study was the first attempt to investigate the status of implementation and sustainability of early childhood positive behavior support (PBS) via the lens of implementation science for community-based child care centers in a Midwest state of the United States.

Objective

Obtain state-level data and gain insights on PBS implementation and sustainability in target child care centers.

Method

Through a total population sampling method, we recruited administrators (N = 94, 12% of the full population) of target child care centers to participate in a survey.

Results

The results suggested that the majority of the responding centers (59.57%) had not received PBS professional development (PD) indicating PBS PD opportunities had not been disseminated in the majority of community-based child care centers in the target state. Nearly half of the programs were not implementing PBS practices after they received PBS PD, which raised questions about continuous use of PBS and the return on investment of PBS PD efforts. The results of ANOVA found that the scope of PBS training significantly affected the level of PBS implementation; the type of training significantly affected the level of PBS sustainability. Simple linear regression revealed programs that had a higher level of PBS implementation also had a higher level of PBS sustainability.

Conclusions

Using implementation science theories and tools, we developed two preliminary measures to obtain meaningful information about early childhood PBS implementation and sustainability in community-based child care centers. Understanding the factors associated with implementation can provide insights for the improvement of PD programs when disseminating the use of evidence-based PBS practices.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

Data availability

The data and materials of this study are available upon request.

References

  • Blasé, K., Van Dyke, M., & Fixsen, D. (2013). Stages of implementation analysis: Where are we? FPG Child Development Institute, University of North Carolina.

    Google Scholar 

  • Branson, D., & Demchak, M. (2011). Toddler teachers’ use of teaching pyramid practices. Topics in Early Childhood Special Education, 30, 196–208. https://doi.org/10.1177/0271121410369184

    Article  Google Scholar 

  • Briggs-Gowan, M. J., Carter, A. S., Skuban, E. M., & Horwitz, S. M. (2001). Prevalence of social-emotional and behavioral problems in a community sample of 1-and 2-year-old children. Journal of the American Academy of Child and Adolescent Psychiatry, 40, 811–819. https://doi.org/10.1097/00004583-200107000-00016

    Article  PubMed  Google Scholar 

  • Conroy, M. A., Sutherland, K. S., Vo, A. K., Carr, S., & Ogston, P. L. (2014). Early childhood teachers’ use of effective instructional practices and the collateral effects on young children’s behavior. Journal of Positive Behavior Interventions, 16, 81–92. https://doi.org/10.1177/1098300713478666

    Article  Google Scholar 

  • Cook, B. G., & Odom, S. L. (2013). Evidence-based practices and implementation science in special education. Exceptional Children, 79, 135–144. https://doi.org/10.1177/001440291307900201

    Article  Google Scholar 

  • Council and on Early Childhood, APP Committee on Psychosocial Aspects of Child and Family Health, APP Section on Developmental and Behavioral Pediatrics, , 2016 AAP Council on Early Childhood, APP Committee on Psychosocial Aspects of Child and Family Health, APP Section on Developmental and Behavioral Pediatrics (2016). Addressing early childhood emotional and behavioral problems. Pediatrics. 138(6): e20163023. https://doi.org/10.1542/peds.2016-3023

  • DeWire, T., McKithen, C., & Carey, R. (2017). Scaling up evidence-based practices: Strategies from investing in innovation (i3) (p. 14). Retrieved from Westat, Inc.; Education Development Center, Inc. (EDC); EdScale, LLC website: https://files.eric.ed.gov/fulltext/ED577030.pdf

  • Division for Early Childhood of the Council for Exceptional Children (2017). Position statement on challenging behavior and young children. Retrieved from https://www.decdocs.org/position-statement-challenging-beha

  • Dougherty, L. R., Leppert, K. A., Merwin, S. M., Smith, V. C., Bufferd, S. J., & Kushner, M. R. (2015). Advances and directions in preschool mental health research. Child Development Perspectives, 9, 14–19. https://doi.org/10.1111/cdep.12099

    Article  Google Scholar 

  • Dunlap, G., Carr, E. G., Horner, R. H., Koegel, R. L., Sailor, W., Clarke, S., Koegel, L. K., Albin, R. W., Vaughn, B. J., McLaughlin, D. M., & James, K. M. (2010). A descriptive, multiyear examination of positive behavior support. Behavioral Disorders, 35, 259–279. https://doi.org/10.1177/019874291003500401

    Article  Google Scholar 

  • Dunlap, G., Wilson, K., Strain, P., & Lee, J. (2013). Prevent-teach-reinforce for young children: The early childhood model of individualized positive behavior support. Paul Brookes Publishing.

    Google Scholar 

  • Dunst, C. J., & Trivette, C. M. (2009). Capacity-building family-systems intervention practices. Journal of Family Social Work, 12(2), 119–143. https://doi.org/10.1080/10522150802713322

    Article  Google Scholar 

  • Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350. https://doi.org/10.1007/s10464-008-9165-0

    Article  PubMed  Google Scholar 

  • Etikan, I., Musa, S. A., & Alkassim, R. S. (2016). Comparison of convenience sampling and purposive sampling. American Journal of Theoretical and Applied Statistics. https://doi.org/10.11648/j.ajtas.20160501.11

    Article  Google Scholar 

  • Fixsen, D. L., & Blase, K. A. (2008). Drivers framework. Chapel Hill, NC: The National Implementation Research Network, Frank Porter Graham Child Development Institute, University of North Carolina

  • Fixsen, D. L., Blase, K., Naoom, S., Metz, A., Louison, L., & Ward, C. (2015). Implementation drivers: Assessing best practices. Chapel Hill, NC: The National Implementation Research Network, Frank Porter Graham Child Development Institute, University of North Carolina.

  • Fox, L., Dunlap, G., Hemmeter, M. L., Joseph, G. E., & Strain, P. S. (2003). The teaching pyramid: A model for supporting social competence and preventing challenging behavior in young children. Young Children, 58, 48–52. https://www.jstor.org/stable/42728957

  • Fox, L., Hemmeter, M. L., & Snyder, P. (2014). Teaching pyramid observation tool (TPOT) for preschool classrooms (research). . Paul H. Brookes.

    Google Scholar 

  • Fox, L., Hemmeter, M. L., Jack, S., & Perez-Binder, D. (2017). Early childhood program-wide PBS benchmarks of quality. National Center for Pyramid Model Innovations. https://challengingbehavior.cbcs.usf.edu/docs/BoQ_EarlyChildhood_Program-Wide.pdf

  • Franks, R. P., & Schroeder, J. (2013). Implementation science: What do we know and where do we go from here. In T. Halle, A. Metz, & I. Martinez-Beck (Eds.), Applying implementation science in early childhood programs and systems (pp. 5–20). Paul H Brookes Publishing.

    Google Scholar 

  • Gage, N. A., Freeman, J., Horner, R. H., Sugai, G., Lewis, T. J., & Strickland-Cohen, K. (2014). Funding support for school-wide positive behavioral interventions and support implementation and scale-up: A descriptive study of nine states. Journal of Disability Policy Studies, 25, 164–174. https://doi.org/10.1177/1044207313488943

    Article  Google Scholar 

  • Gross, D., Sambrook, A., & Fogg, L. (1999). Behavior problems among young children in low-income urban day care centers. Research in Nursing and Health, 22, 15–25. https://doi.org/10.1002/(SICI)1098-240X(199902)22:1%3c15::AID-NUR3%3e3.0.CO;2-2

    Article  PubMed  Google Scholar 

  • Halle, T., Metz, A., & Martinez-Beck, I. (2013). Applying implementation science in early childhood programs and systems. Paul H Brookes.

    Google Scholar 

  • Hemmeter, M. L., Fox, L., & Hardy, J. K. (2016a). Supporting the implementation of tiered models of behavior support in early childhood settings. In B. Reichow, B. Doyd, E. Barton, & S. Odom (Eds.), Handbook of Early Childhood Special Education (pp. 247–266). Springer International Publishing.

    Chapter  Google Scholar 

  • Hemmeter, M. L., Snyder, P. A., Fox, L., & Algina, J. (2016b). Evaluating the implementation of the pyramid model for promoting social-emotional competence in early childhood classrooms. Topics in Early Childhood Special Education, 36, 133–146. https://doi.org/10.1177/0271121416653386

    Article  Google Scholar 

  • IBM Corp. (2017). IBM SPSS Statistics for Macintosh, Version 25.0. Armonk, NY: IBM Corp.

  • Institute of Medicine and National Research Council. (2009). Preventing mental, emotional, and behavioral disorders among young people: Progress and possibilities. The National Academies Press.

    Google Scholar 

  • Johnson, L. D. (2017). Scaling the pyramid model across complex systems providing early care for preschoolers: Exploring how models for decision making may enhance implementation science. Early Education and Development, 28(7), 822–838. https://doi.org/10.1080/10409289.2017.1286205

    Article  Google Scholar 

  • Kaiser, A. P., Hancock, T. B., Cai, X., Foster, E. M., & Hester, P. P. (2000). Parent-reported behavior problems and language delays in boys and girls enrolled in Head Start classrooms. Behavioral Disorders, 26, 26–41. https://doi.org/10.1177/019874290002600104

    Article  Google Scholar 

  • Kansas Department of Health & Environment (2019). FY10 total facility county and total capacity. Retrieved from https://www.kdheks.gov/bcclr/facilities/Facility_and_Capacity_Summary_FY19.pdf

  • Kansas Institute for Positive Behavior Support (KIPBS). (2013). Kansas mental health and positive behavior support: Ten years of Kansas institute for positive behavior support (KIPBS) evaluation data (2001–2012). Retrieved from http://kipbs.org/sc/files/kmhpbs-kipbs-10-year-data.pdf

  • Kansas Institute for Positive Behavior Support (KIPBS). (2014). Kansas mental health positive behavior support: Executive summary of progress and accomplishments. Retrieved from http://kipbs.org/sc/files/kmhpbs-final-report.pdf

  • Kelly, B., & Perkins, D. F. (Eds.). (2012). Handbook of implementation science for psychology in education. Cambridge University Press.

    Google Scholar 

  • Kincaid, D., Dunlap, G., Kern, L., Lane, K. L., Bambara, L. M., Brown, F., Fox, L., & Knoster, T. P. (2016). Positive behavior support: A proposal for updating and refining the definition. Journal of Positive Behavior Interventions, 18, 69–73. https://doi.org/10.1177/1098300715604826

    Article  Google Scholar 

  • Knoster, T. (2018). Commentary: Evolution of positive behavior support and future directions. Journal of Positive Behavior Interventions, 20, 23–26. https://doi.org/10.1177/1098300717735056

    Article  Google Scholar 

  • Lavigne, J. V., LeBailly, S. A., Hopkins, J., Gouze, K. R., & Binns, H. J. (2009). The prevalence of ADHD, ODD, Depression, and Anxiety in a community sample of 4-yearolds. Journal of Clinical Child and Adolescent Psychology, 38, 315–328. https://doi.org/10.1080/15374410902851382

    Article  PubMed  Google Scholar 

  • Lowery, J. L. (2015). National survey on leadership capacity and scaling-up of PBIS implementation. (Doctoral dissertation) Retrieved from http://aquila.usm.edu/dissertations/204

  • Lucyshyn, J. M., Dunlap, G., & Freeman, R. (2015). A historical perspective on the evolution of positive behavior support as a science-based discipline. In F. Brown, J. Anderson, & R. DePry (Eds.), Individual positive behavior supports: A standards-based guide to practices in school and community based settings (pp. 3–25). Paul H. Brookes Publishing.

    Google Scholar 

  • McIntosh, K., Doolittle, J., Vincent, C. G., Horner, R. H., & Ervin, R. A. (2009). School-wide universal behavior sustainability index: School teams. University of British Columbia.

    Google Scholar 

  • McIntosh, K., MacKay, L. D., Hume, A. E., Doolittle, J., Vincent, C. G., Horner, R. H., & Ervin, R. A. (2011). Development and initial validation of a measure to assess factors related to sustainability of school-wide positive behavior support. Journal of Positive Behavior Interventions, 13, 208–218. https://doi.org/10.1177/1098300710385348

    Article  Google Scholar 

  • McIntosh, K., Mercer, S. H., Hume, A. E., Frank, J. L., Turri, M. G., & Mathews, S. (2013). Factors related to sustained implementation of schoolwide positive behavior support. Exceptional Children, 79, 293–311.

    Google Scholar 

  • McIntosh, K., Mercer, S. H., Nese, R. N. T., Strickland-Cohen, M. K., Kittelman, A., Hoselton, R., & Horner, R. H. (2018). Factors predicting sustained implementation of a universal behavior support framework. Educational Researcher, 47, 307–316. https://doi.org/10.3102/0013189X18776975

    Article  Google Scholar 

  • Metz, A., Naoom, S.F., Halle, T., & Bartley, L. (2015). An integrated stage-based framework for implementation of early childhood programs and systems (OPRE Research Brief OPRE 201548). Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.

  • Morse, J. M. (1991). Strategies for sampling. In Morse, J.M. (Ed.), Qualitative nursing research: A contemporary dialogue (pp. 127–145). SAGE Publications, Inc., https://doi.org/10.4135/9781483349015.n16

  • National Center for Pyramid Model Innovations (NCPMI) (n.d.). National Center for Pyramid Model Innovations. https://challengingbehavior.cbcs.usf.edu/

  • Nevo, B. (1985). Face validity revisited. Journal of Educational Measurement, 22, 287–293. https://doi.org/10.1111/j.1745-3984.1985.tb01065.x

    Article  Google Scholar 

  • O’Conner, R., De Feyter, J., Carr, A., Luo, J. L., & Romm, H. (2017). A review of the literature on social and emotional learning for students ages 3–8: Characteristics of effective social and emotional learning programs (part 1 of 4) (REL 2017–245). Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Mid-Atlantic. Retrieved from http://ies.ed.gov/ncee/edlabs

  • Perry, D. F., & Kaufmann, R. K. (2009). Integrating early childhood mental health consultation with the pyramid model (p. 5). Retrieved from Technical Assistance Center on Social Emotional Intervention for Young Children, National Center for Effective Mental Health Consultation website: https://challengingbehavior.cbcs.usf.edu/docs/IssueBrief_integrating-ECMHC.pdf

  • Qi, C. H., & Kaiser, A. P. (2003). Behavior problems of preschool children from low income families: Review of the literature. Topics in Early Childhood Special Education, 23, 188–216. https://doi.org/10.1177/02711214030230040201

    Article  Google Scholar 

  • Rock L. & Crow S. (2017) Not just “soft skills”: How young children’s learning & health benefit from strong social-emotional development. Too Small To Fail. Retrieve from: http://toosmall.org/resources/TSTF-SED-Whitepaper.pdf

  • Ross, S. W., Romer, N., & Horner, R. H. (2012). Teacher well-being and the implementation of school-wide positive behavior interventions and supports. Journal of Positive Behavior Interventions, 14, 118–128. https://doi.org/10.1177/1098300711413820

    Article  Google Scholar 

  • Sarama, J., & Clements, D. H. (2013). Lessons learned in the implementation of the TRIAD scale-up model. In T. Halle, A. Metz, & I. Martinez-Beck (Eds.), Applying implementation science in early childhood programs and systems.Baltimore, MD: Paul H. Brookes Publishing Company.

    Google Scholar 

  • Smith, S. C., & Bost, L. W. (2007). Collecting post-school outcome data: Strategies for Increasing response rates. Retrieved from National Post-School Outcomes Center website: https://files.eric.ed.gov/fulltext/ED575738.pdf

  • Smith, B., & Fox, L. (2003). Systems of service delivery: A synthesis of evidence relevant to young children at risk of or who have challenging behavior. Tampa: University of South Florida, Center for Evidence-Based Practice: Young Children with Challenging Behavior. Retrieved from.

  • Snyder, P. A., Hemmeter, M. L., & Fox, L. (2015). Supporting implementation of evidence-based practices through practice-based coaching. Topics in Early Childhood Special Education, 35, 133–143. https://doi.org/10.1177/0271121415594925

    Article  Google Scholar 

  • Steed, E. A., & Pomerleau, T. M. (2012). Preschool-wide evaluation tool (PreSET) manual: Assessing universal program-wide positive behavior support in early childhood (Research edition). Paul H. Brookes Publishing Co.

  • Sugai, G., & Horner, R. (2019). 20+ years of PBIS: Precorrections, big ideas, & key investments. OSEP Center on PBIS Office of Special Education Programs Center on Positive Behavioral Interventions and Supports. Retrieved from https://assets-global.website-files.com/5d3725188825e071f1670246/5daa327e4a3d9c710b12e76d_CAL%20PBIS%20big%20ideas%20%26%20investments%2028Oct%202019%20HAND.pdf

  • U.S. Department of Education Office for Civil Rights Data. (2014, March). Data snapshot: School discipline (Issue Brief No. 1). Civil Rights Data Collection. Retrieved from http://www.ed.gov/ocr

  • U.S. Department of Health and Human Services & U.S. Department of Education (U.S. DHHS & U.S. DE). (2016). Policy statement on expulsion and suspension policies in early childhood settings. Retrieved from http://www.acf.hhs.gov/sites/default/files/ecd/expulsion_suspension_final.pdf

  • Vinh, M., Strain, P., Davidon, S., & Smith, B. J. (2016). One state’s systems change efforts to reduce child care expulsion: Taking the pyramid model to scale. Topics in Early Childhood Special Education, 36, 159–164. https://doi.org/10.1177/0271121415626130

    Article  Google Scholar 

Download references

Acknowledgements

We thank center administrators and consultants for their participation. We thank the professional organizations for disseminating the survey. We thank Drs. Judith Carta, Steven Warren, Greg Cheatham, and Jose Martinez for their supports during the study. We thank the Office of Planning Research and Evaluation (OPRE) for funding this study.

Funding

This research is funded by the OPRE, Administration for Children and Families, Department of Health and Human Services. Grant # 90YE0207.

Author information

Authors and Affiliations

  1. Juniper Gardens Children’s Project, University of Kansas, 444 Minnesota Avenue, Suite 300, Kansas City, KS, 66101-2914, US

    Jun Ai & Kathryn M. Bigelow

  2. Department of Special Education, University of Kansas, Joseph R. Pearson Hall, Rm. 502, 1122 W. Campus Rd, Lawrence, KS, 66045-3101, US

    Eva M. Horn

Authors
  1. Jun Ai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eva M. Horn
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kathryn M. Bigelow
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jun Ai.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ai, J., Horn, E.M. & Bigelow, K.M. Examining Implementation and Sustainability of Positive Behavior Support in Child Care Centers. Child Youth Care Forum 51, 267–290 (2022). https://doi.org/10.1007/s10566-021-09627-z

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10566-021-09627-z

Keywords

Search

Navigation