Measuring Mentoring Outcomes Using Administrative Data: Results from a Child Welfare Study and a School Study
摘要
Friends of the Children (FOTC) partnered with ICF in 2016 to conduct a set of studies in seven FOTC chapters to assess school-related outcomes, child-welfare outcomes, and caregiver perceptions of program benefits. The first two of these studies—the School Study and the Child Welfare Study—used a quasi-experimental design in which school and child welfare administrative records (respectively) were used to compare FOTC youth with a comparison group of youth not enrolled in the program on key outcomes of interest. Analyses for most outcomes did not reveal statistically significant effects for FOTC youth in the early years of program involvement. However, the Child Welfare Study revealed a promising pattern of findings related to reduced time in care for FOTC youth, and the study of caregivers suggested potential program benefits for continued study. We experienced significant challenges obtaining and working with administrative data, a problem which has important implications for our conclusions. In this chapter, we present our experiences and findings from these three studies and provide insights for other researchers and programs hoping to use administrative data for future research.