Methods: A post randomized consent trial was used, with 1,232 families in the target population (784 intervention, 448 comparison). The program successfully made contact with 452 (58%) of intervention cases, and 94 (12%) participated. Adoptive/ guardianship caregivers were included in the study if permanence occurred for their child after age 5 or the child had been in congregate care, and the child was currently between the ages of 10-13. 22 groups (154 sessions) were run, organized in 7 cohorts. A short questionnaire (10 questions) was distributed to all intervention and control cases after the fourth cohort, after it was determined that just 12% of eligible families were participating in the intervention, to assess differences that might emerge between groups in the study. The survey assessed such things as warmth in the relationship, struggling to manage the child’s behavior, confidence in meeting the child’s needs, and thoughts about ending the adoption/guardianship. Forty-three percent (n=244) responded to the questionnaire.
Results: Bivariate analysis revealed randomization created balanced intervention and control groups. However, important differences were found between those who self-selected out of the intervention sample (i.e., eligible intervention cases who did not participate) and those participated. Intervention participants were more likely to struggle to manage their child’s behavior (t=-2.52, df=98, p≤.05) and were less confident that they could meet the child’s needs (t=2.37, df=100, p≤.05) than parents/guardians in the control group. Differences were also found between intervention participants and intervention group non-participants. Intervention participants noted more struggles managing their child’s behavior (t=-2.31, df=165, p≤.05), more struggles to appropriately respond (t=-2.02, df=162, p≤.05), and were less confident that they could meet the child’s needs (t=2.76, df=168, p<.01). Based on these results, a propensity score model (PSM) was used to approximate a counterfactual within the comparison group, which was then used to create a data set that was balanced on covariates.
Conclusions/Implications: Randomization provided balanced samples, however, parents/guardians that were motivated to participate in the intervention differed noticeably from the control group overall and differed from the non-participants within the intervention sample, suggesting that randomization might not provide an appropriate counterfactual for intervention participants.