The Benefits of Qualitative Pilot Studies in Social Work Research: The Case of Fathers in Reentry from Prison

Background

Despite the value of pilot studies in social work research generally, and their frequent use at different stages of survey and intervention research, pilots in qualitative inquiry are underutilized and underreported. We make the case that qualitative pilot studies have an important place in both qualitative research generally and when embedded as part of more positivistic research approaches such as intervention design and testing. In this study, qualitative research was conducted on an understudied topic—father involvement after incarceration—to inform future intervention development work. The study aims included: a) testing recruitment and data collection strategies, b) verifying sampling appropriateness, c) assessing the validity of the interview guide and survey instruments, d) determining comprehension and acceptability of protocols, and e) testing the use of genograms and ecomaps in the interview process. We used these verification strategies to inform adjustments in the main qualitative study, and to propose key elements for social work researchers to consider when planning a qualitative pilot study.

 

Methods

Participants included seven fathers released from prison in the previous 12-months who had children 12 years or younger with whom they had regular contact, as well as two mothers with children whose fathers met the criteria. Purposive, snowball sampling, and word of mouth recruitment strategies were used. Participants were compensated $40. Interviews were completed in a variety of locations, lasting on average 70 minutes. Participants were first interviewed about fathers’ experience in reentry from prison, followed by questions focused on their views of the content covered in the first part of the interview and on their experience participating in the qualitative pilot study. In other words, we interviewed them about the main topic of interest and then about their experience being in the study. Open, line-by-line coding of the interview transcripts was performed following transcription using Atlas.ti software. Analysis was guided by a grounded theory approach with the goal of identifying emergent codes, sub-categories and overarching themes.

 

Results

We identified four major themes (and sub-categories) reflecting feedback on the recruitment and interview process: (1) accessibility to the study (establishing mutual understanding between participant and researcher), (2) motivation to participate (improving family relationships and community conditions), (3) feedback and response (positive and critical input), and (4) reflections (experience of catharsis). Additionally, we share lessons learned and propose five central considerations for qualitative pilots drawing from an examination of our own experience conducting the pilot study with fathers recently released from prison. The key considerations focus on having clear study objectives, allowing time to make refinements, having an adequate sample size, and welcoming varied feedback from participants.

 

Implications

Qualitative pilot studies provide researchers with multiple opportunities for learning that can assist in study refinement and improvement. This study resulted in guidelines and lessons learned that may increase researchers’ likelihood of using and reporting on qualitative pilot studies. Such a step in the research process can increase rigor, inform future work, and aid in the systematization of pilot study implementation within social work research.