Using Apps to Recruit YMSM: A Cost and Recruitment Efficiency Analysis of App-Based Probability Sampling Procedures Compared with Venue-Based Procedures

Background and Purpose: Substance use studies examining young men who have sex with men (YMSM; age 18-24) have historically relied on samples recruited from venues (e.g., gay bars) that arguably condone substance use. Although rigorous, venue-based probability recruitment methods for this population are costly. Additionally, YMSM are increasingly using smartphone geosocial networking applications (GSNA; e.g., Grindr) rather than venues to find sexual partners and to connect with the gay community. GSNA allow for probability sampling methods and recent research indicates these methods to be a cost-efficient alterative to venue-based recruitment. To date, no known study has investigated how GSNA-based and venue-based sampling procedures compare. Therefore, the aim of this study is to examine the cost and recruitment efficiency of venue-based and GSNA-based YMSM recruitment methods.

Methods: A crossectional survey conducted in Los Angeles, CA, recruited 136 YMSM (68 using venue-based probability methods and 68 using innovative GSNA-based methods). Costs (i.e., recruitment preparation, recruitment implementation, software/hardware) of each method were tracked throughout the entire study process. Each recruitment period tracked the number of men approached, number of men who were eligible to take the study, and number of men who ultimately completed the study. Recruitment periods were analysed using t-tests to look at differences in the number of men approached, eligible, and completing the survey.

Results: Overall, GSNA recruitment methods cost 68% less than venue-based methods. GSNA recruitment preparation took 80% less time compared to the time required for venue-based methods. Findings for recruitment efficiency indicate that significantly more men were approached for the venue method to reach the same sample size as the GSNA method. 

Conclusions and Implications: GSNA appear to demonstrate feasibility (i.e., low cost and high efficiency) as a tool for recruiting YMSM. By lowering cost of research and maintaining the methodological rigor of probability sampling, GSNA have the potential to dramatically increase the amount of research being conducted with YMSM. Additionally, this methodology has meaningful applications to rural and international populations of men in areas where being gay or bisexual may have stigmatizing societal consequences. In these regions, men often do not have venues and places of safety in which to gather, but instead must rely on digital methods of connection. Therefore, future research should consider application of this methodology to these more hidden population of YMSM.