Friday, 13 January 2006 - 8:44 AM

Treatment Fidelity and the Independent Variable in Social Work Intervention Research

John G. Cagle, MSW, Virginia Commonwealth University and Matthias J. Naleppa, PhD, Virginia Commonwealth University.

Treatment fidelity and the independent variable in social work intervention research Purpose While there is ample focus on measuring the dependent variable in social work research, less attention is given to the independent variable. In order to ensure the fidelity of treatment procedures in intervention research, it is especially important to pay close attention to treatment implementation. Verification of clearly defined treatment protocols is essential for effective technology transfer, replication, and intervention comparisons. This study evaluates how treatment fidelity and the independent variable are measured in social work intervention research. Methodology Using an expanded version of evaluation criteria developed by Moncher and Prinz (1991), the authors conducted a content analysis of studies published in social work journals from 2000-2004. The sample included the five social work journals with the highest impact scores, i.e. Social Work, Social Work Research, Research on Social Work Practice, Health and Social Work, and Social Service Review (Institute for Scientific Information, 1997). The content analysis included studies that used experimental, quasi-experimental, or pre-experimental designs, as long as they were testing an intervention or program outcome. Post-test only and single-subject designs were included, if the independent variables were controlled or manipulated by the researcher. Research based on chart review, secondary data, or retrospective information was excluded. All eligible studies were evaluated based on seven criteria: clarity of treatment definition, implementer training, manualized treatment, supervision of treatment agents, identification of essential treatment components for verification, sampling to ensure treatment consistency, and use of fidelity data. Results Findings corroborate previous observations of a notable lack of intervention studies in social work research (e.g. Thyer, 2001; Rosen, Proctor, & Staudt, 1999). Of the 674 articles reviewed, only 58 (8.6%) were outcome studies that met the inclusion criteria (range from <1%-24.9% per journal). While 71.6% of the studies provided a definition for each independent variable, more than two-thirds (68.9%) lacked information on control measures for independent variables. Results also suggest that measures of treatment fidelity are seriously lacking. Of the studies reviewed, 56.8% lacked information on training, 52.7% made no mention of treatment manuals, 78.4% lacked supervision of treatment delivery, 87.8% did not sample for consistency, and 83.8% did not collect fidelity data. Implications Findings echo earlier calls for an increase in the number of social work outcome studies and tightened controls on the independent variable. The studies' limitations are reviewed and implications for social work practice and education are discussed. Recommendations are offered on how social work researchers can enhance treatment fidelity and implementer adherence in future research. Standards for measuring treatment fidelity will be presented. References: Institute for Scientific Information (1997). Journal citation reports. Philadelphia: Author. Moncher, F. & Prinz, R. (1991). Treatment fidelity in outcome studies. Clinical Psychology Review, 11, 247-266. Rosen, A., Proctor, E., & Staudt, M. (1999). Social work research and the quest for effective practice. Social Work Research, 23, 4-14. Thyer, B. (2001). What is the role of theory in research on social work practice? Journal of Social Work Education, 37, 9-25.

See more of Measuring the Effectiveness of Interventions
See more of Oral and Poster

See more of Meeting the Challenge: Research In and With Diverse Communities (January 12 - 15, 2006)