Methods: The evaluation employed both quantitative and qualitative methods, assessing the model implementation process and its fidelity, the outcomes, and the impact of the training. Multiple perspectives were included, as data were obtained from trainees (self-administered questionnaires), behavioral health consumers whom they served (phone interviews), participant observation by the evaluators, and written logs of trainees. Approaches to analysis of these data involved statistics, coding of logs and analyzing field notes, which entailed identification of critical incidents, and their unfolding in field notes and videotapes, and a comparison between module objectives and implementation.

Results: The results of aspects of the process assessment, qualitative and quantitative outcomes of the core trainees, and the consumer impact assessment will be presented, as will the challenges and successes of utilizing the various approaches to evaluating a training program, including measurement issues, and the combining of quantitative and qualitative data.

Implications: It is advantageous for social work evaluators to employ a variety of quantitative and qualitative methods when evaluating diversity training programs. Outcomes of diversity training need to be assessed intermittently over time, as change in attitudes toward diverse groups is a non-linear process. Similarly, cultural competency training for social work practitioners needs to be given over a number of months to be effective. Social work researchers need to focus efforts on modifying existing measures or developing new measures to assess culturally competent practice. Developing research strategies for assessing the impact of practitioner training on their clients is essential for assessing the effectiveness of training of practitioners, whether it is diversity training or evidence-based practice. Further, the results also have implications for social work-client interactions.