Sunday, 15 January 2006: 8:45 AM-10:15 AM
Power Analysis for Advanced Statistical Models
Speaker/Presenter:Shenyang Guo, PhD, University of North Carolina at Chapel Hill
Abstract Text:
Purpose: Ever since Jacob Cohen published his milestone book in 1977, statistical power analysis has been widely recognized as a crucial component for a rigorous analysis of quantitative data by social behavioral scientists. Power analysis is model-specific, that is, its exact method and formula vary by statistical method. Advanced statistical models developed recently, however, are not covered by the Cohen's framework. There is an increasing need among social work researchers to understand power analysis for these models. In this workshop we attempt to review the power analytic frameworks for three advanced models (i.e., hierarchical linear modeling or HLM, event history analysis or EHA, and structural equation modeling or SEM), and demonstrate how to run these analyses with free software packages and SAS syntax using real examples of social work research.

Contents: The workshop will focus on the following topics:

1. Review of the Cohen's framework and key concepts – the overall goal of power analysis is to find an appropriate balance among four factors: statistical significance or probability of making type I error, power or probability of rejecting a false hypothesis, the minimum detectable effect of an experiment or effect size, and needed sample size.

2. HLM – the specific frameworks of power analysis for HLM were developed by Raudenbush and his colleagues, including optimal design for cluster randomized trial (Raudenbush, 1997), for multisite randomized trials (Raudenbush & Liu, 2000), and for repeated measures (Raudenbush & Liu, 2001). Statistical precision is a key factor affecting power of HLM. We will demonstrate how to conduct these analyses using free software OD (http://www.ssicentral.com/other/hlmod.htm).

3. EHA – the specific framework of power analysis for EHA was developed by Collett (1994). In EHA, effect size is defined as hazard ratio (i.e., the ratio of hazard rate of one group over that of the other group). We will demonstrate how to conduct the analysis using free software PS (http://biostat.mc.vanderbilt.edu/twiki/bin/view/Main/PowerSampleSize).

4. SEM – among several frameworks of power analysis for SEM, the most popular one was developed by MacCallum and his colleagues (1996), which evaluates power of SEM based on effect size of RMSEA for close fit, for not-close fit, and for comparing nested models. We will demonstrate how to conduct these analyses using the SAS syntax developed by MacCallum.

Pedagogical Techniques: Teaching methods include lecture, PowerPoint presentation, and computer demonstration.

References

Collett, D. (1994). Modeling Survival Data in Medical Research. London: Chapman & Hall. Chapter 9.

Raudenbush, S.W. (1997). “Statistical analysis and optimal design for cluster randomized trials”, Psychological Methods 2(2): 173-185.

Raudenbush, S.W., & Liu, X.F. (2000). “Statistical power and optimal design for multisite randomized trials”, Psychological Methods 5(2): 199-213.

Raudenbush, S.W., & Liu, X.F. (2001). “Effects of study duration, frequency of observation, and sample size on power in studies of group differences in polynomial change”, Psychological Methods 6(4): 387-401.

MacCallum, R.C., Browne, M.W., & Sugawara, H.M. (1996). “Power analysis and determination of sample size for covariance structure modeling”, Psychological Methods 1(2): 130-149.

See more of Workshop

See more of Meeting the Challenge: Research In and With Diverse Communities (January 12 - 15, 2006)