Comparing Groups Randomization and Bootstrap Methods Using R

by Zieffler, Andrew S.; Harring, Jeffrey R.; Long, Jeffrey D.

• ISBN13: 9780470621691
• ISBN10: 0470621699
• Edition: 1st
• Format: Hardcover
• Copyright: 2011-06-15
• Publisher: Wiley

Summary

This book, written by three behavioral scientists for other behavioral scientists, addresses common issues in statistical analysis for the behavioral and educational sciences. Modern Statistical & Computing Methods for the Behavioral and Educational Sciences using R emphasizes the direct link between scientific research questions and data analysis. Purposeful attention is paid to the integration of design, statistical methodology, and computation to propose answers to specific research questions. Furthermore, practical suggestions for the analysis and presentation of results, in prose, tables and/or figures, are included. Optional sections for each chapter include methodological extensions for readers desiring additional technical details. Rather than focus on mathematical calculations like so many other introductory texts in the behavioral sciences, the authors focus on conceptual explanations and the use of statistical computing. Statistical computing is an integral part of statistical work, and to support student learning in this area, examples using the R computer program are provided throughout the book. Rather than relegate examples to the end of chapters, the authors interweave computer examples with the narrative of the book. Topical coverage includes an introduction to R, data exploration of one variable, data exploration of multivariate data - comparing two groups and many groups, permutation and randomization tests, the independent samples t-Test, the Bootstrap test, interval estimates and effect sizes, power, and dependent samples.

Author Biography

Andrew S. Zieffler, PhD, is Lecturer in the Department of Educational Psychology at the University of Minnesota. Dr. Zieffler has published numerous articles in his areas of research interest, which include the measurement and assessment in statistics education research and statistical computing.

Jeffrey R. Harring, PhD, is Assistant Professor in the Department of Measurement, Statistics, and Evaluation at the University of Maryland. Dr. Harring currently focuses his research on statistical models for repeated measures data and nonlinear structural equation models.

Jeffrey D. Long, PhD, is Professor of Psychiatry in the Carver College of Medicine at The University of Iowa and Head Statistician for Neurobiological Predictors of Huntington's Disease (PREDICT-HD), a longitudinal NIH-funded study of early detection of Huntington's disease. His interests include the analysis of longitudinal and time-to-event data and ordinal data.

Table of Contents

List of Figures.

List of Tables.

Foreword.

Preface.

Acknowledgments.

1. An Introduction to R.

1.1 Getting Started.

1.2 Arithmetic: R as a Calculator.

1.3 Computations in R: Functions.

1.4 Connecting Computations.

1.5 Data Structures: Vectors.

1.6 Getting Help.

1.7 Alternative Ways to Run R.

1.8 Extension: Matrices and Matrix Operations.

1.9 Further Reading.

Problems.

2. Data Representation and Preparation.

2.1 Tabular Data.

2.2 Data Entry.

2.3 Reading Delimited Data into R.

2.4 Data Structure: Data Frames.

2.5 Recording Syntax using Script Files.

2.6 Simple Graphing in R.

2.7 Extension: Logical Expressions and Graphs for Categorical Variables.

2.8 Further Reading.

Problems.

3. Data Exploration: One Variable.

3.1 Reading in the Data.

3.2 Non-Parametric Density Estimation.

3.3 Summarizing the Findings.

3.4 Extension: Variability Bands for Kernel Densities.

3.5 Further Reading.

Problems.

4. Exploration of Multivariate Data: Comparing Two Groups.

4.1 Graphically Summarizing the Marginal Distribution.

4.2 Graphically Summarizing Conditional Distributions.

4.4 Numerical Summaries of Data: Estimates of the Population Parameters.

4.4 Summarizing the Findings.

4.5 Extension: Robust Estimation.

4.6 Further Reading. 

Problems.

5. Exploration of Multivariate Data: Comparing Many Groups.

5.1 Graphing Many Conditional Distributions.

5.2 Numerically Summarizing the Data.

5.3 Summarizing the Findings.

5.4 Examining Distributions Conditional on Multiple Variables.

5.5 Extension: Conditioning on Continuous Variables.

5.6 Further Reading.

Problems.

6. Randomization & Permutation Tests.

6.1 Randomized Experimental Research.

6.2 An Introduction to the Randomization Test.

6.3 Randomization Tests with Large Samples: Monte Carlo Simulation.

6.4 Validity of the Inferences and Conclusions Drawn from a Randomization Test.

6.5 Generalization from the Randomization Results.

6.6 Summarizing the Results for Publication.

6.7 Extension: Test of the Variance. 

Further Reading.

Problems. 

7. Bootstrap Tests.

7.1 Educational Achievement of Latino Immigrants.

7.2 Probability Models: An Interlude.

7.3 Theoretical Probability Models in R.

7.4 Parametric Bootstrap Tests.

7.5 The Parametric Bootstrap.

7.6 Implementing the Parametric Bootstrap in R.

7.7 Summarizing the Results of the Parametric Bootstrap Test.

7.8 Nonparametric  Bootstrap Tests.

7.9 Summarizing the Results for the Nonparametric Bootstrap Test.

7.10 Bootstrapping Using a Pivot Statistic.

7.11 Independence Assumption for the Bootstrap Methods.

7.12 Extension: Testing Functions.

7.13 Further Reading.

Problems.

8. Philosophical Considerations.

8.1 The Randomization Test vs. the Bootstrap Test.

8.2 Philosophical Frameworks of Classical Inference.

9. Bootstrap Intervals and Effect Sizes.

9.1 Educational Achievement Among Latino Immigrants: Example Revisited.

9.2 Plausible Models to Reproduce the Observed Result.

9.3 Bootstrapping Using an Alternative Model.

9.4 Interpretation of the Interval Estimate.

9.5 Adjusted Bootstrap Intervals.

9.6 Standardized Effect Size: Quantifying the Group Differences in a Common Metric.

9.7 Summarizing the Results.

9.8 Extension: Bootstrapping the Confidence Envelope for a Q-Q Plot.

9.9 Confidence Envelopes.

9.10 Further Reading.

Problems.

10. Dependent Samples.

10.1 Matching: Reducing the Likelihood of Non-Equivalent Groups.

10.2 Mathematics Achievement Study Design.

10.3 Randomization/Permutation Test for Dependent Samples.

10.4 Effect Size.

10.5 Summarizing the Results of a Dependent Samples Test for Publication.

10.6 To Match or Not to Match: That is the Question.

10.7 Extension: Block Bootstrap.

10.8 Further Reading.

Problems.

11. Planned Contrasts.

11.1 Planned Comparisons.

11.2 Examination of Weight Loss Conditioned on Diet.

11.3 From Research Questions to Hypotheses.

11.4 Statistical Contrasts.

11.5 Computing the Estimated Contrasts Using the Observed Data.

11.6 Testing Contrasts: Randomization Test.

11.7 Strength of Association: A Measure of Effect.

11.8 Contrast Sum of Squares.

11.9 Eta-Squared for Contrasts.

11.10 Bootstrap Interval for Eta-Squared.

11.11 Summarizing the Results of a Planned Contrast Test Analysis.

11.12 Extension: Orthogonal Contrasts.

11.13 Further Reading.

Problems.

12. Unplanned Contrasts.

12.1 Unplanned Comparisons.

12.2 Examination of Weight Loss Conditioned on Diet.

12.3 Omnibus Test.

12.4 Group Comparisons After the Omnibus Test.

12.5 Ensemble-Adjusted p-values.

12.6 Strengths and Limitations of the Four Approaches.

12.7 Summarizing the Results of Unplanned Contrast Tests for Publication.

12.8 Extension: Plots of the Unplanned Contrasts.

12.9 Further Reading.

Problems.

References.