Score Reliability : Contemporary Thinking on Reliability Issues

by Bruce Thompson

• ISBN13: 9780761926269
• ISBN10: 0761926267
• eBook ISBN(s): 9781452214269
• Format: Paperback
• Copyright: 2002-08-12
• Publisher: SAGE Publications, Inc
• More Book Details

Summary

"This is a book that should be on the desk of anyone truly concerned with reliability. The whole question of conditional reliabilities is current and important; and, the question of reliability generalization is being opened out and moving away from Cronbach's approach. The topic is an important one."--Richard L. Gorsuch, Director of Research in Graduate School of Psychology, Fuller Theological Seminary Should a high school diploma be awarded to students based on their score on a final exit exam? Should businesses deny employment to people based on their score on a personality test? In a world of "high stakes" testing, it has become more important than ever to make certain the scores on which we base our decisions are reliable. Aimed at helping researchers create and evaluate scores better, this reader presents the basic concepts of classical (or "true score") and modern ("generalizability") test theory. Beginning with a review of reliability and validity issues in measurement, the book covers score reliability, reliability induction, and reliability generalization. Exercises with sample data are included at the end of each section so readers can demonstrate knowledge of the principles.

Table of Contents

Preface	ix
PART I. Basic Concepts in Score Reliability	1	(88)
Understanding Reliability and Coefficient alpha, Really	3	(28)
Bruce Thompson
Exercise Set #1	24	(7)
Correcting Effect Sizes for Score Reliability: A Reminder That Measurement and Substantive Issues Are Linked Inextricably	31	(12)
Frank Baugh
A Brief Introduction to Generalizability Theory	43	(16)
Bruce Thompson
Reliability Methods: A Note on the Frequency of Use of Various Types	59	(10)
Thomas P. Hogan
Amy Benjamin
Kristen L. Brezinski
Confidence Intervals About Score Reliability Coefficients	69	(20)
Xitao Fan
Bruce Thompson
Exercise Set #2	85	(4)
PART II. The Nature of Reliability	89	(66)
Guidelines for Authors Reporting Score Reliability Estimates	91	(12)
Bruce Thompson
Reliability as Psychometrics Versus Datametrics	103	(20)
Shlomo S. Sawilowsky
Psychometrics Is Datametrics: The Test Is Not Reliable	123	(26)
Bruce Thompson
Tammi Vacha-Haase
Reliability: Rejoinder to Thompson and Vacha-Haase	149	(6)
Shlomo S. Sawilowsky
PART III. Reliability Induction and Reporting Practices	155	(46)
Sample Compositions and Variabilities in Published Studies Versus Those in Test Manuals: Validity of Score Reliability Inductions	157	(16)
Tammi Vacha-Haase
Lori R. Kogan
Bruce Thompson
How Well Do Researchers Report Their Measures? An Evaluation of Measurement in Published Educational Research	173	(18)
Dale Whittington
The Degree of Congruence Between Test Standards and Test Documentation Within Journal Publications	191	(10)
Audrey L. Qualls
Angela D. Moss
Exercise Set #3	199	(2)
PART IV. Reliability Generalization	201	(80)
Reliability Generalization: Exploring Variance in Measurement Error Affecting Score Reliability Across Studies	203	(16)
Tammi Vacha-Haase
Assessing the Reliability of Beck Depression Inventory Scores: Reliability Generalization Across Studies	219	(26)
Ping Yin
Xitao Fan
Measurement Error in ``Big Five Factors'' Personality Assessment: Reliability Generalization Across Studies and Measures	245	(14)
Chockalingam Viswesvaran
Deniz S. Ones
Reliability Generalization of the NEO Personality Scales	259	(22)
John C. Caruso
Exercise Set #4	278	(3)
Index	281	(2)
About the Editor	283