Uncommon Measures : Equivalence and Linkage among Educational Tests

by National Research Council (U. S.); Holland, Paul W.; Green, Gert F.; Bertenthal, Meryl W.; Hemphill, F. Cadelle; Feuer, Michael J.

• ISBN13: 9780309062794
• ISBN10: 0309062799
• Format: Paperback
• Copyright: 1999-01-01
• Publisher: Natl Academy Pr

Summary

The issues surrounding the comparability of various tests used to assess performance in schools received broad public attention during congressional debate over the voluntary national tests proposed by President Clinton in his 1997 State of the Union Address. Proponents of voluntary national tests argue that there is no widely understood, challenging benchmark of individual student performance in 4th-grade reading and 8th-grade mathematics, thus the need for a new test. Opponents argue that a statistical linkage among tests already used by states and districts might provide the sort of comparability called for by the president's proposal.This book reviews the research literature on the statistical and technical aspects of creating valid links between tests and how the content, use, and purposes of education testing in the United States influences the quality and meaning of those links. The book summarizes relevant prior linkage studies and presents a picture of the diversity of state testing programs. It,also looks at the unique characteristics of the National Assessment of Educational Progress.This book recommends that ultimately policymakers and educators must take responsibility for determining the degree of imprecision they are willing to tolerate in testing and linking. This book provides science-based information with which to make those decisions.

Table of Contents

EXECUTIVE SUMMARY	1	(6)
1 TESTS AND THE CHALLENGE OF LINKAGE	7	(13)
Background	8	(2)
Committee's Approach	10	(2)
Drawing Inferences from Tests	12	(3)
Drawing Inferences from Linked Tests	15	(5)
2 TECHNICAL ASPECTS OF LINKS	20	(28)
Constructing Links	21	(5)
Common Problems in Links	26	(16)
Evaluating Links	42	(5)
One Final Caution	47	(1)
3 CHALLENGES OF LINKING TO NAEP	48	(13)
Distinct Character of NAEP	49	(2)
Linking to NAEP	51	(6)
Challenges to the Validity of Linkage to NAEP	57	(4)
4 TESTS AND TESTING IN THE UNITED STATES: A PICTURE OF DIVERSITY	61	(26)
Types of Tests	62	(5)
Test Content	67	(4)
Testing in States and Districts	71	(16)
5 CONCLUSIONS	87	(7)
Factors that Affect the Validity of Links	87	(4)
Conclusions	91	(1)
Future Research	92	(2)
REFERENCES	94	(7)
GLOSSARY	101	(13)
BIOGRAPHICAL SKETCHES	114