The Equivalence of Direct and Semi-direct Speaking Tests

by Kieran J. O'Loughlin

• ISBN13: 9780521667937
• ISBN10: 0521667933
• Format: Paperback
• Copyright: 2001-10-08
• Publisher: Cambridge University Press

Summary

The Equivalence of Direct and Semi-Direct Speaking Tests documents a comparability study of direct (face-to-face) and semi-direct (language laboratory) versions of the speaking component of the access test: an English language test designed in the 1990s as part of the selection process for immigration to Australia. In the study the issue of test equivalence is explored using a range of quantitative and qualitative evidence including test scores, test taker language output and feedback from various 'players' in the test process including members of the development team, test candidates, interviewers and raters. The findings have important implications for the use of direct and semi-direct speaking tests in various high-stakes contexts such as immigration and university entrance. As such this will be of interest to policy-makers and administrators as well as language teachers and language testing researchers.

Table of Contents

Series Editor's note	vii
Preface	ix
Acknowledgements	xi
Introduction	1	(32)
Rationale	1	(1)
Methodological approach	2	(1)
Structure of the book	3	(1)
Direct, semi-direct and indirect speaking tests	4	(2)
Establishing the equivalence of direct and semi-direct tests	6	(6)
Research findings	12	(19)
Conclusion	31	(2)
The access: test	33	(14)
Background to the test	33	(1)
Development of the test	34	(1)
The oral interaction sub-test	35	(10)
Conclusion	45	(2)
Methodology	47	(15)
The instrumental case study approach	47	(8)
Research design of the study	55	(6)
Summary	61	(1)
Trial 1: The analysis of test scores	62	(18)
Overview	62	(1)
The December 1992 trial	62	(3)
A preliminary study	65	(4)
The current study	69	(10)
Conclusion	79	(1)
Trial 1: The analysis of candidate language output	80	(37)
Overview	80	(1)
Rationale	80	(1)
Methodology	81	(3)
Discourse Study A: The qualitative analysis	84	(16)
Discourse Study B: Lexical density	100	(15)
Conclusion	115	(2)
Trial 2: The study of test processes	117	(28)
Introduction	117	(1)
The June 1994 trial	117	(4)
Method	121	(4)
Findings	125	(18)
Conclusion	143	(2)
Trial 2: The analysis of test scores	145	(18)
Introduction	145	(1)
Analysis with anchored item difficulty estimates	145	(5)
Analysis with unanchored item difficulty estimates	150	(7)
Bias analysis	157	(4)
Conclusion	161	(2)
Summary and conclusions	163	(10)
Overview	163	(1)
Summary of findings	163	(6)
Implications of findings	169	(4)
References	173	(7)
Appendices	180	(96)
Subject index	276	(2)
Author index	278