Program Evaluation In Language Education

by Rea-Dickins, Pauline; Kiely, Richard

• ISBN13: 9781403945709
• ISBN10: 1403945705
• Format: Hardcover
• Copyright: 2005-11-29
• Publisher: Palgrave Macmillan

Summary

This book constitutes both a text for students of evaluation and a guide for those readers undertaking evaluations or research into evaluation processes. Part 1 explores the background to language program evaluation, examining the specific traditions of language program assessment, the wider context of social program evaluation, and the growing industry of quality management and mandate compliance. Part 2 sets out a series of evaluation case studies (some previously unpublished) that examine issues such as language across the curriculum, the native speaker teacher, the primary language curriculum, evaluation for quality management, and stakeholding. Each case examines the policy-making, program management and professional practice dimensions of programs, and explores how these relate to evaluation constructs and procedures. Part 3 provides a guide to evaluation practice and research. It looks at large-scale evaluations, teacher-led evaluations and management-led evaluations, examining in each case purpose, design, evaluation research, impact, stakeholding and ethicality perspectives. Part 4 provides a comprehensive set of resouces for those commissioning, undertaking or researching language program evaluations. Book jacket.

Author Biography

Richard Kiely is a Lecturer in the Graduate School of Education and Pauline Rea-Dickins is Professor of Applied Linguistics in Education, both at the Graduate School of Education, University of Bristol.

Table of Contents

General Editors' Preface	xi
Acknowledgements	xii
Part 1 Departure Points	1	(72)
Introduction	3	(2)
Themes and Challenges	5	(12)
Introduction	5	(1)
Three features of evaluation	5	(2)
Five challenges for evaluation	7	(9)
Summary	16	(1)
Historical Perspectives: Focus on Design and Method	17	(20)
Introduction	17	(1)
Early judgements	18	(1)
Early evaluations	19	(4)
Evaluation as measurement and comparison	23	(3)
Evaluation as a focus on worth and development	26	(4)
Evaluation standards	30	(2)
New theoretical perspectives	32	(4)
Summary	36	(1)
Historical Perspectives: Focus on Context and Use	37	(19)
Introduction	37	(1)
Use of evaluation	37	(3)
Constructivism in evaluation	40	(4)
Realism in evaluation	44	(2)
Political dimensions of evaluation	46	(4)
Compliance with mandates	50	(4)
Summary	54	(2)
Historical Perspectives: Language Program Evaluation and Applied Linguistics	56	(17)
Introduction	56	(1)
Evaluation in language education and Applied Linguistics	56	(3)
Language program evaluations	59	(12)
Language evaluation outside language teaching programmes	71	(1)
Summary	72	(1)
Part 2 Cases and Issues	73	(148)
Introduction	75	(2)
Evaluating Teachers' English Language Competence	77	(22)
Introduction	77	(1)
Context	77	(1)
Scope and aims of the evaluation	78	(2)
Evaluation planning	80	(1)
Articulating constructs and procedures	81	(15)
Evaluation implementation and implications	96	(2)
Summary	98	(1)
Evaluating a Language through Science Program	99	(20)
Introduction	99	(1)
Context	99	(3)
Aims and scope of the evaluation	102	(2)
Evaluation design	104	(7)
Some findings	111	(4)
Implications for evaluation	115	(2)
Summary	117	(2)
Evaluating the Contribution of the Native Speaker Teacher	119	(17)
Introduction	119	(1)
Context	119	(3)
Aims and scope of the evaluation	122	(2)
Evaluation design	124	(3)
Data collection	127	(1)
Some findings	128	(1)
Implications for evaluation	129	(4)
Afterword--15 years on	133	(1)
Summary	134	(2)
Evaluating Foreign Language Teaching in Primary Schools	136	(14)
Introduction	136	(2)
Context	138	(3)
Aims and scope of the evaluation	141	(1)
Design of the evaluation	142	(3)
Data collection	145	(2)
Implications for evaluation	147	(2)
Summary	149	(1)
Evaluating Program Quality in Higher Education	150	(11)
Introduction	150	(1)
Context	150	(1)
Aims and scope of the evaluation	151	(3)
Design of the evaluation	154	(2)
Implications for evaluation	156	(4)
Summary	160	(1)
Evaluating the Student Experience in Higher Education	161	(17)
Introduction	161	(1)
Context	161	(1)
Aims and scope of the evaluation	162	(7)
Data collection	169	(4)
Implications for evaluation	173	(4)
Summary	177	(1)
Evaluating Assessment Standards and Frameworks	178	(22)
Introduction	178	(5)
Evaluation study 1: Evaluation of national and state frameworks for the assessment of learners of English as an additional language	183	(7)
Evaluation study 2: The Centre for Canadian Language Benchmarks	190	(7)
Implications for evaluation practice	197	(2)
Summary	199	(1)
Stakeholding in Evaluation	200	(21)
Introduction	200	(2)
Understanding stakeholding	202	(4)
Modes of stakeholder involvement	206	(8)
Stakeholding and the locus of control	214	(4)
Summary	218	(3)
Appendix 12.1 Student action points	219	(1)
Appendix 12.2 Focus group instruments	219	(2)
Part 3 Evaluation Practice and Research	221	(52)
Introduction	223	(2)
Large-scale Evaluations	225	(21)
Introduction	225	(1)
Understanding large-scale evaluations	225	(6)
How will you validate the evaluation issues and questions?	231	(2)
Which evaluation procedures will you use, and why, and how will you analyse your data?	233	(3)
Why and how will you develop evaluation skills?	236	(4)
What are the constraints that you will be working with in your evaluation?	240	(4)
Developing ethical mindfulness	244	(1)
Summary	245	(1)
Teacher-led Evaluations	246	(9)
Introduction	246	(1)
The scope of teacher-led evaluations	246	(1)
Evaluation projects	247	(3)
Sample projects	250	(4)
Summary	254	(1)
Management-led Evaluation Projects	255	(18)
Introduction	255	(1)
The scope of management-led evaluations	255	(1)
Evaluation projects	255	(6)
Sample projects	261	(10)
Summary	271	(2)
Part 4 Resources	273	(16)
Resources for Language Program Evaluation	275	(14)
Introduction	275	(1)
Books	275	(3)
Journals	278	(4)
Professional associations	282	(1)
Ethical guides and best practice codes	283	(1)
Email lists and bulletin boards	284	(1)
Additional internet resources	285	(4)
Postscript	289	(3)
Bibliography	292	(15)
Index	307