Dataset Shift in Machine Learning

by Quinonero-candela, Joaquin; Sugiyama, Masashi; Schwaighofer, Anton; Lawrence, Neil D.

• ISBN13: 9780262170055
• ISBN10: 0262170051
• Format: Hardcover
• Copyright: 2008-12-12
• Publisher: The MIT Press

Summary

Dataset shift is a common problem in predictive modeling that occurs when the joint distribution of inputs and outputs differs between training and test stages. Covariate shift, a particular case of dataset shift, occurs when only the input distribution changes. Dataset shift is present in most practical applications, for reasons ranging from the bias introduced by experimental design to the irreproducibility of the testing conditions at training time. (An example is -email spam filtering, which may fail to recognize spam that differs in form from the spam the automatic filter has been built on.) Despite this, and despite the attention given to the apparently similar problems of semi-supervised learning and active learning, dataset shift has received relatively little attention in the machine learning community until recently. This volume offers an overview of current efforts to deal with dataset and covariate shift. The chapters offer a mathematical and philosophical introduction to the problem, place dataset shift in relationship to transfer learning, transduction, local learning, active learning, and semi-supervised learning, provide theoretical views of dataset and covariate shift (including decision theoretic and Bayesian perspectives), and present algorithms for covariate shift. Contributors: Shai Ben-David, Steffen Bickel, Karsten Borgwardt, Michael Bruckner, David Corfield, Amir Globerson, Arthur Gretton, Lars Kai Hansen, Matthias Hein, Jiayuan Huang, Choon Hui Teo, Takafumi Kanamori, Klaus-Robert Muller, Sam Roweis, Neil Rubens, Tobias Scheffer, Marcel Schmittfull, Bernhard Scholkopf Hidetoshi Shimodaira, Alex Smola, Amos Storkey, Masashi Sugiyama Neural Information Processing series

Author Biography

Joaquin Quiñonero-Candela is a Researcher in the Online Services and Advertising Group at Microsoft Research Cambridge, U.K.

Masashi Sugiyama is Associate Professor in the Department of Computer Science at Tokyo Institute of Technology.

Anton Schwaighofer is an Applied Researcher in the Online Services and Advertising Group at Microsoft Research, Cambridge, U.K.

Neil D. Lawrence is Senior Lecturer and Member of the Machine Learning and Optimisation Research Group in the School of Computer Science at the University of Manchester.

Masashi Sugiyama is Associate Professor in the Department of Computer Science at Tokyo Institute of Technology.

Klaus-Robert Müller is Head of the Intelligent Data Analysis group at the Fraunhofer Institute and Professor in the Department of Computer Science at the Technical University of Berlin.

Alexander J. Smola is Senior Principal Researcher and Machine Learning Program Leader at National ICT Australia/Australian National University, Canberra.

Bernhard Schölkopf is Director at the Max Planck Institute for Intelligent Systems in Tübingen, Germany. He is coauthor of Learning with Kernels (2002) and is a coeditor of Advances in Kernel Methods: Support Vector Learning (1998), Advances in Large-Margin Classifiers (2000), and Kernel Methods in Computational Biology (2004), all published by the MIT Press.

Alexander J. Smola is Senior Principal Researcher and Machine Learning Program Leader at National ICT Australia/Australian National University, Canberra.

Table of Contents

Introduction to dataset shift	p. 1
When training and test sets are different: characterizing learning transfer	p. 3
Projection and projectability	p. 29
Theoretical views on dataset and covariate shift	p. 39
Binary classification under sample selection bias	p. 41
On Bayesian transduction: implications for the covariate shift problem	p. 65
On the training/test distributions gap: a data representation learning framework	p. 73
Algorithms for covariate shift	p. 85
Geometry of covariate shift with applications to active learning	p. 87
A conditional expectation approach to model selection and active learning under covariate shift	p. 107
Covariate shift by kernel mean matching	p. 131
Discriminative learning under covariate shift with a single optimization problem	p. 161
An adversarial view of covariate shift and a minimax approach	p. 179
Discussion	p. 199
Author comments	p. 201
References	p. 207
Notation and symbols	p. 219
Contributors	p. 223
Index	p. 227
Table of Contents provided by Blackwell. All Rights Reserved.