Advances in Neural Information Processing Systems 10

by Jordan, Michael I.; Kearns, Michael J.; Solla, Sara A.

• ISBN13: 9780262100762
• ISBN10: 0262100762
• Format: Hardcover
• Copyright: 1998-06-05
• Publisher: Bradford Books

Summary

The annual conference on Neural Information Processing Systems (NIPS) is the flagship conference on neural computation. It draws preeminent academic researchers from around the world and is widely considered to be a showcase conference for new developments in network algorithms and architectures. The broad range of interdisciplinary research areas represented includes computer science, neuroscience, statistics, physics, cognitive science, and many branches of engineering, including signal processing and control theory. Only about 30 percent of the papers submitted are accepted for presentation at NIPS, so the quality is exceptionally high. These proceedings contain all of the papers that were presented.

Table of Contents

Preface	xiii	(2)
NIPS Committees	xv	(2)
Reviewers	xvii
Part I Cognitive Science	3	(100)
Synchronized Auditory and Cognitive 40 Hz Attentional Streams, and the Impact of Rhythmic Expectation on Auditory Scene Analysis	3	(7)
Bill Baird
On Parallel versus Serial Processing: A Computational Study of Visual Search	10	(7)
Eyal Cohen
Eytan Ruppin
Task and Spatial Frequency Effects on Face Specialization	17	(7)
Matthew N. Dailey
Garrison W. Cottrell
Neural Basis of Object-Centered Representations	24	(7)
Sophie Deneve
Alexandre Pouget
A Neural Network Model of Native Preference and Filial Imprinting in the Domestic Chick	31	(7)
Lucy E. Hadden
Adaptation in Speech Motor Control	38	(7)
John F. Houde
Michael I. Jordan
Learning Human-like Knowledge by Singular Value Decomposition: A Progress Report	45	(7)
Thomas K. Landauer
Darrell Laham
Peter Foltz
Multi-modular Associative Memory	52	(7)
Nir Levy
David Horn
Eytan Ruppin
Serial Order in Reading Aloud: Connectionist Models and Neighborhood Structure	59	(7)
Jeanne C. Milostan
Garrison W. Cottrell
A Superadditive-Impairment Theory of Optic Aphasia	66	(7)
Michael C. Mozer
Mark Sitton
Martha Farah
A Hippocampal Model of Recognition Memory	73	(7)
Randall C. O'Reilly
Kenneth A. Norman
James L. McClelland
Correlates of Attention in a Model of Dynamic Visual Recognition	80	(7)
Rajesh P.N. Rao
Recurrent Neural Networks Can Learn to Implement Symbol-Sensitive Counting	87	(7)
Paul Rodriguez
Janet Wiles
Comparison of Human and Machine Word Recognition	94	(9)
Markus Schenkel
Cyril Latimer
Marwan Jabri
Part II Neuroscience	103	(142)
Coding of Naturalistic Stimuli by Auditory Midbrain Neurons	103	(7)
Hagai Attias
Christoph E. Schreiner
Refractoriness and Neural Precision	110	(7)
Michael J. Berry II
Markus Meister
Statistical Models of Conditioning	117	(7)
Peter Dayan
Theresa Long
Characterizing Neurons in the Primary Auditory Cortex of the Awake Primate Using Reverse Correlation	124	(7)
R. Christopher deCharms
Michael M. Merzenich
Using Helmholtz Machines to Analyze Multi-channel Neuronal Recordings	131	(7)
Virginia R. de Sa
R. Christopher deCharms
Michael M. Merzenich
Instabilities in Eye Movement Control: A Model of Periodic Alternating Nystagmus	138	(7)
Ernst R. Dow
Thomas J. Anastasio
Hippocampal Model of Rat Spatial Abilities Using Temporal Difference Learning	145	(7)
David J. Foster
Richard G.M. Morris
Peter Dayan
Gradients for Retinotectal Mapping	152	(7)
Geoffrey J. Goodhill
A Mathematical Model of Axon Guidance by Diffusible Factors	159	(7)
Geoffrey J. Goodhill
Computing with Action Potentials (Invited Talk)	166	(7)
John J. Hopfield
Carlos D. Brody
Sam Roweis
A Model of Early Visual Processing	173	(7)
Laurent Itti
Jochen Braun
Dale K. Lee
Christof Koch
Perturbative M-Sequences for Auditory Systems Identification	180	(7)
Mark Kvale
Christoph E. Schreiner
Effects of Spike Timing Underlying Binocular Integration and Rivalry in a Neural Model of Early Visual Cortex	187	(7)
Erik D. Lumer
Dynamic Stochastic Synapses as Computational Units	194	(7)
Wolfgang Maass
Anthony M. Zador
Synaptic Transmission: An Information-Theoretic Perspective	201	(7)
Amit Manwani
Christof Koch
Toward a Single-Cell Account for Binocular Disparity Tuning: An Energy Model May Be Hiding in Your Dendrites	208	(7)
Bartlett W. Mel
Daniel L. Ruderman
Kevin A. Archie
Just One View: Invariances in Inferotemporal Cell Tuning	215	(7)
Maximilian Riesenhuber
Tomaso Poggio
On the Separation of Signals from Neighboring Cells in Tetrode Recordings	222	(7)
Maneesh Sahani
John S. Pezaris
Richard A. Andersen
Independent Component Analysis for Identification of Artifacts in Magnetoencephalographic Recordings	229	(7)
Ricardo Vigario
Veikko Jousmaki
Matti Hamalainen
Riitta Hari
Erkki Oja
Modeling Complex Cells in an Awake Macaque during Natural Image Viewing	236	(9)
William E. Vinje
Jack L. Gallant
Part III Theory	245	(150)
The Canonical Distortion Measure in Feature Space and 1-NN Classification	245	(7)
Jonathan Baxter
Peter Bartlett
Multiple Threshold Neural Logic	252	(7)
Vasken Bohossian
Jehoshua Bruck
Generalization in Decision Trees and DNF: Does Size Matter?	259	(7)
Mostefa Golea
Peter Bartlett
Wee Sun Lee
Llew Mason
Selecting Weighting Factors in Logarithmic Opinion Pools	266	(7)
Tom Heskes
New Approximations of Differential Entropy for Independent Component Analysis and Projection Pursuit	273	(7)
Aapo Hyvarinen
Boltzmann Machine Learning Using Mean Field Theory and Linear Response Correction	280	(7)
Hilbert J. Kappen
F.B. Rodriguez
Relative Loss Bounds for Multidimensional Regression Problems	287	(7)
Jyrki Kivinen
Manfred K. Warmuth
Asymptotic Theory for Regularization: One-Dimensional Linear Case	294	(7)
Petri Koistinen
Two Approaches to Optimal Annealing	301	(7)
Todd K. Leen
Bernhard Schottky
David Saad
Structural Risk Minimization for Nonparametric Time Series Prediction	308	(7)
Ron Meir
Analytical Study of the Interplay between Architecture and Predictability	315	(7)
Avner Priel
Ido Kanter
David A. Kessler
Globally Optimal On-line Learning Rules	322	(7)
Magnus Rattray
David Saad
Minimax and Hamiltonian Dynamics of Excitatory-Inhibitory Networks	329	(7)
H. Sebastian Seung
Tom J. Richardson
Jeffrey C. Lagarias
John J. Hopfield
Data-Dependent Structural Risk Minimization for Perceptron Decision Trees	336	(7)
John Shawe-Taylor
Nello Cristianini
From Regularization Operators to Support Vector Kernels	343	(7)
Alex J. Smola
Bernhard Scholkopf
The Rectified Gaussian Distribution	350	(7)
Nicholas D. Socci
Daniel D. Lee
H. Sebastian Seung
On-line Learning from Finite Training Sets in Nonlinear Networks	357	(7)
Peter Sollich
David Barber
Competitive On-line Linear Regression	364	(7)
Volodya Vovk
On the Infeasibility of Training Neural Networks with Small Squared Errors	371	(7)
Van H. Vu
The Storage Capacity of a Fully-Connected Committee Machine	378	(7)
Yuansheng Xiong
Chulan Kwon
Jong-Hoon Oh
The Efficiency and the Robustness of Natural Gradient Descent Learning Rule	385	(10)
Howard H. Yang
Shun-ichi Amari
Part IV Algorithms and Architecture	395	(310)
Ensemble Learning for Multi-Layer Networks	395	(7)
David Barber
Christopher M. Bishop
Radial Basis Functions: A Bayesian Treatment	402	(7)
David Barber
Bernhard Schottky
Shared Context Probabilistic Transducers	409	(7)
Yoshua Bengio
Samy Bengio
Jean-Francois Isabelle
Yoram Singer
Approximating Posterior Distributions in Belief Networks Using Mixtures	416	(7)
Christopher M. Bishop
Neil Lawrence
Tommi Jaakkola
Michael I. Jordan
Receptive Field Formation in Natural Scene Environments: Comparison of Single Cell Learning Rules	423	(7)
Brian S. Blais
Nathan Intrator
Harel Shouval
Leon N. Cooper
An Annealed Self-Organizing Map for Source Channel Coding	430	(7)
Matthias Burger
Thore Graepel
Klaus Obermayer
Incorporating Test Inputs into Learning	437	(7)
Zehra Cataltepe
Malik Magdon-Ismail
On Efficient Heuristic Ranking of Hypotheses	444	(7)
Steve Chien
Andre Stechert
Darren Mutz
Learning to Order Things	451	(7)
William W. Cohen
Robert E. Schapire
Yoram Singer
Regularisation in Sequential Learning Algorithms	458	(7)
Joao F. G. de Freitas
Mahesan Niranjan
Andrew H. Gee
Agnostic Classification of Markovian Sequences	465	(7)
Ran EI-Yaniv
Shai Fine
Naftali Tishby
Ensemble and Modular Approaches for Face Detection: A Comparison	472	(7)
Raphael Feraud
Olivier Bernier
A Revolution: Belief Propagation in Graphs with Cycles	479	(7)
Brendan J. Frey
David J. C. MacKay
Hierarchical Non-linear Factor Analysis and Topographic Maps	486	(7)
Zoubin Ghahramani
Geoffrey E. Hinton
Regression with Input-dependent Noise: A Gaussian Process Treatment	493	(7)
Paul W. Goldberg
Christopher K. I. Williams
Christopher M. Bishop
Linear Concepts and Hidden Variables: An Empirical Study	500	(7)
Adam J. Grove
Dan Roth
Classification by Pairwise Coupling	507	(7)
Trevor Hastie
Robert Tibshirani
Unsupervised On-line Learning of Decision Trees for Hierarchical Data Analysis	514	(7)
Marcus Held
Joachim M. Buhmann
Nonlinear Markov Networks for Continuous Variables	521	(7)
Reimar Hofmann
Volker Tresp
Active Data Clustering	528	(7)
Thomas Hofmann
Joachim M. Buhmann
Function Approximation with the Sweeping Hinge Algorithm	535	(7)
Don R. Hush
Fernando Lozano
Bill Home
The Error Coding and Substitution PaCTs	542	(7)
Gareth James
Trevor Hastie
S-Map: A Network with a Simple Self-Organization Algorithm for Generative Topographic Mappings	549	(7)
Kimmo Kiviluoto
Erkki Oja
Learning Nonlinear Overcomplete Representations for Efficient Coding	556	(7)
Michael S. Lewicki
Terrence J. Sejnowski
Factorizing Multivariate Function Classes	563	(7)
Juan K. Lin
A Framework for Multiple-Instance Learning	570	(7)
Oded Maron
Tomas Lozano-Perez
An Application of Reversible-Jump MCMC to Multivariate Spherical Gaussian Mixtures	577	(7)
Alan D. Marrs
Estimating Dependency Structure as a Hidden Variable	584	(7)
Marina Meila
Michael I. Jordan
Combining Classifiers Using Correspondence Analysis	591	(7)
Christopher J. Merz
Learning Path Distributions Using Nonequilibrium Diffusion Networks	598	(7)
Paul Mineiro
Javier Movellan
Ruth J. Williams
Learning Generative Models with the Up-Propagation Algorithm	605	(7)
Jong-Hoon Oh
H. Sebastian Seung
An Incremental Nearest Neighbor Algorithm with Queries	612	(7)
Joel Ratsaby
RCC Cannot Compute Certain FSA, Even with Arbitrary Transfer Functions	619	(7)
Mark Ring
EM Algorithms for PCA and SPCA	626	(7)
Sam Roweis
Local Dimensionality Reduction	633	(7)
Stefan Schaal
Sethu Vijayakumar
Christopher G. Atkeson
Prior Knowledge in Support Vector Kernels	640	(7)
Bernhard Scholkopf
Patrice Simard
Alex J. Smola
Vladimir Vapnik
Training Methods for Adaptive Boosting of Neural Networks	647	(7)
Holger Schwenk
Yoshua Bengio
Learning Continuous Attractors in Recurrent Networks	654	(7)
H. Sebastian Seung
Monotonic Networks	661	(7)
Joseph Sill
Stacked Density Estimation	668	(7)
Padhraic Smyth
David Wolpert
Bidirectional Retrieval from Associative Memory	675	(7)
Friedrich T. Sommer
Gunther Palm
Mapping a Manifold of Perceptual Observations	682	(7)
Joshua B. Tenenbaum
Graph Matching with Hierarchical Discrete Relaxation	689	(7)
Richard C. Wilson
Edwin R. Hancock
Multiplicative Updating Rule for Blind Separation Derived from the Method of Scoring	696	(9)
Howard H. Yang
Part V Implementation	705	(30)
A 1,000-Neuron System with One Million 7-bit Physical Interconnections	705	(7)
Yuzo Hirai
Silicon Retina with Adaptive Filtering Properties	712	(7)
Shih-Chii Liu
Analog VLSI Model of Intersegmental Coordination with Nearest-Neighbor Coupling	719	(7)
Girish N. Patel
Jeremy H. Holleman
Stephen P. DeWeerth
An Analog VLSI Neural Network for Phase-based Machine Vision	726	(9)
Bertram E. Shi
Kwok Fai Hui
Part VI Speech, Handwriting and Signal Processing	735	(38)
Analysis of Drifting Dynamics with Neural Network Hidden Markov Models	735	(7)
Jens Kohlmorgen
Klaus-Robert Muller
Klaus Pawelzik
Bayesian Robustification for Audio Visual Fusion	742	(7)
Javier Movellan
Paul Mineiro
Modeling Acoustic Correlations by Factor Analysis	749	(7)
Lawrence Saul
Mazin Rahim
Blind Separation of Radio Signals in Fading Channels	756	(7)
Kari Torkkola
Hybrid NN/HMM-Based Speech Recognition with a Discriminant Neural Feature Extraction	763	(10)
Daniel Willett
Gerhard Rigoll
Part VII Visual Processing	773	(86)
A Non-Parametric Multi-Scale Statistical Model for Natural Images	773	(7)
Jeremy S. De Bonet
Paul A. Viola
Recovering Perspective Pose with a Dual Step EM Algorithm	780	(7)
Andrew D.J. Cross
Edwin R. Hancock
Bayesian Model of Surface Perception	787	(7)
William T. Freeman
Paul A. Viola
Features as Sufficient Statistics	794	(7)
Davi Geiger
Archisman Rudra
Laurance T. Maloney
Detection of First and Second Order Motion	801	(7)
Alexander Grunewald
Heiko Neumann
A Simple and Fast Neural Network Approach to Stereovision	808	(7)
Rolf D. Henkel
Inferring Sparse, Overcomplete Image Codes Using an Efficient Coding Framework	815	(7)
Michael S. Lewicki
Bruno A. Olshausen
Visual Navigation in a Robot Using Zig-Zag Behavior	822	(7)
M. Anthony Lewis
2D Observers for Human 3D Object Recognition?	829	(7)
Zili Liu
Daniel Kersten
Self-similarity Properties of Natural Images	836	(7)
Antonio Turiel
German Mato
Nestor Parga
Jean-Pierre Nadal
Multiresolution Tangent Distance for Affine-invariant Classification	843	(7)
Nuno Vasconcelos
Andrew Lippman
Phase Transitions and the Perceptual Organization of Video Sequences	850	(9)
Yair Weiss
Part VIII Applications	859	(142)
Using Expectation to Guide Processing: A Study of Three Real-World Applications	859	(7)
Shumeet Baluja
Structure Driven Image Database Retrieval	866	(7)
Jeremy S. De Bonet
Paul A. Viola
A General Purpose Image Processing Chip: Orientation Detection	873	(7)
Ralph Etienne-Cummings
Donghui Cai
An Analog VLSI Model of the Fly Elementary Motion Detector	880	(7)
Reid R. Harrison
Christof Koch
MELONET I: Neural Nets for Inventing Baroque-Style Chorale Variations	887	(7)
Dominik Hornel
Extended ICA Removes Artifacts from Electroencephalographic Recordings, Tzyy-Ping Jung, Colin Humphries, Te-Won Lee, Scott Makeig	894	(7)
Martin J. McKeown
Vicente Iragui
Terrence J. Sejnowski
A Generic Approach for Identification of Event Related Brain Potentials via a Competitive Neural Network Structure	901	(7)
Daniel H. Lange
Hava T. Siegelmann
Hillel Pratt
Gideon F. Inbar
A Neural Network Based Head Tracking System	908	(7)
Daniel D. Lee
H. Sebastian Seung
Wavelet Models for Video Time-Series	915	(7)
Sheng Ma
Chuanyi Ji
Reinforcement Learning for Call Admission Control and Routing in Integrated Service Networks	922	(7)
Peter Marbach
Oliver Mihatsch
Miriam Schulte
John N. Tsitsiklis
Learning to Schedule Straight-Line Code, Eliot Moss, Paul Utgoff	929	(7)
John Cavazos
Doina Precup
Darko Stefanovic
Carla Brodley
David Scheeff
Enhancing Q-Learning for Optimal Asset Allocation	936	(7)
Ralph Neuneier
Intrusion Detection with Neural Networks	943	(7)
Jake Ryan
Meng-Jang Lin
Risto Miikkulainen
Incorporating Contextual Information in White Blood Cell Identification	950	(7)
Xubo Song
Yaser Abu-Mostafa
Joseph Sill
Harvey Kasdan
Bach in a Box--Real-Time Harmony	957	(7)
Randall R. Spangler
Rodney M. Goodman
Jim Hawkins
Experiences with Bayesian Learning in a Real World Application	964	(7)
Peter Sykacek
Georg Dorffner
Peter Rappelsberger
Josef Zeitlhofer
A Solution for Missing Data in Recurrent Neural Networks with an Application to Blood Glucose Prediction	971	(7)
Volker Tresp
Thomas Briegel
Use of a Multi-Layer Perceptron to Predict Malignancy in Ovarian Tumors	978	(7)
Herman Verrelst
Y ves Moreau
Joos Vandewalle
Dirk Timmerman
Modelling Seasonality and Trends in Daily Rainfall Data	985	(7)
Peter M. Williams
The Observer-Observation Dilemma in Neuro-Forecasting	992	(9)
Hans Georg Zimmermann
Ralph Neuneier
Part IX Control, Navigation and Planning	1001	(78)
Generalized Prioritized Sweeping	1001	(7)
David Andre
Nir Friedman
Ronald Parr
Nonparametric Model-Based Reinforcement Learning	1008	(7)
Christopher G. Atkeson
An Improved Policy Interation Algorithm for Partially Observable MDPs	1015	(7)
Eric A. Hansen
Automated Aircraft Recovery via Reinforcement Learning: Initial Experiments	1022	(7)
Jeffrey F. Monaco
David G. Ward
Andrew G. Barto
Reinforcement Learning for Continuous Stochastic Control Problems	1029	(7)
Remi Munos
Paul Bourgine
Adaptive Choice of Grid and Time in Reinforcement Learning	1036	(7)
Stephan Pareigis
Reinforcement Learning with Hierarchies of Machines	1043	(7)
Ronald Parr
Stuart Russell
Multi-time Models for Temporally Abstract Planning	1050	(7)
Doina Precup
Richard S. Sutton
How to Dynamically Merge Markov Decision Processes	1057	(7)
Satinder Singh
David Cohn
The Asymptotic Convergence-Rate of Q-learning	1064	(7)
Csaba Szepesvari
Hybrid Reinforcement Learning and Its Application to Biped Robot Control	1071	(8)
Satoshi Yamada
Akira Watanabe
Michio Nakashima
Index of Authors	1079	(4)
Keyword Index	1083