The Handbook of Multisensory Processes

by Gemma A. Calvert, Charles Spence and Barry E. Stein (Eds.)

• ISBN13: 9780262033213
• ISBN10: 0262033216
• Edition: 1st
• Format: Hardcover
• Copyright: 2004-06-01
• Publisher: MIT PRESS

Summary

This landmark reference work brings together for the first time in one volume the most recent research from different areas of the emerging field of multisensory integration. After many years of using a modality-specific "sense-by-sense" approach, researchers across different disciplines in neuroscience and psychology now recognize that perception is fundamentally a multisensory experience. To understand how the brain synthesizes information from the different senses, we must study not only how information from each sensory modality is decoded but also how this information interacts with the sensory processing taking place within other sensory channels. The findings cited in The Handbook of Multisensory Processessuggest that there are broad underlying principles that govern this interaction, regardless of the specific senses involved. The book is organized thematically into eight sections; each of the 55 chapters presents a state-of-the-art review of its topic by leading researchers in the field. The key themes addressed include multisensory contributions to perception in humans; whether the sensory integration involved in speech perception is fundamentally different from other kinds of multisensory integration; multisensory processing in the midbrain and cortex in model species, including rat, cat, and monkey; behavioral consequences of multisensory integration; modern neuroimaging techniques, including EEG, PET, and fMRI, now being used to reveal the many sites of multisensory processing in the brain; multisensory processes that require postnatal sensory experience to emerge, with examples from multiple species; brain specialization and possible equivalence of brain regions; and clinical studies of such breakdowns of normal sensory integration as brain damage and synesthesia.

Table of Contents

Introduction	xi
I PERCEPTUAL CONSEQUENCES OF MULTIPLE SENSORY SYSTEMS
The Cross-Modal Consequences of the Exogenous Spatial Orienting of Attention	3	(24)
Charles Spence
John McDonald
Modulations of Visual Perception by Sound	27	(8)
Ladan Shams
Yukiyasu Kamitani
Shinsuke Shimojo
Cross-Modal Interactions Evidenced by the Ventriloquism Effect in Humans and Monkeys	35	(14)
Timothy M. Woods
Gregg H. Recanzone
Multisensory Integration of Dynamic Information	49	(20)
Salvador Soto-Faraco
Alan Kingstone
Sweet and Sour Smells: Learned Synesthesia Between the Senses of Taste and Smell	69	(16)
Richard J. Stevenson
Robert A. Boakes
Cross-Modal Interactions in Speeded Classification	85	(22)
Lawrence E. Marks
Multisensory Texture Perception	107	(16)
Susan J. Lederman
Roberta L. Klatzky
Cross-Modal Object Recognition	123	(18)
Fiona N. Newell
Perceptual Effects of Cross-Modal Stimulation: Ventriloquism and the Freezing Phenomenon	141	(12)
Jean Vroomen
Beatrice de Gelder
II IS SPEECH A SPECIAL CASE OF MULTISENSORY INTEGRATION?
From Multisensory Integration to Talking Heads and Language Learning	153	(24)
Dominic W. Massaro
Spatial and Temporal Constraints on Audiovisual Speech Perception	177	(12)
Kevin G. Munhall
Eric Vatikiotis-Bateson
Speech as a Supramodal or Amodal Phenomenon	189	(14)
Carol A. Fowler
Audiovisual Speech Binding: Convergence or Association?	203	(22)
Lynne E. Bernstein
Edward T. Auer, Jr.
Jean K. Moore
Multisensory Animal Communication	225	(18)
Sarah R. Partan
III THE NEURAL MECHANISMS UNDERLYING THE INTEGRATION OF CROSS-MODAL CUES
Multisensory Integration in Single Neurons of the Midbrain	243	(22)
Barry E. Stein
Wan Jiang
Terrence R. Stanford
Analysis and Modeling of Multisensory Enhancement in the Deep Superior Colliculus	265	(20)
Thomas J. Anastasio
Paul E. Patton
The Resurrection of Multisensory Cortex in Primates: Connection Patterns That Integrate Modalities	285	(10)
Jon H. Kaas
Christine E. Collins
Multisensory Convergence in Early Cortical Processing	295	(16)
Charles E. Schroeder
John J. Foxe
Multisensory Neuronal Convergence of Taste, Somatosensory, Visual, Olfactory, and Auditory Inputs	311	(22)
Edmund T. Rolls
Cross-Modal Memory in Primates: The Neural Basis of Learning About the Multisensory Properties of Objects and Events	333	(10)
Amanda Parker
Alexander Easton
Corticocortical Connectivity of Cross-Modal Circuits	343	(14)
M. Alex Meredith
Multisensory-Evoked Potentials in Rat Cortex	357	(16)
Daniel S. Barth
Barbara Brett-Green
IV MULTISENSORY MECHANISMS IN ORIENTATION
Auditory-Visual Interactions Subserving Primate Gaze Orienting	373	(22)
A. J. Van Opstal
D. P. Munoz
Modeling the Time Course of Multisensory Interaction in Manual and Saccadic Responses	395	(14)
Adele Diederich
Hans Colonius
Multisensory Influences on Orientation and Movement Control	409	(16)
James R. Lackner
Paul DiZio
Action as a Binding Key to Multisensory Integration	425	(18)
Leonardo Fogassi
Vittorio Gallese
Multisensory Neurons for the Control of Defensive Movements	443	(10)
Michael S. A. Graziano
Charles G. Gross
Charlotte S. R. Taylor
Tirin Moore
Cortical Mechanisms of Tool Use Subserved by Multisensory Integration	453	(10)
Hidetoshi Ishibashi
Shigeru Obayashi
Atsushi Iriki
Multisensory Representations of Space in the Posterior Parietal Cortex	463	(20)
Yale E. Cohen
Richard A. Andersen
V HUMAN BRAIN STUDIES OF MULTISENSORY PROCESSES
Hemodynamic Studies of Audiovisual Interactions	483	(20)
Gemma A. Calvert
James W. Lewis
Multiple Electrophysiological Mechanisms of Audiovisual Integration in Human Perception	503	(12)
Alexandra Fort
Marie-Helene Giard
MEG Studies of Cross-Modal Integration and Plasticity	515	(14)
Tommi Raij
Veikko Jousmaki
Functional Imaging Evidence for Multisensory Spatial Representations and Cross-Modal Attentional Interactions in the Human Brain	529	(20)
Emiliano Macaluso
Jon Driver
Electrophysiological Studies of Multisensory Attention	549	(14)
Martin Eimer
Neuroimaging Studies of Cross-Modal Integration for Emotion	563	(18)
John O'Doherty
Edmund T. Rolls
Morten Kringelbach
Multisensory Perception of Emotion, Its Time Course, and Its Neural Basis	581	(18)
Beatrice De Gelder
Jean Vroomen
Gilles Pourtois
VI THE MATURATION AND PLASTICITY OF MULTISENSORY PROCESSES
Epigenetic Factors That Align Visual and Auditory Maps in the Ferret Midbrain	599	(14)
Andrew J. King
Timothy P. Doubell
Irini Skaliora
Visual Instruction of the Auditory Space Map in the Midbrain	613	(12)
Yoram Gutfreund
Eric I. Knudsen
The Development of Multisensory Integration	625	(18)
Mark T. Wallace
Perceptual Development and the Origins of Multisensory Responsiveness	643	(12)
Robert Lickliter
Lorraine E. Bahrick
The Value of Multisensory Redundancy in the Development of Intersensory Perception	655	(26)
David J. Lewkowicz
Kimberly S. Kraebel
VII CROSS-MODAL PLASTICITY
Rewiring Cortex: Cross-Modal Plasticity and Its Implications for Cortical Development and Function	681	(14)
Mriganka Sur
Cross-Modal Consequences of Visual Deprivation in Animals	695	(8)
Josef P. Rauschecker
Visual Cortical Involvement in Normal Tactile Perception	703	(8)
K. Sathian
S. C. Prather
M. Zhang
Visual Cortex Engagement in Tactile Function in the Presence of Blindness	711	(8)
Esteban A. Fridman
Pablo Celnik
Leonardo G. Cohen
Compensatory Plasticity as a Consequence of Sensory Loss	719	(30)
Brigitte Roder
Frank Rosler
Audiovisual Speech Perception in Deaf Adults and Children Following Cochlear Implantation	749	(24)
Tonya R. Bergeson
David B. Pisoni
Neuroimaging Studies of Cross-Modal Plasticity and Language Processing in Deaf People	773	(12)
Ruth Campbell
Mairead MacSweeney
VIII PERSPECTIVES DERIVED FROM CLINICAL STUDIES
Multisensory Integration: Resolving Ambiguities for Human Postural Control	785	(14)
Leslie Allison
John J. Jeka
Neuropsychological Evidence of Integrated Multisensory Representation of Space in Humans	799	(20)
Elisabetta Ladavas
Alessandro Farne
Cross-Modal Integration and Spatial Attention in Relation to Tool Use and Mirror Use: Representing and Extending Multisensory Space Near the Hand	819	(18)
Angelo Maravita
Jon Driver
Grapheme-Color Synesthesia: When 7 Is Yellow and D Is Blue	837	(14)
Mike J. Dixon
Daniel Smilek
Brandon Wagar
Philip M. Merikle
Behavioral and Brain Correlates of Multisensory Experience in Synesthesia	851	(16)
Jason B. Mattingley
Anina N. Rich
Synesthesia, Cross-Activation, and the Foundations of Neuroepistemology	867	(18)
V. S. Ramachandran
E. M. Hubbard
P. A. Butcher
Contributors	885	(4)
Index	889