Multimodal Signals: Cognitive and Algorithmic Issues, Cost Action 2102 and Eucognition International School Vietri Sul Mare, Italy, April 21-26, 2008 Revised Selected and

by Esposito, Anna; Hussain, Amir; Marinaro, Maria; Martone, Raffaele

• ISBN13: 9783642005244
• ISBN10: 3642005241
• Format: Paperback
• Copyright: 2009-04-01
• Publisher: Springer Verlag

Summary

This book constitutes the thoroughly refereed post-conference proceedings of the COST Action 2102 and euCognition supported international school on Multimodal Signals: "Cognitive and Algorithmic Issues" held in Vietri sul Mare, Italy, in April 2008.The 34 revised full papers presented were carefully reviewed and selected from participants' contributions and invited lectures given at the workshop. The volume is organized in two parts; the first on Interactive and Unsupervised Multimodal Systems contains 14 papers. The papers deal with the theoretical and computational issue of defining algorithms, programming languages, and determinist models to recognize and synthesize multimodal signals. These are facial and vocal expressions of emotions, tones of voice, gestures, eye contact, spatial arrangements, patterns of touch, expressive movements, writing patterns, and cultural differences, in anticipation of the implementation of intelligent avatars and interactive dialogue systems that could be exploited to improve user access to future telecommunication services. The second part of the volume, on Verbal and Nonverbal Communication Signals, presents 20 original studies devoted to the modeling of timing synchronization between speech production, gestures, facial and head movements in human communicative expressions and on their mutual contribution for an effective communication.

Table of Contents

Interactive and Unsupervised Multimodal Systems
Multimodal Human Machine Interactions in Virtual and Augmented Reality	p. 1
Speech through the Ear, the Eye, the Mouth and the Hand	p. 24
Multimodality Issues in Conversation Analysis of Greek TV Interviews	p. 40
Representing Communicative Function and Behavior in Multimodal Communication	p. 47
Using the iCat as Avatar in Remote Meetings	p. 60
Using Context to Disambiguate Communicative Signals	p. 67
Modeling Aspects of Multimodal Lithuanian Human - Machine Interface	p. 75
Using a Signing Avatar as a Sign Language Research Tool	p. 83
Data Fusion at Different Levels	p. 94
Voice Technology Applied for Building a Prototype Smart Room	p. 104
Towards Facial Gestures Generation by Speech Signal Analysis Using Huge Architecture	p. 112
Multi-modal Speech Processing Methods: An Overview and Future Research Directions Using a Matlab Based Audio-Visual Toolbox	p. 121
From Extensity to Protensity in Cas: Adding Sounds to Icons	p. 130
Statistical Modeling of Interpersonal Distance with Range Imaging Data	p. 137
Verbal and Nonverbal Communication Signals
How the Brain Processes Language in Different Modalities	p. 145
From Speech and Gestures to Dialogue Acts	p. 164
The Language of Interjections	p. 170
Gesture and Gaze in Persuasive Political Discourse	p. 187
Content in Embedded Sentences: A Typology by Context Shift	p. 197
A Distributional Concept for Modeling Dialectal Variation in TTS	p. 208
Regionalized Text-to-Speech Systems: Personal Design and Application Scenarios	p. 216
Vocal Gestures in Slovak: Emotions and Prosody	p. 223
Spectrum Modification for Emotional Speech Synthesis	p. 232
Comparison of Grapheme and Phoneme Based Acoustic Modeling in LVCSR Task in Slovak	p. 242
Automatic Motherese Detection for Face-to-Face Interaction Analysis	p. 248
Recognition of Emotions in German Speech Using Gaussian Mixture Models	p. 256
Electroglottogram Analysis of Emotionally Styled Phonation	p. 264
Emoticonsciousness	p. 271
Urban Environmental Information Perception and Multimodal Communication: The Air Quality Example	p. 288
Underdetermined Blind Source Separation Using Linear Separation System	p. 300
Articulatory Synthesis of Speech and Singing: State of the Art and Suggestions for Future Research	p. 306
Qualitative and Quantitative Crying Analysis of New Born Babies Delivered Under High Risk Gestation	p. 320
Recognizing Facial Expressions Using Model-Based Image Interpretation	p. 328
Face Localization in 2D Frontal Face Images Using Luminosity Profiles Analysis	p. 340
Author Index	p. 347
Table of Contents provided by Ingram. All Rights Reserved.