Designing Human Interface in Speech Technology

by Chen, Fang

• ISBN13: 9780387241555
• ISBN10: 0387241558
• Format: Hardcover
• Copyright: 2005-12-30
• Publisher: Springer Verlag

Summary

Designing Human Interface in Speech Technology bridges a gap between the needs of the technical engineer and cognitive researchers working in the multidisciplinary area of speech technology applications. The approach is systematic and the focus is on the utility of developing and designing speech related products.Included is coverage of topics such as neuroscience on the multimodal cortex, cognitive theories on multi-task performance, stress and workload, as well as human information process theory and ecological interface design theory for evaluating speech-related human-system interfaces.Of special emphasis are topics such as spoken dialogue system design, in-vehicle communication system design and speech technology in military applications. Also included are tools on how to analyze the design, different design theories and process, methods about how to understand users. The material systematically describes the user-center design process and usability evaluation methods.Designing Human Interface in Speech Technology is appropriate for designers, engineers, and decision makers working in the area of speech technology research. It is also a good text book for senior university students and postgraduate students in the respective interaction design areas.

Table of Contents

Preface	xvii
Abbreviation	xxi
Acknowledgement	xxiv
Introduction	1	(26)
New Time with New Requirement	1	(1)
The ASR Applications	2	(7)
The History	3	(2)
Analysis on the Consumer Applications	5	(2)
Using ASR to Drive Ship--One Application Example	7	(2)
Interface Design	9	(4)
Neuroscience and Cognitive Psychology	9	(1)
Speech Interaction Studies	10	(1)
Multidisciplinary Aspects	11	(1)
Task Orientated or Domain Orientated System	12	(1)
Usability and User-centered Design	13	(4)
Usability Issue	13	(1)
Understand the User	14	(1)
About Design Guidelines	15	(2)
Research Philosophy	17	(1)
Research Philosophy	17	(8)
I Ching Philosophy
Research and Design Methodology
Research Validity
Conclusion	25	(2)
Basic Neuropsychology	27	(26)
Introduction	27	(1)
General Aspects of Neuroscience	28	(5)
Basic Neuron Structure and Signal Transfer
The Principles of Brain Functioning
Methodology of Neuropsychological Studies
Perception	33	(6)
The Sensory System
Sensory Modality
Cortical Connection and Function
Perception and Recognition Theories
Language	39	(6)
Neurology of Language
Speech Perception
Word Recognition
Language Comprehension
Learning and Memory	45	(5)
Learning Theory
Memory
The Mechanism of Memory
Working Memory
Forgetting
Conclusion	50	(3)
Attention, Workload and Stress	53	(42)
Introduction	53	(1)
Attention	54	(4)
Neuroscience Perspective
Focusing Attention
Dividing Attention
Multiple-task Performance	58	(3)
The Resource Concept
The Efficiency of Multiple Task Performance
Individual Differences
Stress and Workload	61	(2)
Stress
Workload
The Relationship Between Stress and Workload	63	(5)
Stressors Classification
Stress: Its Cognitive Effects
Stress: Its Physiological Effects
Stress: Its Effects on Speech
Fatigue
The Measurement of Stress and Workload	68	(4)
The Measurement of Stress
Workload Assessment
Performance Measurement
Subjective Rating Measures
Psychophysiological Measures	72	(6)
Psychological Function Test
Physiological Function Test
Environmental Stress	78	(5)
Acceleration
Vibration
Noise
Auditory Distraction
Workload and the Production of Speech	83	(2)
Analysis of Speech Under Stress	85	(6)
Emotion and Cognition
Speech Measures Indicating Workload
Acoustic Analysis of Speech
Improving ASR Performance
Research Problems	91	(3)
Conclusion	94	(1)
Design Analysis	95	(28)
Introduction	95	(2)
Information Processing Theory	97	(1)
The Ecological Perspective	98	(5)
Ecological View of the Interface design
Distributed Cognition	103	(1)
Cognitive System Engineering	104	(2)
Work and Task Analysis	106	(9)
Task Analysis
Cognitive Task Analysis
GOMS---A Cognitive Model
Cognitive Work Analysis
Interaction Design Process	115	(4)
Human-System Interface
Design Process
Interaction Design
Scenario-Based Design	119	(1)
Discussion	120	(2)
Conclusion	122	(1)
Usability Design and Evaluation	123	(44)
Introduction	123	(1)
Different Design Approaches	123	(2)
The Concept of Usability	125	(10)
Definitions
Usability Design
Usability Evaluation
Human Needs and Satisfaction	135	(6)
Trust
Pleasure
User-Centered Design	141	(11)
What is UCD Process?
Planning the UCD Process?
Specifying the Context of Use
User Analysis
User Partnership
Usability Requirements Analysis
UCD Process in Practices
Social Technical Issue	152	(1)
Adaptive and Intuitive User Interface	153	(2)
Usage-centered Design	155	(5)
Creative Design
Design Criteria and Process
Ecological Approach
Universal Access	160	(3)
Ethnography Method for Contextual Interface Design	163	(1)
Conclusion	164	(3)
Human Factors in Speech Interface Design	167	(58)
Introduction	167	(2)
The unique Characteristics of Human Speech	169	(2)
Human Speech Recognition System	171	(8)
Automatic Speech Recognition System
Speech Feature Analysis and Pattern Matching
Speech Synthesis
National Language Processing
Language Modeling
Human Factors in Speech Technology	179	(1)
Speech Input	180	(6)
Human Factors and NLP
Flexibility of Vocabulary
Vocabulary Design
Accent
Emotion
Assessment and Evaluation	186	(2)
Feedback Design	188	(4)
Classification of Feedback
Modality of Feedback
Textual Feedback or Symbolic Feedback
Synthesized Speech Output	192	(7)
Cognitive Factors
Intelligibility
Comprehension
Emotion
Social Aspects
Evaluation
Error Correction	199	(6)
Speech Recognition Error
User Errors
User Error Correction
Syntax	205	(1)
Back-up and Reversion	206	(2)
Human Verbal Behavior in Speech Input Systems	208	(4)
Expertise and Experience of the User
The Evolutionary Aspects of Human Speech
Multimodal Interaction System	212	(12)
Definitions
Advantages of Multimodal Interface
Design Questions
Selection and Combination of Modalities
Modality Interaction
Modality for Error Correction
Evaluation
Conclusion	224	(1)
The Usability of Spoken Dialogue System Design	225	(26)
Introduction	225	(1)
The Attractive Business	226	(2)
Ergonomic and Socio-technical Issues	228	(4)
The User Analysis
The Variance of Human Speech
Dialogue Strategy
Speech Recognition Error	232	(2)
Error Correction for Dialogue Systems
Cognitive and Emotional Issue	234	(3)
Short-Term Memory
Verbal/Spatial Cognition
Speech and Persistence
Emotion, Prosody and Register
Affective Communication	237	(1)
Limitations of SUI	238	(3)
Speech Synthesis
Interface Design
Usability Evaluation	241	(8)
Functionality Evaluation
Who Will Carry Out Usability Evaluation Work?
The Usability Design Criteria
Evaluation Methods
Conclusion	249	(2)
In-Vehicle Communication System Design	251	(38)
Introduction	251	(5)
Intelligent Transport System
Design of ITS
In-vehicle Speech Interaction Systems	256	(10)
Design Spoken Input
Multimodal Interface
ETUDE Dialogue Manager
DARPA Communicator Architecture
SENECs
SmartKom Mobile
The Cognitive Aspects	266	(6)
Driver Distraction
Driver's Information Processing
Interface Design
Human Factors
Use of Cellular Phones and Driving	272	(4)
Accident Study
Types of Task and Circumstances
Human Factors Study Results
Use of In-vehicle Navigation	276	(5)
Accident Analysis
Types of Tasks
Navigation system-Related Risk
System Design and Evaluation	281	(5)
System Design
System Evaluation/Assessment
Future Works	286	(1)
Conclusion	287	(2)
Speech Technology in Military Application	289	(42)
Introduction	289	(2)
The Categories in Military Applications	291	(3)
Command and Control
Computers and Information Access
Training
Joint Force at Multinational Level
Application Analysis	294	(3)
Comparison Between Speech Input and Manual Input	297	(4)
The Argumentation between Poock and Damper
Effects of concurrent tasks on Direct Voice Input
Voice Input and Concurrent Tracking Tasks
Aviation Application	301	(11)
The Effects from Stress
Compare Pictorial and Speech Display
Eye/Voice Mission Planning Interface (EVMPI) Model
Application in Cockpit Fast Jet
Battle Management System
UAV Control Stations
Army Application	312	(4)
Command and Control on Move (C2OTM)
ASR Application in AFVs
The Soldier's Computer
Applications in Helicopter
Air Traffic Control Application	316	(4)
Training of Air Traffic Controllers
Real Time Speech Gisting for ATC Application
Navy application	320	(1)
Aircraft Carrier Flight Deck Control
Space Application	321	(1)
Other Applications	322	(2)
Computer Aid Training
Aviation Weather Information
Interface Design for Military Datasets
Integrating Speech Technology Into Military Systems	324	(6)
The Selection of Suitable Function for Speech technology
Recognition Error, Coverage and Speed
Interface Design
Alternative and Parallel Control Interface
Innovative Spoken Dialogue Interface
Conclusion	330	(1)
References	331	(46)
Index	377