Evolving Connectionist Systems : Methods and Applications in Bioinformatics, Brain Study and Intelligent Machines

by Kasabov, Nikola K.

• ISBN13: 9781852334000
• ISBN10: 1852334002
• Format: Paperback
• Copyright: 2003-02-01
• Publisher: Springer Verlag

Summary

Many methods and models have been proposed for solving difficult problems such as prediction, planning and knowledge discovery in application areas such as bioinformatics, speech and image analysis. Most, however, are designed to deal with static processes which will not change over time. Some processes - such as speech, biological information and brain signals - are not static, however, and in these cases different models need to be used which can trace, and adapt to, the changes in the processes in an incremental, on-line mode, and often in real time. This book presents generic computational models and techniques that can be used for the development of evolving, adaptive modelling systems. The models and techniques used are connectionist-based (as the evolving brain is a highly suitable paradigm) and, where possible, existing connectionist models have been used and extended. The first part of the book covers methods and techniques, and the second focuses on applications in bioinformatics, brain study, speech, image, and multimodal systems. It also includes an extensive bibliography and an extended glossary. Evolving Connectionist Systems is aimed at anyone who is interested in developing adaptive models and systems to solve challenging real world problems in computing science or engineering. It will also be of interest to researchers and students in life sciences who are interested in finding out how information science and intelligent information processing methods can be applied to their domains.

Table of Contents

Prologue	1	(6)
Part I Evolving Connectionist Systems: Methods and Techniques
Evolving Processes and Evolving Connectionist Systems	7	(24)
Evolving Processes	7	(5)
Working Classification Scheme for Learning in Connectionist Systems	12	(13)
Artificial Intelligence (AI) Versus Emerging Intelligence (EI)	25	(1)
Introduction to Evolving Connectionist Systems	26	(2)
Summary and Open Problems	28	(1)
Further Reading	29	(2)
Evolving Connectionist Systems for Unsupervised Learning	31	(26)
On-Line Unsupervised Learning - General Principles	31	(8)
ECOS for On-Line Clustering	39	(10)
Self-Organising Maps -- SOMs	49	(3)
Evolving Self-Organising Maps (ESOM)	52	(3)
Summary and Open Problems	55	(1)
Further Reading	55	(2)
Evolving Connectionist Systems for Supervised Learning	57	(34)
Principles and Architectures of Connectionist Systems for On-Line Supervised Learning	57	(8)
Evolving Fuzzy Neural Networks -- EFuNN	65	(10)
Knowledge Manipulation in Evolving Fuzzy Neural Networks (EFuNNs) - Rule Insertion, Rule Extraction, Rule Aggregation	75	(10)
On-Line Evaluation, Feature Modification and Parameter Adaptation in EFuNNs	85	(3)
Summary and Open Questions	88	(1)
Further Reading	88	(3)
Recurrent Evolving Systems, Reinforcement Learning and Evolving Automata	91	(8)
Recurrent Evolving Connectionist Systems	91	(4)
Evolving Connectionist Systems and Evolving Automata	95	(1)
Reinforcement Learning in ECOS	96	(1)
Summary and Open Questions	97	(1)
Further Reading	98	(1)
Evolving Neuro-Fuzzy Inference Systems	99	(26)
Different Types of Rules and Inference in Knowledge-Based Neural Networks	99	(5)
Hybrid Neuro-Fuzzy Inference Systems -- HyFIS	104	(3)
Dynamic Evolving Neuro-Fuzzy Inference Systems -- DENFIS	107	(9)
Different Types of Fuzzy Rules in ECOS	116	(2)
Type-2 Evolving Connectionist Systems	118	(2)
Interval-Based Evolving Connectionist Systems and Other Ways of Defining Receptive Fields	120	(3)
Summary and Open Problems	123	(1)
Further Reading	123	(2)
Evolutionary Computation and Evolving Connectionist Systems	125	(18)
Evolutionary Computation - a Brief Introduction	125	(6)
Evolutionary Computation (EC) for the Optimisation of Off-Line Learning Connectionist Systems	131	(3)
Evolutionary Computation for the Optimisation of On-Line Learning Systems	134	(6)
Summary and Open Problems	140	(1)
Further Reading	140	(3)
Evolving Connectionist Machines -- Framework, Biological Motivation and Implementation Issues	143	(22)
A framework for evolving connectionist machines	143	(5)
Biological Motivation for ECOS -- the ``Instinct'' for Information	148	(2)
Spatial and Temporal Complexity of ECOS	150	(1)
On-Line Feature Selection and Feature Evaluation	151	(5)
An Agent-Based Framework for Evolving Connectionist Machines	156	(2)
Evolving Hardware	158	(2)
Conclusion and Open Questions	160	(1)
Further Reading	160	(5)
Part II Evolving Connectionist Systems: Applications in Bioinformatics, Brain Study, and Intelligent Systems
Data Analysis, Modelling and Knowledge Discovery in Bioinformatics	165	(28)
Bioinformatics - an Area of Information Growth and Emergence of Knowledge	165	(5)
Dynamic DNA and RNA Sequence Data Analysis and Knowledge Discovery	170	(4)
Gene Expression Data Analysis, Rule Extraction and Disease Profiling	174	(10)
Fuzzy Evolving Clustering of Genes According to Their Time-Course Expression	184	(2)
Protein Structure Prediction	186	(3)
Dynamic Cell Modelling	189	(2)
Summary and Open Problems	191	(1)
Further Reading	191	(2)
Dynamic Modelling of Brain Functions and Cognitive Processes	193	(16)
Evolving Structure of the Brain and Evolving Cognition	193	(4)
Dynamic Modelling of Brain States Based on EEG Signals	197	(3)
Dynamic Modelling of Cognitive Processes Based on Brain Imaging	200	(2)
Modelling Perception - the Auditory System	202	(2)
Dynamic Modelling of Integrated Auditory and Visual Systems	204	(2)
Computational Models of the Entire Brain	206	(1)
Summary and Open Problems	207	(1)
Further Reading	208	(1)
Modelling the Emergence of Acoustic Segments (Phonemes) in Spoken Languages	209	(20)
Introduction to the Issues of Learning Spoken Languages	209	(2)
The Dilemma of ``Innateness Versus Learning'' or ``Nature Versus Nurture'' Revisited	211	(2)
ECOS for Modelling the Emergence of Phones and Phonemes	213	(8)
Modelling Evolving Bilingual Systems	221	(4)
Summary and Open Problems	225	(2)
Further Reading	227	(2)
On-Line Adaptive Speech Recognition	229	(16)
Introduction to Adaptive Speech Recognition Problems	229	(3)
A Framework of Evolving Connectionist Systems for Adaptive Speech Recognition	232	(1)
On-Line Adaptive Phoneme-Based Speech Recognition	233	(4)
On-Line Adaptive Whole Word and Phrases Recognition	237	(3)
Feature Selection and Feature Evaluation for On-Line Adaptive Speech Recognition Systems	240	(2)
Natural Language Understanding for Adaptive Intelligent Human Computer Interfaces	242	(1)
Summary and Open Problems	243	(1)
Further Reading	243	(2)
On-Line Image and Video Data Processing	245	(12)
On-Line Colour Quantisation	245	(3)
On-Line Image Classification	248	(3)
On-Line Video Camera Operation Recognition	251	(4)
Summary and Open Problems	255	(1)
Further Reading	256	(1)
Evolving Systems for Integrated Multi-Modal Information Processing	257	(16)
Multi-Modal Information Processing	257	(1)
AVIS: a Framework for Integrated Auditory and Visual Information Processing Systems	258	(2)
PIAVI -- an Experimental Evolving System for Person Identification Based on Integrated Auditory and Visual Information Processing	260	(10)
Summary and Open Problems	270	(1)
Further Reading	271	(2)
Epilogue	273	(2)
References	275	(16)
Extended Glossary	291	(14)
Index	305