Information Storage and Retrieval Systems

by Kowalski, Gerald; Maybury, Mark T.

• ISBN13: 9780792379249
• ISBN10: 0792379241
• Edition: 2nd
• Format: Hardcover
• Copyright: 2000-07-01
• Publisher: Kluwer Academic Pub

Summary

This book provides a theoretical and practical explanation of the latest advancements in information retrieval and their application to existing systems. It takes a system approach, discussing all aspects of an Information Retrieval System. The major difference between this book and the first edition is the addition to this text of descriptions of the automated indexing of multimedia documents, as items in information retrieval are now considered to be a combination of text along with graphics, audio, image and video data types. The growth of the Internet and the availability of enormous volumes of data in digital form have necessitated intense interest in techniques to assist the user in locating data. The importance of the Internet and its associated hypertext linked structure are put into perspective as a new type of information retrieval data structure. The total system approach also includes discussion of the human interface and the importance of information visualization for identification of relevant information. With the availability of large quantities of multi-media on the Internet (audio, video, images), Information Retrieval Systems need to address multi-modal retrieval. The primary use of this book is as a college text on Information Retrieval Systems. But in addition to the theoretical aspects, the book maintains a theme of practicality that puts into perspective the importance and utilization of the theory in systems that are being used by anyone on the Internet. The student will gain an understanding of what is achievable using existing technologies and deficient areas that warrant additional research. The text provides coverage of all of the major aspects of information retrieval and has sufficient detail to allow students to implement a simple Information Retrieval System.

Table of Contents

Preface	xi
Introduction to Information Retrieval Systems	1	(26)
Definition of Information Retrieval System	2	(2)
Objectives of Information Retrieval Systems	4	(6)
Functional Overview	10	(10)
Item Normalization	10	(6)
Selective Dissemination of Information	16	(2)
Document Database Search	18	(1)
Index Database Search	18	(2)
Multimedia Database Search	20	(1)
Relationship to Database Management Systems	20	(1)
Digital Libraries and Data Warehouses	21	(3)
Summary	24	(3)
Information Retrieval System Capabilities	27	(24)
Search Capabilities	28	(10)
Boolean Logic	29	(1)
Proximity	30	(1)
Contiguous Word Phrases	31	(1)
Fuzzy Searches	32	(1)
Term Masking	32	(1)
Numeric and Date Ranges	33	(1)
Concept and Thesaurus Expansions	34	(2)
Natural Language Queries	36	(1)
Multimedia Queries	37	(1)
Browse Capabilities	38	(3)
Ranking	38	(2)
Zoning	40	(1)
Highlighting	40	(1)
Miscellaneous Capabilities	41	(3)
Vocabulary Browse	41	(1)
Iterative Search and Search History Log	42	(1)
Canned Query	43	(1)
Multimedia	43	(1)
Z39.50 and WAIS Standards	44	(3)
Summary	47	(4)
Cataloging and Indexing	51	(20)
History and Objectives of Indexing	52	(4)
History	52	(2)
Objectives	54	(2)
Indexing Process	56	(2)
Scope of Indexing	57	(1)
Precoordination and Linkages	58	(1)
Automatic Indexing	58	(7)
Indexing by Term	61	(2)
Indexing by Concept	63	(1)
Multimedia Indexing	64	(1)
Information Extraction	65	(3)
Summary	68	(3)
Data Structure	71	(34)
Introduction to Data Structure	72	(1)
Stemming Algorithms	73	(9)
Introduction to the Stemming Process	74	(1)
Porter Stemming Algorithm	75	(2)
Dictionary Look-up Stemmers	77	(1)
Successor Stemmers	78	(2)
Conclusions	80	(2)
Inverted File Structure	82	(3)
N-Gram Data Structures	85	(3)
History	86	(1)
N-Gram Data Structure	87	(1)
PAT Data Structure	88	(5)
Signature File Structure	93	(1)
Hypertext and XML Data Structures	94	(5)
Definition of Hypertext Structure	95	(2)
Hypertext History	97	(1)
XML	98	(1)
Hidden Markov Models	99	(3)
Summary	102	(3)
Automatic Indexing	105	(34)
Classes of Automatic Indexing	105	(3)
Statistical Indexing	108	(15)
Probabilistic Weighting	108	(3)
Vector Weighting	111	(2)
Simple Term Frequency Algorithm	113	(3)
Inverse Document Frequency	116	(1)
Signal Weighting	117	(2)
Discrimination Value	119	(1)
Problems With Weighting Schemes	120	(1)
Problems With the Vector Model	121	(1)
Bayesian Model	122	(1)
Natural Language	123	(7)
Index Phrase Generation	125	(3)
Natural Language Processing	128	(2)
Concept Indexing	130	(2)
Hypertext Linkages	132	(3)
Summary	135	(4)
Document and Term Clustering	139	(26)
Introduction to Clustering	140	(3)
Thesaurus Generation	143	(11)
Manual Clustering	144	(1)
Automatic Term Clustering	145	(1)
Complete Term Relation Method	146	(5)
Clustering Using Existing Clusters	151	(2)
One Pass Assignments	153	(1)
Item Clustering	154	(2)
Hierarchy of Clusters	156	(4)
Summary	160	(5)
User Search Techniques	165	(34)
Search Statements and Binding	166	(1)
Similarity Measures and Ranking	167	(8)
Similarity Measures	168	(5)
Hidden Markov Model Techniques	173	(1)
Ranking Algorithms	174	(1)
Relevance Feedback	175	(4)
Selective Dissemination of Information Search	179	(7)
Weighted Searches of Boolean Systems	186	(5)
Searching the INTERNET and Hypertext	191	(3)
Summary	194	(5)
Information Visualization	199	(22)
Introduction to Information Visualization	200	(3)
Cognition and Perception	203	(5)
Background	203	(1)
Aspects of Visualization Process	204	(4)
Information Visualization Technologies	208	(10)
Summary	218	(3)
Text Search Algorithms	221	(20)
Introduction to Text Search Techniques	221	(4)
Software Text Search Algorithms	225	(8)
Hardware Text Search Systems	233	(5)
Summary	238	(3)
Multimedia Information Retrieval	241	(16)
Spoken Language Audio Retrieval	242	(2)
Non-Speech Audio Retrieval	244	(1)
Graph Retrieval	245	(1)
Imagery Retrieval	246	(3)
Video Retrieval	249	(6)
Summary	255	(2)
Information System Evaluation	257	(24)
Introduction to Information System Evaluation	257	(3)
Measures Used in System Evaluations	260	(7)
Measurement Example - TREC Results	267	(11)
Summary	278	(3)
References	281	(32)
Subject Index	313