The Text Mining Handbook: Advanced Approaches in Analyzing Unstructured Data

by Ronen Feldman , James Sanger

• ISBN13: 9780521836579
• ISBN10: 0521836573
• eBook ISBN(s): 9781139814065
• Format: Hardcover
• Copyright: 2006-12-11
• Publisher: Cambridge University Press
• More Book Details

Summary

Text mining tries to solve the crisis of information overload by combining techniques from data mining, machine learning, natural language processing, information retrieval, and knowledge management. In addition to providing an in-depth examination of core text mining and link detection algorithms and operations, this book examines advanced pre-processing techniques, knowledge representation considerations, and visualization approaches. Finally, it explores current real-world, mission-critical applications of text mining and link detection in such varied fields as M&A business intelligence, genomics research and counter-terrorism activities.

Table of Contents

Preface	x
Introduction to Text Mining	1	(18)
Defining Text Mining	1	(12)
General Architecture of Text Mining Systems	13	(6)
Core Text Mining Operations	19	(38)
Core Text Mining Operations	19	(22)
Using Background Knowledge for Text Mining	41	(10)
Text Mining Query Languages	51	(6)
Text Mining Preprocessing Techniques	57	(7)
Task-Oriented Approaches	58	(4)
Further Reading	62	(2)
Categorization	64	(18)
Applications of Text Categorization	65	(1)
Definition of the Problem	66	(2)
Document Representation	68	(2)
Knowledge Engineering Approach to TC	70	(1)
Machine Learning Approach to TC	70	(8)
Using Unlabeled Data to Improve Classification	78	(1)
Evaluation of Text Classifiers	79	(1)
Citations and Notes	80	(2)
Clustering	82	(12)
Clustering Tasks in Text Analysis	82	(2)
The General Clustering Problem	84	(1)
Clustering Algorithms	85	(3)
Clustering of Textual Data	88	(4)
Citations and Notes	92	(2)
Information Extraction	94	(37)
Introduction to Information Extraction	94	(2)
Historical Evolution of IE: The Message Understanding Conferences and Tipster	96	(5)
IE Examples	101	(3)
Architecture of IE Systems	104	(5)
Anaphora Resolution	109	(10)
Inductive Algorithms for IE	119	(3)
Structural IE	122	(7)
Further Reading	129	(2)
Probabilistic Models for Information Extraction	131	(15)
Hidden Markov Models	131	(6)
Stochastic Context-Free Grammars	137	(1)
Maximal Entropy Modeling	138	(2)
Maximal Entropy Markov Models	140	(2)
Conditional Random Fields	142	(3)
Further Reading	145	(1)
Preprocessing Applications Using Probabilistic and Hybrid Approaches	146	(31)
Applications of HMM to Textual Analysis	146	(6)
Using MEMM for Information Extraction	152	(1)
Applications of CRFs to Textual Analysis	153	(2)
TEG: Using SCFG Rules for Hybrid Statistical--Knowledge-Based IE	155	(11)
Bootstrapping	166	(9)
Further Reading	175	(2)
Presentation-Layer Considerations for Browsing and Query Refinement	177	(12)
Browsing	177	(8)
Accessing Constraints and Simple Specification Filters at the Presentation Layer	185	(1)
Accessing the Underlying Query Language	186	(1)
Citations and Notes	187	(2)
Visualization Approaches	189	(55)
Introduction	189	(3)
Architectural Considerations	192	(2)
Common Visualization Approaches for Text Mining	194	(31)
Visualization Techniques in Link Analysis	225	(10)
Real-World Example: The Document Explorer System	235	(9)
Link Analysis	244	(31)
Preliminaries	244	(2)
Automatic Layout of Networks	246	(4)
Paths and Cycles in Graphs	250	(1)
Centrality	251	(8)
Partitioning of Networks	259	(13)
Pattern Matching in Networks	272	(1)
Software Packages for Link Analysis	273	(1)
Citations and Notes	274	(1)
Text Mining Applications	275	(42)
General Considerations	276	(5)
Corporate Finance: Mining Industry Literature for Business Intelligence	281	(16)
A ``Horizontal'' Text Mining Application: Patent Analysis Solution Leveraging a Commercial Text Analytics Platform	297	(12)
Life Sciences Research: Mining Biological Pathway Information with Gene Ways	309	(8)
Appendix A: DIAL: A Dedicated Information Extraction Language for Text Mining	317	(20)
What Is the DIAL Language?	317	(1)
Information Extraction in the DIAL Environment	318	(2)
Text Tokenization	320	(1)
Concept and Rule Structure	320	(2)
Pattern Matching	322	(1)
Pattern Elements	323	(4)
Rule Constraints	327	(1)
Concept Guards	328	(1)
Complete DIAL Examples	329	(8)
Bibliography	337	(54)
Index	391