How to Build a Digital Library

by Witten; Bainbridge

• ISBN13: 9781558607903
• ISBN10: 1558607900
• Format: Paperback
• Copyright: 2002-07-09
• Publisher: Elsevier Science

Summary

Given modern society's need to control its ever-increasing body of information, digital libraries will be among the most important and influential institutions of this century. With their versatility, accessibility, and economy, these focused collections of everything digital are fast becoming the "banks" in which the world's wealth of information is stored. How to Build a Digital Library is the only book that offers all the knowledge and tools needed to construct and maintain a digital library-no matter how large or small. Two internationally recognized experts provide a fully developed, step-by-step method, as well as the software that makes it all possible. How to Build a Digital Library is the perfectly self-contained resource for individuals, agencies, and institutions wishing to put this powerful tool to work in their burgeoning information treasuries. * Sketches the history of libraries-both traditional and digital-and their impact on present practices and future directions * Offers in-depth coverage of today's practical standards used to represent and store information digitally * Uses Greenstone, freely accessible open-source software-available with interfaces in the world's major languages (including Spanish, Chinese, and Arabic) * Written for both technical and non-technical audiences * Web-enhanced with software documentation, color illustrations, full-text index, source code, and more

Author Biography

Ian H. Witten, a professor of computer science at the University of Waikato in New Zealand, directs the New Zealand Digital Library research project. He received an MA in Mathematics from Cambridge University, an MSc in Computer Science from the University of Calgary, and a PhD in Electrical Engineering from Essex University. Dr. Witten has published widely on digital libraries, machine learning, text compression, hypertext, speech synthesis and signal processing, and computer typography and has written several books David Bainbridge is a senior lecturer in computer science at the University of Waikato, New Zealand. He graduated from the University of Edinburgh in 1991 as the class medalist in Computer Science and holds a PhD in Optical Music Recognition from the University of Canterbury, New Zealand. An active member of the New Zealand Digital Library project, he manages the group's digital music library, Meldex, and has collaborated with several United Nations Agencies, the BBC, and various public libraries

Table of Contents

List of figures	xiii
List of tables	xix
Foreword	xxi
Edward A. Fox
Preface	xxv
Orientation: The world of digital libraries	1	(38)
Example One: Supporting human development	1	(1)
Example Two: Pushing on the frontiers of science	2	(1)
Example Three: Preserving a traditional culture	3	(1)
Example Four: Exploring popular music	4	(1)
The scope of digital libraries	5	(1)
Libraries and digital libraries	5	(3)
The changing face of libraries	8	(12)
In the beginning	10	(1)
The information explosion	11	(3)
The Alexandrian principle	14	(1)
Early technodreams	15	(1)
The library catalog	16	(1)
The changing nature of books	17	(3)
Digital libraries in developing countries	20	(4)
Disseminating humanitarian information	21	(1)
Disaster relief	21	(1)
Preserving indigenous culture	22	(1)
Locally produced information	22	(1)
The technological infrastructure	23	(1)
The Greenstone software	24	(4)
The pen is mighty: Wield it wisely	28	(7)
Copyright	29	(2)
Collecting from the Web	31	(3)
Illegal and harmful material	34	(1)
Cultural sensitivity	34	(1)
Notes and sources	35	(4)
Preliminaries: Sorting out the ingredients	39	(38)
Sources of material	40	(6)
Ideology	41	(1)
Converting an existing library	42	(1)
Building a new collection	43	(1)
Virtual libraries	44	(2)
Bibliographic organization	46	(9)
Objectives of a bibliographic system	47	(1)
Bibliographic entities	48	(7)
Modes of access	55	(3)
Digitizing documents	58	(15)
Scanning	59	(2)
Optical character recognition	61	(1)
Interactive OCR	62	(5)
Page handling	67	(1)
Planning an image digitization project	68	(1)
Inside an OCR shop	69	(1)
An example project	70	(3)
Notes and sources	73	(4)
Presentation: User interfaces	77	(54)
Presenting documents	81	(15)
Hierarchically structured documents	81	(2)
Plain, unstructured text documents	83	(3)
Page images	86	(2)
Page images and extracted text	88	(1)
Audio and photographic images	89	(2)
Video	91	(1)
Music	92	(1)
Foreign languages	93	(3)
Presenting metadata	96	(3)
Searching	99	(13)
Types of query	100	(4)
Case-folding and stemming	104	(2)
Phrase searching	106	(2)
Different query interfaces	108	(4)
Browsing	112	(7)
Browsing alphabetical lists	113	(1)
Ordering lists of words in Chinese	114	(2)
Browsing by date	116	(1)
Hierarchical classification structures	116	(3)
Phrase browsing	119	(5)
A phrase browsing interface	119	(3)
Key phrases	122	(2)
Browsing using extracted metadata	124	(2)
Acronyms	125	(1)
Language identification	126	(1)
Notes and sources	126	(5)
Collections	126	(1)
Metadata	127	(1)
Searching	127	(1)
Browsing	128	(3)
Documents: The raw material	131	(90)
Representing characters	134	(21)
Unicode	137	(1)
The Unicode character set	138	(5)
Composite and combining characters	143	(3)
Unicode character encodings	146	(3)
Hindi and related scripts	149	(5)
Using Unicode in a digital library	154	(1)
Representing documents	155	(8)
Plain text	156	(1)
Indexing	157	(3)
Word segmentation	160	(3)
Page description languages: PostScript and PDF	163	(21)
PostScript	164	(6)
Fonts	170	(3)
Text extraction	173	(5)
Using PostScript in a digital library	178	(1)
Portable Document Format: PDF	179	(4)
PDF and PostScript	183	(1)
Word-processor documents	184	(10)
Rich Text Format	185	(6)
Native Word formats	191	(1)
LaTeX format	191	(3)
Representing images	194	(12)
Lossless image compression: GIF and PNG	195	(2)
Lossy image compression: JPEG	197	(6)
Progressive refinement	203	(3)
Representing audio and video	206	(10)
Multimedia compression: MPEG	207	(3)
MPEG video	210	(1)
MPEG audio	211	(1)
Mixing media	212	(2)
Other multimedia formats	214	(1)
Using multimedia in a digital library	215	(1)
Notes and sources	216	(5)
Markup and metadata: Elements of organization	221	(62)
Hypertext markup language: HTML	224	(5)
Basic HTML	225	(3)
Using HTML in a digital library	228	(1)
Extensible markup language: XML	229	(8)
Development of markup and stylesheet languages	230	(2)
The XML metalanguage	232	(3)
Parsing XML	235	(1)
Using XML in a digital library	236	(1)
Presenting marked-up documents	237	(16)
Cascading style sheets: CSS	237	(8)
Extensible stylesheet language: XSL	245	(8)
Bibliographic metadata	253	(8)
MARC	254	(3)
Dublin Core	257	(1)
BibTeX	258	(2)
Refer	260	(1)
Metadata for images and multimedia	261	(5)
Image metadata: TIFF	262	(1)
Multimedia metadata: MPEG-7	263	(3)
Extracting metadata	266	(14)
Extracting document metadata	267	(1)
Generic entity extraction	268	(2)
Bibliographic references	270	(1)
Language identification	270	(1)
Acronym extraction	271	(2)
Key-phrase extraction	273	(4)
Phrase hierarchies	277	(3)
Notes and sources	280	(3)
Construction: Building collections with Greenstone	283	(72)
Why Greenstone?	285	(7)
What it does	285	(3)
How to use it	288	(4)
Using the Collector	292	(10)
Creating a new collection	293	(7)
Working with existing collections	300	(1)
Document formats	301	(1)
Building collections manually: A walkthrough	302	(7)
Getting started	303	(1)
Making a framework for the collection	304	(1)
Importing the documents	305	(2)
Building the indexes	307	(1)
Installing the collection	308	(1)
Importing and building	309	(10)
Files and directories	310	(2)
Object identifiers	312	(1)
Plug-ins	313	(1)
The import process	314	(3)
The build process	317	(2)
Greenstone archive documents	319	(4)
Document metadata	320	(2)
Inside the documents	322	(1)
Collection configuration file	323	(4)
Default configuration file	324	(1)
Subcollections and supercollections	325	(2)
Getting the most out of your documents	327	(22)
Plug-ins	327	(9)
Classifiers	336	(6)
Format statements	342	(7)
Building collections graphically	349	(4)
Notes and sources	353	(2)
Delivery: How Greenstone works	355	(38)
Processes and protocols	356	(4)
Processes	357	(1)
The null protocol implementation	357	(2)
The Corba protocol implementation	359	(1)
Preliminaries	360	(12)
The macro language	360	(9)
The collection information database	369	(3)
Responding to user requests	372	(13)
Performing a search	375	(1)
Retrieving a document	376	(1)
Browsing a hierarchical classifier	377	(1)
Generating the home page	378	(1)
Using the protocol	378	(6)
Actions	384	(1)
Operational aspects	385	(7)
Configuring the receptionist	386	(5)
Configuring the site	391	(1)
Notes and sources	392	(1)
Interoperability: Standards and protocols	393	(50)
More markup	395	(13)
Names	395	(2)
Links	397	(5)
Types	402	(6)
Resource description	408	(5)
Collection-level metadata	410	(3)
Document exchange	413	(6)
Open eBook	414	(5)
Query languages	419	(7)
Common command language	419	(3)
XML Query	422	(4)
Protocols	426	(8)
Z39.50	427	(2)
Supporting the Z39.50 protocol	429	(1)
The Open Archives Initiative	430	(3)
Supporting the OAI protocol	433	(1)
Research protocols	434	(6)
Dienst	435	(1)
Simple digital library interoperability protocol	436	(1)
Translating between protocols	437	(1)
Discussion	438	(2)
Notes and sources	440	(3)
Visions: Future, past, and present	443	(34)
Libraries of the future	445	(9)
Today's visions	445	(3)
Tomorrow's visions	448	(3)
Working inside the digital library	451	(3)
Preserving the past	454	(8)
The problem of preservation	455	(1)
A tale of preservation in the digital era	456	(1)
The digital dark ages	457	(2)
Preservation strategies	459	(3)
Generalized documents: A challenge for the present	462	(12)
Digital libraries of music	462	(4)
Other media	466	(3)
Generalized documents in Greenstone	469	(2)
Digital libraries for oral cultures	471	(3)
Notes and sources	474	(3)
Appendix: Installing and operating Greenstone	477	(4)
Glossary	481	(8)
References	489	(10)
Index	499	(18)
About the authors	517