Real-time Image and Video Processing: From Research to Reality

by Kehtarnavaz, Nasser

• ISBN13: 9781598290523
• ISBN10: 1598290525
• Edition: 1st
• Format: Paperback
• Copyright: 2006-03-01
• Publisher: Morgan & Claypool

Summary

Real-Time Image and Video Processing presents an overview of the guidelines and strategies for transitioning an image or video processing algorithm from a research environment into a real-time constrained environment. Such guidelines and strategies are scattered in the literature of various disciplines including image processing, computer engineering, and software engineering, and thus have not previously appeared in one place. By bringing these strategies into one place, the book is intended to serve the greater community of researchers, practicing engineers, industrial professionals, who are interested in taking an image or video processing algorithm from a research environment to an actual real-time implementation on a resource constrained hardware platform. These strategies consist of algorithm simplifications, hardware architectures, and software methods. Throughout the book, carefully selected, representative examples from the literature are presented to illustrate the discussed concepts. After reading the book, readers will have a strong understanding of the wide variety of techniques and tools involved in designing a real-time image or video processing system.

Table of Contents

Real-Time Image and Video Processing Concepts	1	(14)
Introduction	1	(1)
Parallelism in Image/Video Processing Operations	1	(4)
Low-Level Operations	3	(1)
Intermediate-Level Operations	4	(1)
High-Level Operations	5	(1)
Matrix--Vector Operations	5	(1)
Diversity of Operations in Image/Video Processing	5	(1)
Definition of ``Real-Time''	6	(3)
Real-time in Perceptual Sense	6	(1)
Real-time in Software Engineering Sense	7	(1)
Real-time in Signal Processing Sense	8	(1)
Misinterpretation of Concept of Real-time	8	(1)
Challenges in Real-time Image/Video Processing	9	(1)
Historical Perspective	9	(2)
History of Image/Video Processing Hardware Platforms	9	(2)
Growth in Applications of Real-time Image/Video Processing	11	(1)
Trade-Off Decisions	11	(1)
Chapter Breakdown	12	(3)
Algorithm Simplification Strategies	15	(18)
Introduction	15	(1)
Core Simplification Concepts	16	(3)
Reduction in Number of Operations	16	(2)
Reduction in Amount of Data	18	(1)
Simplified Algorithms	19	(1)
Examples of Simplifications	19	(12)
Reduction in Number of Operations	20	(4)
Reduction of Data	24	(5)
Simple Algorithms	29	(2)
Summary	31	(2)
Hardware Platforms for Real-Time Image and Video Processing	33	(22)
Introduction	33	(1)
Essential Hardware Architecture features	34	(1)
Overview of Currently Available processors	35	(6)
Digital Signal Processors	35	(2)
Field Programmable Gate Arrays	37	(1)
Multicore Embedded System-on-Chip	38	(1)
General-Purpose Processors	39	(1)
Graphics Processing Unit	40	(1)
Example Systems	41	(12)
DSP-Based Systems	41	(2)
FPGA-Based Systems	43	(5)
Hybrid Systems	48	(2)
GPU-Based Systems	50	(2)
PC-Based Systems	52	(1)
Revolutionary Technologies	53	(1)
Summary	54	(1)
Software Methods for Real-Time Image and Video Processing	55	(26)
Introduction	55	(1)
Elements of Software Platform	55	(6)
Programming Languages	56	(4)
Software Architecture Design	60	(1)
Real-time Operating System	60	(1)
Memory Management	61	(5)
Memory Performance Gap	61	(1)
Memory Hierarchy	61	(1)
Organization of Image Data in Memory	62	(1)
Spatial Locality and Cache Hits/Misses	63	(1)
Memory Optimization Strategies	63	(3)
Software Optimization	66	(5)
Profiling	66	(1)
Compiler Optimization Levels	66	(1)
Fixed-Point Versus Floating-Point Computations and Numerical Issues	67	(2)
Optimized Software Libraries	69	(1)
Precompute Information	69	(1)
Subroutines Versus In-Line Code	69	(1)
Branch Predication	70	(1)
Loop Transformations	70	(1)
Packed Data Processing	71	(1)
Examples of Software Methods	71	(7)
Software Design	72	(2)
Memory Management	74	(2)
Software Optimization	76	(2)
Summary	78	(3)
The Road Map	81	(2)
Recommended Road Map	81	(1)
Epilog	82	(1)
References	83	(14)
About the Authors	97