Multi-Frame Motion-Compensated Prediction for Video Transmission

by Wiegand, Thomas; Girod, Bernd

• ISBN13: 9780792374978
• ISBN10: 0792374975
• Format: Hardcover
• Copyright: 2001-09-01
• Publisher: Kluwer Academic Pub

Summary

Multi-Frame Motion-Compensated Prediction for Video Transmission presents a comprehensive description of a new technique in video coding and transmission. The work presented in the book has had a very strong impact on video coding standards and will be of interest to practicing engineers and researchers as well as academics. The multi-frame technique and the Lagrangian coder control have been adopted by the ITU-T as an integral part of the well known H.263 standard and are were adopted in the ongoing H.26L project of the ITU-T Video Coding Experts Group. This work will interest researchers and students in the field of video coding and transmission. Moreover, engineers in the field will also be interested since an integral part of the well known H.263 standard is based on the presented material.

Table of Contents

Preface	xiii
Introduction	xvii
Main Contributions	xviii
Practical Importance	xx
Organization of the Book	xxi
State-of-the-Art Video Transmission	1	(20)
Video Transmission System	2	(1)
Basic Components of a Video Codec	3	(4)
ITU-T Recommendation H.263	7	(1)
Effectiveness of Motion Compensation Techniques in Hybrid Video Coding	8	(2)
Advanced Motion Compensation Techniques	10	(6)
Exploitation of Long-Term Statistical Dependencies	11	(2)
Efficient Modeling of the Motion Vector Field	13	(2)
Multi-Hypothesis Prediction	15	(1)
Video Transmission Over Error Prone Channels	16	(3)
Chapter Summary	19	(2)
Rate-Constrained Coder Control	21	(16)
Optimization Using Lagrangian Techniques	22	(1)
Lagrangian Optimization in Video Coding	23	(2)
Coder Control for ITU-T Recommendation H.263	25	(1)
Choosing the Coder Control Parameters	26	(8)
Experimental Determination of the Coder Control Parameters	27	(2)
Interpretation of the Lagrange Parameter	29	(4)
Efficiency Evaluation for the Parameter Choice	33	(1)
Comparison to Other Encoding Strategies	34	(1)
Chapter Summary	35	(2)
Long-Term Memory Motion-Compensated Prediction	37	(24)
Long-Term Memory Motion Compensation	38	(3)
Prediction Performance	41	(5)
Scene Cuts	41	(2)
Uncovered Background	43	(1)
Texture with Aliasing	44	(1)
Similar Realizations of a Noisy Image Sequence	45	(1)
Relationship to other Prediction Methods	45	(1)
Statistical Model for the Prediction Gain	46	(6)
Integration into ITU-T Recommendation H.263	52	(6)
Rate-Constrained Long-Term Memory Prediction	53	(2)
Rate-Distortion Performance	55	(3)
Discussion and Outlook	58	(1)
Chapter Summary	59	(2)
Affine Multi-Frame Motion-Compensated Prediction	61	(22)
Affine Multi-Frame Motion Compensation	62	(4)
Syntax of the Video Codec	63	(2)
Affine Motion Model	65	(1)
Rate-Constrained Coder Control	66	(7)
Affine Motion Parameter Estimation	66	(5)
Reference Picture Warping	71	(1)
Rate-Constrained Multi-Frame Hybrid Video Encoding	71	(1)
Determination of the Number of Efficient Reference Frames	72	(1)
Experiments	73	(7)
Affine Motion Compensation	73	(3)
Combination of Affine and Long-Term Memory Motion Compensation	76	(4)
Assessment of the Rate-Distortion Performance of Multi-Frame Prediction	80	(1)
Discussion and Outlook	81	(1)
Chapter Summary	81	(2)
Fast Motion Estimation for Multi-Frame Prediction	83	(18)
Lossless Fast Motion Estimation	84	(4)
Triangle Inequalities for Distortion Approximation	85	(1)
Search Order	86	(1)
Search Space	87	(1)
Lossy Fast Motion Estimation	88	(2)
Sub-Sampling of the Search Space	88	(1)
Sub-Sampling of the Block	89	(1)
Experiments	90	(8)
Results for Lossless Methods	90	(4)
Results for Lossy Methods	94	(4)
Discussion and Outlook	98	(1)
Chapter Summary	99	(2)
Error Resilient Video Transmission	101	(24)
Error Resilient Extensions of the Decoder	102	(1)
Error-Resilient Coder Control	103	(8)
Inter-Frame Error Propagation	104	(1)
Estimation of the Expected Transmission Error Distortion	105	(4)
Incorporation into Lagrangian Coder Control	109	(2)
Experiments	111	(11)
Channel Model and Modulation	111	(1)
Channel Coding and Error Control	112	(2)
Results without Feedback	114	(5)
Experimental Results with Feedback	119	(3)
Discussion and Outlook	122	(1)
Chapter Summary	122	(3)
Conclusions	125	(4)
Appendices	129	(4)
A--- Simulation Conditions	129	(2)
Distortion Measures	129	(1)
Test Sequences	130	(1)
B--- Computation of Expected Values	131	(2)
References	133	(14)
Index	147