DIGITAL IMAGE COMPRESSION Algorithms and Standards

THE KLUWER INTERNATIONAL SERIES IN ENGINEERING AND COMPUTER SCIENCE

COMMUNICATIONS AND INFORMATION THEORY Consulting Editor Robert Gallager

Other books in the series:

CONTROL AND PERFORMANCE IN PACKET, CIRCUIT, AND ATM NETWORKS, XueDao Gu, Kazem Sohraby and Dhadesugoor R. Vaman

ISBN: 0-7923-9625-1 DISCRETE srOCHASTIC PROCESSES, Robert G. Gallager

ISBN: 0-7923-9583-2 WIRELESS PERSONAL COMMUNICATIONS: Research Developments, Brian D. Woerner, Theodore S. Rappaport and Jeffrey H. Reed

ISBN: 0-7923-9555-7 PLANNING AND ARCHITECTURAL DESIGN OF INTEGRATED SERVICES DIGITAL NETWORKS, A. Nejat Ince, Dag Wilhelmsen and Biilent Sankur

ISBN: 0-7923-9554-9 WIRELESS INFRARED COMMUNICATIONS, John R. Barry

ISBN: 0-7923-9476-3 COMMUNICATIONS AND CRYPTOGRAPHY: Two sides 01 One Tapestry, Richard E. Blahut, Daniel J. Costello, Jr., Ueli Maurer and Thomas Mittelholzer

ISBN: 0-7923-9469-0 WIRELESS AND MOBILE COMMUNICATIONS, Jack M. Holtzman and David J. Goodman

ISBN: 0-7923-9464-X INTRODUCTION TO CONVOLUTIONAL CODES WITH APPLICATIONS, Ajay Dholakia

ISBN: 0-7923-9467-4 CODED-MODULATION TECHNIQUES FOR FADING CHANNELS, S. Hamidreza Jamali, and Tho Le-Ngoc

ISBN: 0-7923-9421-6 WIRELESS PERSONAL COMMUNICATIONS: Trends and ChaUenges, TheodoreS. Rappaport, Brian D. Woerner, Jeffrey H. Reed

ISBN: 0-7923-9430-5 ELLIPTIC CURVE PUBLIC KEY CRYPTOSYSTEMS, Alfred Menezes

ISBN: 0-7923-9368-6 SATELLITE COMMUNICATIONS: Mobile and Fixed Services, Michael Miller, Branka Vucetic and Les Berry

ISBN: 0-7923-9333-3 WIRELESS COMMUNICATIONS: Future Directions, Jack M. Holtzman and David J. Goodman

ISBN: 0-7923-9316-3 DISCRETE-TIME MODELS FOR COMMUNICATION SYSTEMS INCLUDING ATM, Herwig Bruneel and Byung G. Kim

ISBN: 0-7923-9292-2 APPLICATIONS OF FINITE FIELDS, Alfred J. Menezes, Ian F. Blake, XuHong Gao, Ronald C. Mullin, Scott A. Vanstone, Tomik Yaghoobian

ISBN: 0-7923-9282-5 WIRELESS PERSONAL COMMUNICATIONS, Martin J. Feuerstein, Theodore S. Rappaport

ISBN: 0-7923-9280-9 SEQUENCE DETECTION FOR HIGH-DENSITY srORAGE CHANNEL, Jaekyun Moon, L. Richard Carley

ISBN: 0-7923-9264-7 DIGITAL SATELLITE COMMUNICATIONS SYSTEMS AND TECHNOLOGmS: Military and Civil Applications, A. Nejat Ince

ISBN: 0-7923-9254-X IMAGE AND TEXT COMPRESSION, James A. Storer

ISBN: 0-7923-9243-4 VECTOR QUANTIZATION AND SIGNAL COMPRESSION, Allen Gersho, Robert M. Gray

ISBN: 0-7923-9181-0 THIRD GENERATION WIRELESS INFORMATION NETWORKS, Sanjiv Nanda, David J. Goodman

ISBN: 0-7923-9128-3

DIGITAL IMAGE COMPRESSION Algorithms and Standards

by

Wei dong Kou

SPRINGER SCIENCE+BUSINESS MEDIA, LLC

Library of Congress Cataloging-in-Publication Data

A C.I.P. Catalogue record for this book is available from the Library of Congress.

ISBN 978-1-4419-5156-4 ISBN 978-1-4757-2361-8 (eBook) DOI 10.1007/978-1-4757-2361-8

Copyright @ 1995 by Springer Science+Business Media New York Originally published by Kluwer Academic Publishers in 1995 Softcover reprint of the hardcover 1st edition 1995

All rights reserved. No part of this publication may be reproduced, stored in a retrieval system or transmitted in any form or by any means, mechanical, photo-copying, recording, or otherwise, without the prior written permission of the publisher, Springer Science+Business Media, LLC.

Printed on acid-free paper.

To Yuxia, and Daniel

Contents

Preface xi Acknowledgements xv

1. Principles of Digital Image Compression 1 1.1 Digital Images and Applications 1 1.2 Principles of Digital Image Compression 2 1. 3 Performance Measurement of Digital Image Compression 4 1.4 Characteristics of Digital Image Compression 6 1.5 Digital Image Compression Standards 7

2. Compression Algorithm Fundamentals 9 2.1 Sampling and Quantization 9 2.2 Run-Length Coding 14 2.3 Shannon-Fano Coding 15 2.4 Huffman Coding 17 2.5 Predictive Coding 19 2.6 Ziv-Lempe1 Coding 20 2.7 Arithmetic Coding 22 2.8 Transform Coding 26 2.9 Vector Quantization 29 2.10 Subband Coding 32

3. CCITT Facsimile Compression Standards 37 3.1 CCITT T.4 I-Dimensional Compression Standard 37 3.2 CCITT T.4 2-Dimensional Compression Standard 43 3.3 CCITT T.6 2-Dimensional Compression Standard 51

4. JBIG Compression Standard 55 4.1 Stripes and Data Ordering 55 4.2 Resolution Reduction 57 4.3 Templates and Adaptation 60 4.4 JBIG Sequential Coding 63 4.5 JBIG Progressive Coding 64

vii

viii Digital Image Compression: Algorithms and Standards

5. JPEG Compression Standard 69 5.1 JPEG Image Definition 70 5.2 JPEG Baseline Algorithm 73

5.2.1 Discrete Cosine Transform 74 5.2.2 Quantization 75 5.2.3 Zig-zag Reordering 76 5.2.4 Entropy Coding 77 5.2.5 JPEG Interchange Format 81

5.3 JPEG Sequential OCT-Based Coding 83 5.3.1 Adaptive Arithmetic Coding for JPEG 84 5.3.2 Sequential OCT Encoding Process with

Arithmetic Coding 86 5.4 JPEG Progressive OCT-Based Coding 87 5.5 JPEG Lossless Coding 89 5.6 JPEG Hierarchical Coding 91 5.7 JPEG Extensions 94

5.7.1 Variable Quantization Extension 94 5.7.2 Selective Refinement Extension 95 5.7.3 Tiling Extension 96 5.7.4 Still Picture Interchange File Format Extension 98

6. Digital Video Compression Standards 103 6.1 CCITT H.261 Standard 103 6.2 MPEG Standards 110

6.2.1 MPEG-1 Standard 111 6.2.2 MPEG-2 Standard 117 6.2.3 MPEG-4 Standard 127

7. Digital Image Compression Advanced Topics 131 7.1 Segmentation Based Coding 131

7.1.1 Region Growing Based Coding 131 7.1.2 Split-and-Merge Based Coding 132 7.1.3 Tree Structured Segmentation Based Coding 133

7.2 Directional Filtering Based Coding 134 7.3 Recognition Based Coding 136 7.4 Fractal Coding 13 8 7.5 Wavelet Coding 142

Appendix A. Mathmatical Descriptions 150 Appendix B. Fast DCT Algorithms 159

Contents

Glossary Information of ISO/lEe Standards Information of ITU Standards Bibliography Index

169 179 181 183 187

ix

Preface

Recent advances in digital image technology, coupled with breakthroughs in the price and performance of digital hardware and firmware, have driven fast growing imaging business applications, resulting in an ever increasing need for the storage and transmission of digital images. Digital image compression is the technology of image data rate reduction to save storage space and reduce transmission rate requirements. Digital image compression offers a solution for diverse imaging applications requiring a vast amount of data to represent digital images. These applications include document imaging management systems, facsimile transmission, image archiving, remote sensing, medical imaging, entertainment, HDTV (high definition television), broadcasting, education and video teleconferencing.

In the past few years, digital image compression has attracted the attention of engineers, researchers,. and academicians, leading to various digital image compression standardization efforts for different types of images and applications. These include the JPEG (Joint Photographic Experts Group) standard for continuous-tone (multilevel) still images, the JBIG (Joint Bi-Ievel Experts Image Group) standard for bi-Ievel images, the CCITT (Consultative Committee on International Telephony and Telegraphy) Recommendation H.261 for video conferencing, and the MPEG (Miving Pictures Experts Group) standards for full motion compression on DSM (digital storage media) and HDTV. The current imaging industry has also adopted the CCITT facsimile standards, CCITT Recommendation T.4 (Group 3) and T.6 (Group 4) for hi-level image compression. Digital image compression has become a major component of widespread imaging applications involving storage or transmission.

With the quickly expanding imaging marketplace, there is a need for comprehensive digital image compression reference books focusing on digital image compression standards. Since the imaging industry is relatively new, and since various image compression standardization processes have not yet been completed, a book to address these recent emerging compression standards will be very useful

xi

xii Digital Image Compression: Algorithms and Standards

for readers who are interested in image business planning, imaging product design and development, imaging application development, and imaging based research.

The goal of this book is to introduce the reader to digital image compression algorithms and related standards including: the CCITT facsimile standards T.4 and T.6, the JBIG, JPEG, CCITT H.261 and MPEG standards. We believe that most readers would benefit from a discussion of the principles of these image compression standards. We also believe that the best references for the technical details would be the original standard documents of ISOIIEC (International Standard OrganizationlInternational Electrotechnical Commission) and ITU (International Telecommunication Union, formerly, CCITT). The purpose of this book is to provide readers with comprehensive explanations of the principles and concepts of digital image compression algorithms, to help readers acquire a knowledge of the recently emerging digital image compression standards, and to be able to use these standards in their business, product development, and research activities.

The book will be organized in seven chapters. The principles of digital image compression and the possible application areas are outlined in Chapter I, while the compression algorithm fundamentals will be described in Chapter 2. Then, we use three chapters, Chapters 3, 4 and 5, to discuss the three main digital image compression standard groups, namely, the CCITT facsimile standards, T.4 and T.6, the JBIG standard, and the JPEG standard. Chapter 6 discusses the digital video compression standards: the CCITT H.261 and MPEG standards (MPEG-l, MPEG-2, and MPEG-4). Finally, Chapter 7 discusses advanced topics on digital image compression. These topics include the following recently developed digital compression techniques: segmentation based coding, directional filtering based coding, recognition based coding, fractal coding, and wavelet coding.

The approach for organizing and presenting the information in this book is to mainly answer three questions on the subject:

1. What is a specific compression algorithm/standard? 2. Why is it necessary? 3. How does it work?

Readers who are interested in imaging product planning, architecture, design, and marketing, will only need to find the answers of the first two questions. Technical readers such as a student, a researcher, or an engineer who are interested in finding out how an individual algorithm works, will also need to find the answer of the third question. Those who are actually implementing standard algorithms, in addition to the information presented in this book, will need to have a copy of the standards for the detailed information.

Preface xiii

Because we are addressing a diverse audience, this book will use as few mathematical formulae as possible. Necessary mathematical formulae will be provided in an appendix unless they are an integral part of the main text. This is because the main purpose of this book is to present readers with comprehensive explanations of the principles and concepts of digital image compression algorithms and the recently emerging digital image compression standards.

Acknowledg ments

I would like to thank Wayne Fisher, Wayne Doran, Paul J. Latimer, Jeof Marlow, and Dick Bate for proofreading portion of the manuscript and for their valuable suggestions to make this book more readable for a wide audience. My thanks also go to AT&T Imaging Systems at Waterloo for supporting my work at ANSI ASC X3L3 (AudiolPicture Coding: JPEG, JBIG, MPEG, and MHEG) and ASC X9B9 (Financial Image Interchange) standard committees. I thank Robert Holland for his encouragement to this project. I owe a great deal of gratitude and appreciation to the lTV and ISOIlEC for their copyright permissions. Finally, the support from my wife Yuxia and my son Daniel makes this project possible. During this project, there was little family time and no vacation trip for the family. I would like express my gratitude and appreciation to Yuxia and Daniel for their sacrifice and support.

xv

DIGITAL IMAGE COMPRESSION Algorithms and Standards