A Faster Implementation of Video Compression/Decompression on Multi-core Architectures 

Dr. M. J. Nigam and Dr. R. NiyogiDeptt. Of Electronics & Comp. Engg.

Indian Institute of Technology, RoorkeeDr. Ankush Mittal

College of Engineering Roorkee

A Faster Implementation of Video Compression/Decompression on Multi-core Architectures

Gratitude and acknowledgment for the last project

Project goals

Multi-core implementations of standard algorithms (MPEG, H.264)

Multi-core implementations of bandwidth preserving recent algorithms (CEZW, MJPEG, content-based compression)

Machine dependent fast decompressionMulti-core implementation of integrated

network streaming algorithm

Types of multi-core

PC and Laptop CUDA – GPU (nVIDIA)

CELL (IBM) Workstation

Why Multicore Architecture?

Moore’s LawIncreasing job size and problem

complexityLimitations in clock speedPower saving requirementsCost effective

Overall Architecture

Content based approach

MPEG basedFrame packaging* CEZW+

Traditional system

Split video into frames

Inter - framecoding

DCT based transform coding

Save to disk

Network Transmission

End UserUploaded To server

Save to disk

Uploaded To server

Network Transmission

Bandwidth Estimation

SDM

End User

Our system

Analysis• Performance requirements met

– Resistance to low & fluctuating bandwidth– Perceptible video quality– Scalability

• In terms of no. of videos• In terms of no. of users

– Simple & real-time decoder– Encode once & decode at multiple bitrates– Robustness

Analysis• Comparison with present systems

– RSVP & related systems• Expensive for the end-user

– Realmedia, Quicktime, Windows Media• Low, Medium, High bandwidth profiles• Do not deal with educational videos

– Youtube & Google Videos• Large waiting time & buffering requirements

– Extensive research in this field– No end-to-end framework exists

MPEG Encoding Process

Parallelization of Encoder

• Encoders can be parallelized at several level– Data per GOP– Data per Frame– Data per Macro Block

The Cell B. E. Processor

• A joint venture by IBM, SONY and TOSHIBA

• Rated as super computer on a chip

Architecture

Time based deliverables

• 1-3 months: Multi-Core Implementation (MCI) of MPEG-4 (H.264) along with documentation

• 4-6 months: MCI of MJPEG• 7-9 months: MCI of CEZW • 10-12 months: MCI of Content based• 13-15 months: Decompression optimization• 16-18 months: MCI of integrated streaming• 19-24 months: Through testing, documentation

Technologies Fall-outs

• Developing a new e-learning video CODEC,

• Providing a video interface for using the CODEC,

• Developing standards for the streaming protocol,

• Providing framework for network bandwidth optimized content delivery solutions.

Expected Outcomes

• Standardized development tools for E-learning courseware.

• Software for content-based delivery and distribution of E-learning courseware.

• Documentation and dissemination in terms of research papers of the methodologies and framework for enhanced E-learning.

Total Budget outlay

S. No. Item Estimated cost

1. Equipment/Software/Services

50 lakhs

2. Research/Project Staff 15 Lakhs

3. Contingency, Consumables and Travel

15 lakhs

Total80 lakhs

The budget will be shared by the two participating institutes equally (i.e., IIT Roorkee and College of Engineering Roorkee).

S. No. Item Year 1 Year II Total for years

1. Equipment/Software/Services

40 Lakhs

10 lakhs

50 lakhs

2. Research/Project Staff

7 lakhs 8 lakhs 15 Lakhs

3. Contingency, Consumables and Travel

7 lakhs 8 lakhs 15 lakhs

Total 54 lakhs

26 lakhs

80 lakhs

About College of Engg. Roorkee

Established in 1998Admissions through AIEEEHeaded by ex-Vice Chancellor of IIT

Roorkee, Prof. Gopal RanjanRanked top in the northern region

Work done• Dishant Ailawadi, Milan Kumar Mohapatra, Ankush Mittal, Frame-

Based Parallelization of MPEG-4 on Compute Unified Device Architecture (CUDA), IEEE Int. Conference on Advance Computing (IACC’10), Feb. 2010 (accepted)

• N. Parakh, A. Mittal, and R. Niyogi,  Optimization of MPEG 2 Encoder on Cell  B.E. Processor. Proceedings of the IEEE International Conference on  Advance Computing (IACC09), 6-7 March, 2009  pp2945--2949

• Amit Pande, Amit Verma, Ankush Mittal, Ashish Agrawal, Network Aware Content-based Resource Allocation for E-learning Systems, International Journal of Signal and Imaging Systems Engineering, Inderscience (accepted)

Publications related to the project

International journal paper• A. Mittal, S. Gupta, S. Jain, and A. Jain, Content-based Adaptive

Compression of Educational Videos using Phase Correlation Techniques, ACM Journal of Multimedia Systems (Springer), vol. 11, no. 3, pp. 249-259, March 2006

• A. Mittal, C. Gupta and A. Gupta, Addressing the Bandwidth Efficiency, Control and Evaluation issues in Software Remote Laboratory, IEEE Transactions on Industrial Electronics, Special Issue on E-Learning and Remote Laboratories within Engineering Education, vol. 55 (6), pp. 2326-2333, June 2008

M.J.NIGAMM.J.NIGAM

ProfessorProfessor

Electronics & Computer Engineering DepartmentElectronics & Computer Engineering Department

Indian Institute of TechnologyIndian Institute of Technology

RoorkeeRoorkee

•B.Tech. degree in Electronics and Communication Engineering from Regional Engineering College, Warangal (AP.), India 1976.

•M.E. degree in Electronics and Communication Engineering with specialization in Control & Guidance in 1978

•Ph.D. degree in Electronics and Computer Engineering in 1992 from University of Roorkee,Roorkee, India.

• Presently Professor

•Research interests: Digital Image Processing and Intelligent Control of Robot Manipulators.

•Number of research articles in these areas have been published/ presented in various journals and Conferences.

M.J.Nigam

• Research publications till date - 50+

• Ph.D. guidance – completed - 03

• Ph.D. guidance – in progress - 02

• M.Tech.guidance- completed - 45

• B.Tech.Projects guidance - completed - 14

• B.Tech.(SURA)Projects guidance - completed - 03

• B.Tech.SummerProjects guidance - completed -04

Overall Research Activities

Dr. R. Niyogi

B. Tech. (Jadavpur Univ)PhD (IIT Kharagpur)From 2006, assistant professor at IIT-R

Dr. Ankush Mittal

B. Tech. Computer Sc. & Engg. (IIT-Delhi) PhD (The National Univ. of Singapore) Worked in NUS as faculty for two years From Jan. 2007 – Dec.. ‘09, associate

professor; now Prof. at COER Young scientist awards from NASI, ISCA, etc. Outstanding teacher award, 2008, IITR IBM Faculty award, US $10000

Research and Thesis Supervision (Dr. Ankush Mittal)

Thesis Completed6 Ph.D.23 M. Tech.12 B. Tech.

Two Books 170 Research papers

(60+ in Journals)IEEE Transactions: 5Springer: 9Elsevier: 8

Research Grants

3 Completed

1 in progress

THANK YOU