multimedia cloud computing wenwu zhu, senior researcher @ internet media group @ microsoft research...

Multimedia Cloud Computing

Wenwu Zhu, Senior Researcher @ Internet Media Group @ Microsoft Research Asia

Chong Luo, Member of the IEEE

Jianfeng Wang, Master Student in MOE-Microsoft Key Laboratory

Shipeng Li, Researcher @ Microsoft Research Asia

IEEE SINGAL PROCESSING MAGAZINE, MAY 2011

2

OverviewIntroductionRelated WorksMultimedia-aware CloudCloud-aware MultimediaSummaryReference

3

OverviewIntroductionRelated WorksMultimedia-aware CloudCloud-aware MultimediaSummaryReference

4

IntroductionWhat is and why needs cloud

computing?Challenges of multimedia on

cloud◦Multimedia and service

heterogeneity◦QoS heterogeneity◦Network heterogeneity◦Device heterogeneity

Multimedia-aware cloud (media cloud) v.s cloud-aware multimedia (cloud media)

5

Multimedia on Cloud

6

Media Cloud v.s Cloud Media

7

OverviewIntroductionRelated WorksMultimedia-aware CloudCloud-aware MultimediaSummaryReference

8

OverviewIntroductionRelated WorksMultimedia-aware CloudCloud-aware MultimediaSummaryReference

9

Multimedia-aware CloudMedia-cloud-computing

architecture◦Media edge cloud (MEC) architecture

Distributed parallel multimedia processing

Case study◦Photosynth[1]

10

MEC ArchitectureLike CDN[2] edge servers

architecture

11

MEC Architecture

12

Distributed parallel multimedia processing

DHT

LoadBalancer

13

Case Study - Photosynth

14

Case Study - PhotosynthMajor computation task

◦Image Conversion◦Feature extration◦Image matching◦Reconstruction

User-level parallel synthing in the MEC

Task-level parallel synthing in the MEC

15

User-level Parallel Synthing

16

Task-level Parallel Synthing

17

Simulation Result

18

OverviewIntroductionRelated WorksMultimedia-aware CloudCloud-aware MultimediaSummaryReference

19

Cloud-aware Multimedia

20

Cloud-aware MultimediaStorage and sharingAuthoring and mashupAdaptation and deliveryMedia rendering

21

Storage and sharingAdvantage

◦High reliability◦High data rate

Issues◦High bandwidth demand of load

balancing algorithms for streaming

22

Authoring and MashupOffline tools

◦Adobe◦Windows Movie Maker

Online service◦Jaycut

http://www.jaycut.com

XML-based file format

23

Authoring and Mashup

24

Adaptation and DeliveryA large amount of computingRequest service simultaneouslyExample – Cloudcoder

◦Offload much of the processing to the cloud

◦Transcoder instances scales up automatically

25

Adaptation and Delivery

26

Media RenderingA large amount of computing

◦Fully render◦Partially render

Multimedia retrieval◦Content-based image retrieval (CBIR)

Feature extraction Similarity measurement

27

Media Rendering

28

OverviewIntroductionRelated WorksMultimedia-aware CloudCloud-aware MultimediaSummaryReference

29

SummaryMedia cloud

◦Propose an MEC-computing architecture to achieve high QoS support for various services.

Cloud media◦Propose how multimedia service can

optimally utilize cloud-computing resources.

30

OverviewIntroductionRelated WorksMultimedia-aware CloudCloud-aware MultimediaSummaryReference

31

Reference[1] Photosynth

◦http://photosynth.net/[2] CDN

◦http://miin1130.pixnet.net/blog/post/26763766-cdn(content-delivery-network)%E6%87%89%E7%94%A8%E7%B0%A1%E5%96%AE%E8%AA%AA%E6%98%8E