cs 414 - spring 2012 cs 414 – multimedia systems design lecture 14 – introduction to multimedia...
TRANSCRIPT
![Page 1: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/1.jpg)
CS 414 - Spring 2012
CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management
Klara Nahrstedt
Spring 2012
![Page 2: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/2.jpg)
CS 414 - Spring 2012
Administrative Reading: “Multimedia Systems”, Steinmetz
and Nahrstedt, Springer 2004, Chapter 2 HW1 posted on Wednesday, February 22.
HW1 due on Thursday, March 1.
![Page 3: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/3.jpg)
Outline
AV Requirements - Real-time AV Requirements on Multimedia
Communication and Operating Systems Resource management
ResourcesQuality of Service (QoS) ConceptOperations
CS 414 - Spring 2012
![Page 4: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/4.jpg)
Integrating Aspects of Multimedia
CS 414 - Spring 2012
Image/VideoCapture
Image/Video InformationRepresentation
MediaServerStorage
Transmission
CompressionProcessing
Audio/VideoPresentationPlaybackAudio/Video
Perception/ Playback
Audio InformationRepresentation
Transmission
AudioCapture
A/V Playback
![Page 5: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/5.jpg)
Integrating Aspects of Multimedia
CS 414 - Spring 2012
Image/VideoCapture
Image/Video InformationRepresentation
MediaServerStorage
Transmission
CompressionProcessing
Audio/VideoPresentationPlaybackAudio/Video
Perception/ Playback
Audio InformationRepresentation
Transmission
AudioCapture
A/V Playback
![Page 6: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/6.jpg)
Integrating Aspects of Multimedia
CS 414 - Spring 2012
Image/VideoCapture
Image/Video InformationRepresentation
MediaServerStorage
Transmission
CompressionProcessing
Audio/VideoPresentationPlaybackAudio/Video
Perception/ Playback
Audio InformationRepresentation
Transmission
AudioCapture
A/V Playback
![Page 7: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/7.jpg)
For Next Four Weeks we will cover Transmission/Networks of Multimedia
CS 414 - Spring 2012
Image/VideoCapture
Image/Video InformationRepresentation
MediaServerStorage
Transmission
CompressionProcessing
Audio/VideoPresentationPlaybackAudio/Video
Perception/ Playback
Audio InformationRepresentation
Transmission
AudioCapture
A/V Playback
![Page 8: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/8.jpg)
Multimedia System/Network
CS 414 - Spring 2012
Network
MMApplication
OS/DistributedSystems/Network
MMApplication
OS/DS/Network
Sender/Server Receiver/ClientCapture AVCode AV
Display AVDecode AV
Stream AV, Sync AV, Schedule AV,Queue/Buffer AV, Shape AV, Manage AV, Route AV, Retrieve AV, Pre-fetch/Cache AV, Record AV
![Page 9: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/9.jpg)
AV Requirements: Real-Time and Deadlines Real-time system – system in which correctness
of computation depends not only on obtaining the right results, but also providing them on timeExamples: control of temperature in a chemical
plant; control of a flight simulator Deadline – represents the latest acceptable time
for the result deliverySoft deadlines versus hard deadlines
CS 414 - Spring 2012
![Page 10: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/10.jpg)
AV Requirements: Real-Time and Multimedia Difference between RT requirements for
traditional RT systems and Multimedia systemsSoft deadlines versus hard deadlinesPeriodic behavior versus random behaviorBandwidth requirements
CS 414 - Spring 2012
![Page 11: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/11.jpg)
Layered Partition of Multimedia Systems with respect to Required Resources and Individual Services
CS 414 - Spring 2012
![Page 12: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/12.jpg)
AV Requirements on MM Systems and Networks
Transport system – guaranteed delivery with respect to metrics such as delay, reliability, bandwidth requirements
OS process management – real-time processing of continuous data, communication and synchronization between processes/ threads
CS 414 - Spring 2012
![Page 13: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/13.jpg)
AV Requirements on MM Systems and Networks (2) Memory/Buffer management – guaranteed
timing delay and efficient data manipulation File system/Media Servers – transparent
and guaranteed continuous retrieval of audio/video
Device management – integration of audio and video
CS 414 - Spring 2012
![Page 14: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/14.jpg)
Result of AV Requirements
Need Resource Management to coordinate Transport/Network Resources, CPU/OS ResourcesMemory/Buffer ResourcesStorage/Disk ResourcesDevice Resources
CS 414 - Spring 2012
![Page 15: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/15.jpg)
Resource Management (Why do we need resource management?) Limited capacity in digital distributed
systems despite data compression and usage of new technologies
Need adherence for processing of continuous data by every hardware and software component along the data path
Competition for resources exist in an integrated multimedia system
CS 414 - Spring 2012
![Page 16: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/16.jpg)
Window of Resources
CS 414 - Spring 2012
NetworkFile access
High-qualityAudio
HDTV
Interactive HDTV-quality multi-view video
abundant
Sufficient
Sufficient butScarce toSufficient
Insufficient -SufficientBut scarce
1980 1990 2000
insufficient
SufficientBut scarce
insufficient
2010 2020
SufficientTo abundant
abundant
insufficient
sufficient
Requirements
Hardwaresupport
![Page 17: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/17.jpg)
Quality of Service (How to parameterize services?) To manage resources, we need services over resources
to schedule AV data, to shape access for AV data, to process AV data, to move AV data, etc.
Multimedia systems consist of set of AV-specific services Processing (media-related) services: retrieve audio/video,
record video/audio, compress audio/video, fast forward video, rewind video
Transport (network) services: Stream video, fast forward video, rewind video
To provide multimedia services, services get parameterized with quality levels called Quality of Service
CS 414 - Spring 2012
![Page 18: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/18.jpg)
Examples of A/V QoS Parameters QoS for Audio service:
Sample rate – 8000 samples/second (8KHz), 44.1 KHz Sample resolution – 8 bits per sample, 16 bits per sample
QoS for Video service: Video frame rate – 25 frames per second, 30 frames per
second Frame Period – 40 ms, 30 ms, 25 ms, … Frame resolution – 320x240 pixels, 640x480 pixels,
1920x1080 pixels, … Pixel resolution – 24 bits per pixel, 8 bits per pixel Frame size – 64KB Compression rate – 8:1
CS 414 - Spring 2012
![Page 19: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/19.jpg)
Examples of Network QoS QoS for network service:
Throughput – Number of bits per second e.g., 100 Mbps (Ethernet throughput) – level 1 e.g., 10 Mbps (WiFi throughput) – level 2 e.g., 128 kbps (ISDN throughput) – level 3
Connection setup time – time how long it take to connect the sender and receiver
e.g., 50 ms, 10 ms, …
End-to-End Delay – time interval from the time packet is sent from the sender until the time it is received at the receiver (Treceive – Tsend)
e.g., 80 ms, 100 ms, 160 msCS 414 - Spring 2012
![Page 20: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/20.jpg)
Layered Model for QoS
CS 414 - Spring 2012
Quality of Experience
Quality ofService
![Page 21: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/21.jpg)
Application QoS Parameters
CS 414 - Spring 2012
![Page 22: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/22.jpg)
System QoS Parameters
CS 414 - Spring 2012
![Page 23: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/23.jpg)
Network QoS Parameters
CS 414 - Spring 2012
![Page 24: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/24.jpg)
QoS Classes Guaranteed Service Class
QoS guarantees are provided based on deterministic and statistical QoS parameters
Predictive Service ClassQoS parameter values are estimated and based on
the past behavior of the service Best Effort Service Class
There are no guarantees or only partial guarantees are provided
CS 414 - Spring 2012
![Page 25: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/25.jpg)
QoS Classes (cont.)
CS 414 - Spring 2012
QoS Class determines: (a) reliability of offered QoS, (b) utilization of resources
![Page 26: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/26.jpg)
• Single Value: QoS1 – average (QoSave), contractual value, threshold value, target value
• Throughput – 10 Mbps
• Pair Value: <QoS1, QoS2> with QoS1 – required value; QoS2 – desired value
<QoSavg,QoSpeak>; <QoSmin, QoSmax>
• Throughput - <8,12> Mbps
CS 414 - Spring 2012
Deterministic QoS Parameters
![Page 27: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/27.jpg)
Deterministic QoS Parameter Values Triple of Values <QoS1, QoS2, QoS3>
QoS1 – best value
QoS2 – average value
QoS3 – worst value
Example:<QoSpeak, QoSavg, QoSmin>, where QoS is network
bandwidthThroughput <12, 10, 8> Mbps
CS 414 - Spring 2012
![Page 28: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/28.jpg)
Guaranteed QoS We need to provide 100% guarantees for QoS values
(hard guarantees) or very close to 100% (soft guarantees) Current QoS calculation and resource allocation are based
on: 1. Hard upper bounds for imposed workloads
2. Worst case assumptions about system behavior
1. Advantages: QoS guarantees are satisfied even in the worst case case (high reliability in guarantees)
2. Disadvantage: Over-reservation of resources, hence needless rejection of requests
CS 414 - Spring 2012
![Page 29: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/29.jpg)
Predictive QoS Parameters We utilize QoS values (QoS1, ..QoSi) and compute
average QoSbound step at K>i is QoSK = 1/i*∑jQoSj
We utilize QoS values (QoS1, , QoSi) and compute maximum valueQoSK = max j=1,…i (QoSj)
We utilize QoS values (QoS1, , QoSi) and compute minimum valueQoSK = min j=1,…i (QoSj)
CS 414 - Spring 2012
![Page 30: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/30.jpg)
Best Effort QoS
No QoS bounds or possible very weak QoS bounds
Advantages: resource capacities can be statistically multiplexed, hence more processing requests can be granted
Disadvantages: QoS may be temporally violated
CS 414 - Spring 2012
![Page 31: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/31.jpg)
Relation between QoS and Resources
CS 414 - Spring 2012
Translation, Scaling, Negotiation
ReservationAdmission
Scheduling, Rate ControlFlow Control, Congestion Control, Adaptation
![Page 32: CS 414 - Spring 2012 CS 414 – Multimedia Systems Design Lecture 14 – Introduction to Multimedia Resource Management Klara Nahrstedt Spring 2012](https://reader038.vdocuments.us/reader038/viewer/2022110205/56649cb95503460f9497f8fa/html5/thumbnails/32.jpg)
Conclusion QoS – an important concept in multimedia
systems Very different types of QoS parameters and
values Important relation between QoS and
Resources Need to understand operations on QoS and
their impact on resource management
CS 414 - Spring 2012