cs 529 multimedia networking review. digital audio what is the tradeoff between sample size and...
TRANSCRIPT
![Page 1: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/1.jpg)
CS 529 Multimedia Networking
Review
![Page 2: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/2.jpg)
Digital Audio
• What is the tradeoff between sample size and fidelity? Between sample rate and fidelity?
• What uses of computer audio require a high sample rate and large sample size? Which do not? Why?
a
![Page 3: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/3.jpg)
Digital Audio
• What are the sample rate and sample sizes for typical voice-quality audio?
• If typical encoding captures a wave form “as it is”, what does MP3 attempt to do? And how?
a
![Page 4: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/4.jpg)
[RS75]
• What is energy?• What is the zero crossing rate?
• More importantly– how are they used?– why are they used?
![Page 5: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/5.jpg)
[RS75]
• What is IMN?– How computed?
• What is IMX?– How computed?
![Page 6: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/6.jpg)
Digital Video
• What are typical frame rates for videos?• What are some common resolutions for
videos (e.g., HD)?• How many bits are needed for “true color”
images?
![Page 7: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/7.jpg)
QoS and Multimedia Applications
• Rank sensitivity (low, medium, high) for
Conversational Voice and DelayStreaming Video and DelayConversational Voice and CapacityStreaming Video and Capacity
![Page 8: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/8.jpg)
Transport Protocols
• One reason TCP is “good” for multimedia applications? Example?
• One reason TCP is “bad” for multimedia applications? Example?
• One reason UDP is “good” for multimedia applications? Example?
• One reason UDP is “bad” for multimedia applications? Example?
![Page 9: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/9.jpg)
Buffering
• What is a playout buffer?
• What is it used for?
• How big is it?
![Page 10: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/10.jpg)
Skype
• What is the network architecture used for Skype?– What kinds of nodes are there?– How are the nodes connected?– Why are they connected this way?
![Page 11: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/11.jpg)
HTTP Streaming
• How does HTTP work for streaming video?
• Where is the “intelligence” in an HTTP streaming system?
![Page 12: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/12.jpg)
Multimedia Quality Assessment
• Broadly, what are two types of methods to assess multimedia performance?
• What is an example of each method for assessing voice quality?
![Page 13: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/13.jpg)
Experiments in CS
• What are the main steps in the scientific process?
• Provide a Hypothesis for something in Multimedia Networking– How would you test it?
![Page 14: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/14.jpg)
NetFlix
• Why isn’t frame loss a component of video quality for NetFlix?
• What are the components of NetFlix video quality?
![Page 15: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/15.jpg)
RTP
• What is it?• Can I use it instead of TCP/UDP?• What are some of RTP’s major features?
![Page 16: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/16.jpg)
SIP
• What is it? • What services does it provide?
– Registrar?– Proxy?
• How does it allow for a “mobile” caller?
![Page 17: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/17.jpg)
Network Support for Multimedia?
• What are alternatives to “best effort”?• What is a challenge to “guaranteed” QoS?
![Page 18: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/18.jpg)
Video Compression
• How is it similar to image compression?• How is it different?
• MPEG– What is a GoP?
![Page 19: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/19.jpg)
[WS00]
• What is at least one implicit hypothesis the researchers test?
• How are subjective audio quality ratings provided?
• How are objective audio quality “costs” gathered?
![Page 20: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/20.jpg)
[WS00]
• What is at least one implicit hypothesis the researchers test?– What are some of the independent variables?
• What tool do the researchers use to test audio?
![Page 21: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/21.jpg)
[WS00]
• Provide order, best to worstQuiet – one recorded low volume, other normBad mic – one had low quality mic, other norm5% loss – both voices, with repetitionLoud – one recorded high volume, other norm20% loss – both voices, with repetitionEcho – one had open mic, no headsetReference – non-degraded
![Page 22: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/22.jpg)
[HHH+12]
• Why is commercial streaming over HTTP confused?
• Why is commercial streaming over HTTP timid?
![Page 23: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/23.jpg)
[RBV+12]
• Which is best?
• What else should be considered?
![Page 24: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/24.jpg)
[LG14]
• For video messaging on smartphones, what are two main factors affect transmission speed?
• What are some suggested improvements by the authors?
![Page 25: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/25.jpg)
[LG14]
• For video messaging on smartphones, what are two main factors affect transmission speed?
Answer: file size and location
• What are some suggested improvements by the authors?
Answer: Compress/transcode and distribute images among servers in cloud
![Page 26: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/26.jpg)
[SKH02]
• What are the 3 fundamental limitations faced by MCGs?
![Page 27: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/27.jpg)
[SKH02]
• What is the tension/tradeoff between responsiveness and consistency in MCGs?
• What is interest management? Describe how it works
• What is dead reckoning? Describe how it works
![Page 28: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/28.jpg)
[SJNC13]
• What are the benefits of using cloud gaming instead of traditional gaming?
• What are the challenges?
![Page 29: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/29.jpg)
[CFGS14]
What are the main messages from the graph based on [CFGS14]?
![Page 30: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/30.jpg)
[CFGS14]
• Order these from least downstream bitrate to most:– Thin game– Live video– Pre-recorded video– Traditional game– Virtual environment
• What are the approximate bitrates for each?
![Page 31: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/31.jpg)
[CFGS14]
Turbulence Summary
![Page 32: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/32.jpg)
[SJ95]
• What is the E-Policy?• What is the I-Policy?
• When, in general, is the E-Policy good?• When, in general, is the I-Policy good?
• What is a talkspurt?
![Page 33: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/33.jpg)
[SJ95]
• How does QM-120 work?
• What is QM-(600,2)? What is the motivation behind it?
• Describe one item of future work.– Why is it of interest?– Briefly, how would you approach doing it?
![Page 34: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/34.jpg)
[WCCL09]
• What are the challenges proposed by the paper?– Hint: it considers buffer sizes
• What have the academics done about the challenges?
![Page 35: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/35.jpg)
[WCCL09]
• Briefly describe the methodology the author uses to determine the “optimal” buffer size
![Page 36: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/36.jpg)
[WCCL09]
• Briefly describe the methodology the author uses to determine the “optimal” buffer sizeAns: 1. Encode audio samples2. Simulate loss3. Add delay, dropping if needed4. Decode 5. Apply QoE measure – PESQ + E-model6. Repeat 1-5 for all buffer sizes, with highest QoE
being optimal
![Page 37: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/37.jpg)
[WCCL09]
• Interpret the above graph• What are the main messages?
![Page 38: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/38.jpg)
[PHH98]
• What are the client loss characteristics of the Mbone (and other P2P networks)?
• Why can TCP and retransmissions be used to repair loss in the Mbone?
![Page 39: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/39.jpg)
[PHH98]
• What is forward error correction (FEC)?
• What are the two categories of FEC described by the authors? What are the main advantages and disadvantages of each?
![Page 40: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/40.jpg)
[PHH98]
• Broadly, what are receiver based repair techniques? Why are they often called error concealment?
• What is a recommended repair technique for a non-interactive, multicast multimedia session? Why?
![Page 41: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/41.jpg)
[HCH09]
2%
0%1%
0%
3%4%
5%6%
7%8%
9%10%
Significance of picture for Skype?
![Page 42: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/42.jpg)
[HCH09]
• What’s is the optimal redundancy ratio for repair as defined by the authors?
![Page 43: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/43.jpg)
[HCH09]
• What’s is the optimal redundancy ratio for repair as defined by the authors?Ans: Minimum amount of redundancy data needed to sustain same audio quality under different network conditions
![Page 44: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/44.jpg)
[HCH09]
How did the author’s generate this graph? How to read it?
![Page 45: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/45.jpg)
[HKBT01]
• What “alternate” service does ABE offer?– What is green traffic?– What is blue traffic?
![Page 46: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/46.jpg)
[HKBT01]
• What does it mean to say “Green does not hurt Blue”?
• Based on below formula, what happens if green “cuts” in line? How do you fix it?
![Page 47: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/47.jpg)
[HKBT01]
Using DSD, what is the order of the next 3 packets?
![Page 48: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/48.jpg)
[HKBT01]
What is the significanceof this graph?
![Page 49: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/49.jpg)
[LCK10]
• What general property about network bitrates and latency sensitivity does CHAP rely upon?
• What are credits as assigned by CHAP? How are they assigned? How are they “spent”?
![Page 50: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/50.jpg)
[LCK10]
• Interpret the above graph• What are the messages for CHAP?
0 100 200 300 400 500 6000.0
0.5
1.0
FIFO (only qstat)FIFO (qstat + 1 HTTP downloads)
Server Ping (ms)
![Page 51: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/51.jpg)
[MSM04]
• How does the above quote relate to motivation for the proposed work?
• Describe the authors’ variant on the “method of limits” to determine video quality
Recent IBM QoS policy says:“The priority for smooth video is higher than the priority for frame quality”
![Page 52: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/52.jpg)
[MSM04]
• What was difference between acceptability of video for Palmtops versus Desktops?
![Page 53: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses](https://reader036.vdocuments.us/reader036/viewer/2022062516/56649d995503460f94a84067/html5/thumbnails/53.jpg)
[CC10]
• What are three primary ways latency affects players in network games?
• How much does latency affect players in network games?