Live Music Mode: Case Study and Development

Performing Arts Production Workshop

Trieste, Italy

14 July 2009

Stefan Karapetkov

Emerging Technologies Director

Polycom

2

Manhattan School of Music

3

Manhattan School of Music

International Conservatory of Music (1918)

Offering BM, MM and DMA in Classical & Jazz Music

800+ students from over 48 countries

350 Faculty

400 students in Precollege Division (5-17)

400+ Public Concerts/Year

4

Manhattan School of Music

5

Core Philosophy and Technologies

Live, interactive audio-visual communication in virtual environment Connect, Interact, Listen, Learn

Integration of standards-based, interoperable collaboration video solutions in real timeGroup-based videoconferencingLive web streaming - archival video distancelearning.msmnyc.edu/live

6

Pinchas Zukerman at Canada Art CentreTeaches a Student in New York

7

Classical Program at MSM

8

Jazz Program at MSM

9

Video Network Elements

Personal Telepresence

Room Based Telepresence

Soft Client

Recording

Video Border Proxy

Media Servers

Management Application

Gateways

Directory PresenceContent Mgmt GK/Proxy

10

Audio and Video Compression

Concert Site Remote Site

11

Advanced Audio Compression Technology

Data Bit Rate

Au

dio

Fre

qu

ency G.722.1G.722.1

G.722G.722

AMR-NBAMR-NB

G.711G.711

G.722.2G.722.2

Wid

eb

an

d

Na

rro

wb

an

d

4 kbps 64 kbps 128 kbps

Siren 14 stereoSiren 14 stereo

G.729AG.729AG.728G.728

G.722.1CG.722.1C

Su

per

Wid

e

G.719 stereo G.719 stereo

Siren 22 stereoSiren 22 stereo

12

Audio Codec Highlights

Bandwidth Bit rate Delay Complexity Standard Algorithm

SIREN22 22 kHz32-64 kbps mono

64-128 kbps stereo

40 ms 18.4 MIPS N/A Transform

G.719 20 kHz32-128 kbps mono

64-256 kbps stereo

40 ms 17.7 MIPS ITU Transform

MP3 ≤ 20 kHz 64-384 kbps ≥ 54 ms > 100 MIPS ISO Transform

MPEG-4 AAC-LD ≤ 20 kHz

24-192 kbps(TAA: 64 kbps

mono128 kbps stereo)

≥ 20 ms > 130 MIPS ISO Transform

13

Automatic Gain Control (AGC)

Signal strength

AGC adds 0dBAGC adds 3dB

AGC adds 6dB

Max. 12 feet from microphone

Nominal is 2 feet from microphone

14

Automatic Noise Suppression (ANS) & Noise Fill

Signal White noise

Signal

Signal Comfort Noise

ANS Noise Fill

15

Acoustic Echo Cancellation (AEC)

Echo

AEC Coupling

16

Advanced Video Technology: High DefinitionQ

ualit

yQ

ualit

y

BandwidthBandwidth384kbps 512kbps 1Mbps 6Mbps

480p

720p

352x288

704x480

1280x720

1080p4K

1920x10803840x2160

Email Stefan.Karapetkov@polycom.comBlog http://videonetworker.blogspot.com/