Discussion of a Framework for an Alternative Spectrum Use by PMSE

Prof. Dr.-Ing. Georg Fischer

Lehrstuhl für Technische Elektronik

Chairman ETSI STF386

Birthplace of mp3

1. What’s going on? - Challenges of the future

2. Spectrum situation with PMSE

3. Proposal for a way forward - Creative Spectrum

4. Technical approach with Creative Spectrum

5. Conclusion

2

Content

Creative Spectrum

1. What’s going on? - Challenges of the future

3

4

What’s going on? - Challenges of the future Moore‘s law

Creative Spectrum

Quelle: H. Bähring, Mikrorechnertechnik, Band , Springer, 2002.

Gordan Moore, TI

1965:

“Complexity of an IC

is doubling every 2

years”

Integration density of Electronics is doubling every two years

5

What’s going on? - Challenges of the future ITRS Roadmap

Creative Spectrum

Source: INTERNATIONAL TECHNOLOGY ROADMAP FOR SEMICONDUCTORS (ITRS) 2009 EDITION

New Sensors

enablers for

immersive

perception!

6

What’s going on? - Challenges of the future Edholm’s law of bandwidth

Creative Spectrum

Wireless data rates

are growing faster

than wireline!

We will run into a

serious problem!

LTE 50 Mbit/s

1 Gbit/s

Source: Steven Cherry, Edholm’s Law of Bandwidth,

Telecommunications data rates are as predictable as Moore’s Law, IEEE Spectrum, July 2004

Phil Edholm, Nortel’s chief technology officer and vice president of network architecture

Extrapolation

EASY-A/C,

LTE Advanced

7

What’s going on? - Challenges of the future Analysis by APWPT

Creative Spectrum

Source: M. Fehr, APWPT

Data Rate is doubling every two years

8

What’s going on? - Challenges of the future CISCO study

Creative Spectrum

Mobile Communication Data amount is Doubling each year!

9

What’s going on? - Challenges of the future CISCO study

Creative Spectrum

Laptops and

Smartphones with

QuadCore and HD

Display…

10

What’s going on? - Challenges of the future CISCO study

Creative Spectrum

Where does the

audiovisual content

come from?

Wireless cameras,

wireless microphones,

so PMSE…

11

What’s going on? - Challenges of the future CISCO study

Creative Spectrum

If we want HD on our

tablet, how do we

produce the high

quality content we want

to consume?

…PMSE is key for

production

Find a modus for

coexistence between

PMSE and mobile

communication

12

What’s going on? - Challenges of the future Eurovision Song Contest

Creative Spectrum

Number of links doubling every 5 years

1998 Birmingham / UK 40 ch Mic + 2 ch IEM 42

1999 Jerusalem / Israel 42 ch Mic + 6 ch IEM 48

2000 Stockholm / Sweden 48 ch Mic + 16 ch IEM 64

2001 Copenhagen / Denmark 48 ch Mic + 16 ch IEM 64

2002 Tallinn / Estonia 54 ch Mic + 16 ch IEM 70

2003 Riga / Latvia 54 ch Mic + 16 ch IEM 70

2004 Istanbul / Turkey 54 ch Mic + 16 ch IEM 70

2005 Kyiv / Ukraine 54 ch Mic + 16 ch IEM 70

2006 Athens / Greece 54 ch Mic + 16 ch IEM 70

2007 Helsinki / Finland 56 ch Mic + 16 ch IEM 72

2008 Belgrade / Serbia 56 ch Mic + 16 ch IEM 72

2009 Moscow / Russia 56 ch Mic + 16 ch IEM 72

2010 Oslo / Norway 72 ch Mic + 32 ch IEM 104

2011 Düsseldorf / Germany 82 ch Mic + 40 ch IEM 122

2012 Baku / Aserbaijan 104 ch Mic + 40 ch IEM 144

Number of

PMSE links

13

What’s going on? - Challenges of the future Evolution of Audio Formats

Creative Spectrum

# of audio channels with audio format in the past doubling every

20 years, now quicker growth rate

1920 Mono Rundfunk in Deutschland 1

1962 Stereo Einführung in D 2

1970 Quadrophonie Schallplatten in Quadro 4

1987 Surround 5.1 Definition des Standards 6

1999 Surround 6.1 Star Wars Film 7

1993 Surround 7.1 Last Action Hero 8

Surround 9.1 10

Surround 8.4 12

Surround 22.2 24

Surround 29.1 30

Number of

channels

Wishes

• Multichannel Audio/Video, immersive

• HD Audio/Video wireless

• 24 bit Audio Studio quality over wireless

14

What’s going on? - Challenges of the future Discussion of findings

Creative Spectrum

Findings

• Microelectronics integrations density - doubling every 2 years (Moore’s law)

• Data rate on interfaces – doubling – doubling every 2 years (Edholm’s law)

• Data amount in mobile communication – doubling every 1 year (Cisco Study)

• PMSE Growth – doubling at least every 5 years, probably faster…

• Drivers: HD and Immersive audio-visual capture

Discussion

• Every user of spectrum has an exponential growth rate

• The content that is to be distributed must be produced

• So spectrum need by distribution and production both have exponential growth

Fairness

• There is no argument why only one kind of services has the right for growth and the

other not…

• All services have their socioeconomic benefit and interdepend

• Without HD content being produced there would be no HD content to be distributed

• Several growing services are competing with the limited spectrum resource

• Spectrum is a naturally limited finite resource, it cannot be magnified

15

What’s going on? - Challenges of the future Immersive perception

Creative Spectrum

Holodeck,

telepresence

Source: Star Trek

Can we fully

capture an event,

performance?

Produce it ?

Reproduce it in

an immersive

way?

We are on the

way by audio &

video in HD, 3D,

multichannel,…

16

What’s going on? - Challenges of the future New Mobile GUIs

Creative Spectrum

Google Glasses

Source EDN

Source: Microvision

Source: Celluon

Source: Microvision Quadcore Smartphone LG

2. Spectrum situation with PMSE

17

18

Spectrum situation with PMSE Spectrum lost for PMSE-Audio

Creative Spectrum

470 862

f/MHz

790

Mobile Communication

co-primary to TV

880 915

TV primary, PMSE secondary

925 960

GMS/UMTS/LTE

UL DL

Digital Dividend I

-20%

694

Digital Dividend II

-24%

502

Further Digital

Dividend -8%

If primary assignment

is lost,

secondary is also

immediately lost

PSS Public Safety

and Security

e.g. TETRA

-52%

Regulation

• PMSE-Audio is a secondary service in TV band

• It is imagined that in future 400…6000 MHz could all be Mobile

Communication

19

Spectrum situation with PMSE exponential growth

Creative Spectrum

Exponential growth

It is impossible to satisfy an exponential traffic growth

by linearly adding more spectrum

Do you know the fairy tale?

1 rice corn on the first field, then

2, 4, 8,16, 32, 64, 128, 256, 512, 1024, 2048, ...

There is rumour 400…6000 MHz will all become Mobile communication…

Giving more spectrum in a linear way will not satisfy Mobile demand…

Total spectrum needs to double after each DD?

Yearly DDs? Doubling total spectrum …..impossible….

It is a hydra....

cut one head, two new will grow…

20

Spectrum situation with PMSE exponential growth

Creative Spectrum

Linear growth

of Spectrum

Exponential

growth of data

How to fill

the gap

coming up?

21

Spectrum situation with PMSE How to increase cellular network capacity?

Creative Spectrum

View from a regulator - OFCOM

Small Cells (Femtos) have the highest potential,

far more than a total digital dividend, consequence?

The source coding card

Reducing

protocol

overhead

Digital

Dividend

card

The FEMTO

option

3. Proposal for a way forward

- Creative Spectrum

22

23

Proposal for a way forward - Creative Spectrum Spectrum assignment for PMSE

Creative Spectrum

PMSE Applications

• Audio

• Video

• Effect control (Lighting, Fire, Coloured walls, fog, …)

• Conference Systems

• Talk-back Systems

• Stage-Alarm Systems, production safety networks

Actual spectrum assignments

• Every application has an individual piece of spectrum

• Increases spectrum fragmentation - inefficient

• Only secondary status or even ISM band without any protection at all

• Does PMSE want status as secondary, competing with WSD?

Proposal for future spectrum assignment

• Assign spectrum to an event/production

• Spectrum is dynamically partitioned across applications according to real-time need

• Under control of producer

• Chance for a status in preference to secondary applications

Wireless Microphone

Camera receiver

Camera

Light effect

Fog machine

24

Proposal for a way forward - Creative Spectrum Spectrum assignment for PMSE

Creative Spectrum

You need to talk one voice

Audio, Video, effect, safety,…

We need to join forces….

CREATIVE SPECTRUM

The only one chance for primary/Co-primary status…

25

Proposal for a way forward - Creative Spectrum SWOT analysis for “Creative Spectrum”

Creative Spectrum

Strength

• Spectrum is a very valuable resource (recent 120 Mil €/MHz paired in Germany)

• Spectrum handled very efficiently, fragmentation is overcome

Weaknesses

• So far Audio, Video, effect, safety community not well interlinked

• Need to join forces, talk one voice, bring communities together

Opportunities

• Only a summarized view on all kinds of PMSE applications will open the chance for

primary/co-primary status in regulation

• Ensure highest and increased production quality and immersiveness

• Enabling us to cope with the challenges of the future (growth laws)

Threads

• Total Creative Spectrum will be very fragmented, e.g. spread over several duplex gaps

• Dynamic partitioning of Creative Spectrum across multiple applications

• In-situ change of spectrum partitioning during production

• Joined Radio Resource Management across all applications

4. Technical approach with Creative Spectrum

26

27

Technical approach with Creative Spectrum Source Coding

Creative Spectrum

Todays view on source coding

• PMSE for high quality production uses limited compression

• Digital Audio typical 2:1 to 4:1 (analogue compander equiv. to 2:1)

• Constant rate coder

• Spectrum would be saved with higher compression, but this would

severely degrade quality and lead to artefacts when concatenating

codecs in production and distribution

• Higher compression typically comes with increased latency

New approach

• Use “near lossless” codecs to meet quality objectives

• A near lossless codec will always be variable rate

• Produced data rate depends on level of details in information source

• Quiet microphones and still pictures deliver low rate….

28

Technical approach with Creative Spectrum Statistical Multiplexing Gain

Creative Spectrum

Realistic view on an event/production…

• It is very unlikely that all sensors (Microphones, cameras, talk back) at

the same time capture a very detailed information source

• It is very unlikely that all microphones produce the highest data rate in

the same moment

• It is very unlikely that all cameras produce the highest data rate in the

same moment

• It is very unlikely that a peak in data rate coincide with audio, video,

effect control,…

Statistical Multiplexing Gain

• If several sources vary their data rate, the sum has less variation

• Central limit theorem – the sum has less variation than its individual

summands

• In total less spectrum needed

29

Technical approach with Creative Spectrum Statistical Multiplexing Gain

Creative Spectrum

Will all people talk at the same time?

Will all cameras capture fast changing pictures?

All happening in exactly the same moment? NO!

Source: Benedikt & Jakob

30

Technical approach with Creative Spectrum Physical Layer Design

Creative Spectrum

PHY Design

• Data rate per link must follow the variable rate produced by source coder

• Dynamic scheduling at a scale of 1…20 ms

• Video frame rate naturally 20 ms (50 fps)

• OFDM air interfaces using Radio Resource blocks (time-frequency-tiles)

allow for high flexibility, e.g. LTE PHY 10 ms frame, 10x 1 ms subframes

Radio Resource Management

• Controls total spectrum “Creative Spectrum”

• In charge of partitioning spectrum across applications

• Must be highly dynamic 1...20 ms scale

• Must know the in situ need by each sensor

• Not all services with same latency requirements

• Serving different QoS and QoE requirements across applications

• Scaling of Service Levels, soft degradation mechanisms

31

Technical approach with Creative Spectrum Open Questions

Creative Spectrum

Source coding related

• How much rate variability is there with audio and video source coding?

• Suitable near lossless Audio and Video codecs?

• Peak and average compression factors?

• Quantify the Statistical Multiplexing gain with an event

• Latency introduced by near lossless codes

PHY related

• OFDM air Interface design? Air interface parameters?

• Reuse of existing air interfaces?

• Reuse of existing chip solutions? Synergistic cost savings?

RRM Related

• Update rate of RRM? 1…20 ms? What makes sense?

• QoS to QoE mapping

• Cross Layer aware scheduling

32

Technical approach with Creative Spectrum Open Questions

Creative Spectrum

Neighbour and nomadic production

• How to exchange information between neighboured productions?

• Real-time exchange of signalling and resource information?

• What to align with nomadic productions?

• How does the RRM know about what’s going on

in its surrounding?

Regulation

• Will regulators accept the concept for “Creative Spectrum” supporting the

Cultural and Creative Sector CCS?

• Will we be successful in obtaining primary/co-primary status?

Alternative way? GDB – keep secondary status of PMSE

• Geolocation databases (GDB) are gaining acceptance

• WSD and PMSE using GDB would also deliver protection

• What if GDB is not accepted or not all WSD hook up with GDB?

• PMSE would not have protection…Plenty of WSD creating interference for

PMSE…not really an option

Source: Benedikt &

Jakob

5. Conclusions

33

34

Conclusions Open Questions

Creative Spectrum

Spectrum

• Spectrum is a naturally limited finite resource

• Spectrum demand exponentially increasing in production (PMSE) and

distribution (mobile communication)

• All have to use spectrum more efficiently

Creative Spectrum

• A new approach for overcoming fragmentation across all PMSE applications

• The only one chance for primary or co-primary status

• The only way to cope with increasing future demands

• The next level after BMWI C-PMSE project and ETSI STF386

Technical Approach

• Near lossless, variable rate audio and video codecs

• Drawing statistical multiplexing gain

• A new PHY with highly dynamic RRM at 1…20 ms scale

• QoS, QoE aware scheduling, cross layer optimization