Technical Update - Ken Hodge

The cabling system

Build & function• Metro• Backbone• General office• Data Centre• Industrial Premises• Residential…..

IT Applications• Voice• Data• Broadcast technologies• Ethernet & IP technologies• QoS & demand priority….

Planned life of the installation• 3 year• 5 year• 10 year• 10+ year……

Protocols• Gigabit Ethernet• PoE & PoE+• 10GbE• 40GbE &100GbE• 1, 2, 4G & 10G FC• Infiniband• FCoE• Data Centre Ethernet

Cabling Decisions

Technology Advances

Intel:• ‘the HPC of today is the PC of tomorrow’• ‘the #1 High Performance Computer (HPC)

performs at 1PetaFlop• 1 PetaFlop = 1015 FLoating Point Operations Per Second

• ‘an ExaFlop (1018) will be required by 2020’

IBM roadrunner

Transmission Technology Developments:• TeraBit transceivers

• 25 x 40Gbps externally modulated lasers• 40GBps transceivers

• 40Gbps serial laser technology (1300nm)• 2x20G VCSELS (840 & 860nm) with CWDM

• Higher bandwidth MMF 4700MHz.km• Low bend loss SMF

Source: Vertically Integrated Systems

Higher Speed Applications

Current Developments in IEEE

802.3az Energy Efficient Ethernet (EEE) expected to be approved in Sept 2010

802.3ba High Speed Ethernet (HSE) 40GbE & 100GbE expected to be approved in June 2010

802.3av 10G EPON approved in Sept 2009

802.3at PoE-plus approved in Sept 2009

802.3aq 10GbE LRM 802.3an 10GBASE-T 802.3ae 10GbE

New Applications in DevelopmentIEEE

CFITF

ReviewWG

Ballot

SponsorBallot Standard

StudyGroup

J F M A M J J A S O N D2007

J F M A M J J A S O N D2008

Task Forcesanctioned

J F M A M J J A S O N D2009

J A S O N D2006

J F M A M 2010

1. support full-duplex operation only2. preserve 802.3 Ethernet frame format3. preserve 802.3 min/max frame sizes

4. support a BER of > 10-12 at MAC/PHY interface5. support a MAC data rate of 40G + PHY specs:

for at least 10km on SMF for at least 100m on OM3* for at least 7m on copper cabling for at least 1m over a backplane

6. support a MAC data rate of 100G + PHY specs: for at least 40km on SMF for at least 10km on SMF for at least 100m on OM3* for at least 7m on copper cabling

7. provide appropriate support for OTN

IEEE 802.3ba HSE Project Objectives

* and 125m on OM4 cabling

• Basics– Multi-lane transmission– MPO connector (IEC 61754-7)– Cable Skew 80ns (50/125 ≈ 16.2m)

• 40G–40GBASE-SR4

• 4x10G transmission• 8f OM3 cable

• 100G–100GBASE-SR10

• 10x10G• 20f OM3 cable

QSFP

Tx Rx

Tx

Rx

MPO

IEEE 802.3ba 100m MMF

Original

1260 – 1360

Extended

1360 - 1460

Water Peak Band

Short

1460 -1530

Conv

1530 –

1565

Long

1565 –

1625

UL

1625 -

1675

ITU-T definition of optical wavelength bands

Dis

pe

rsio

n (㎰

/㎚-㎞

)

Att

en

ua

tion

(d

B/㎞

)

SSMF IEC 60793-2-50 type B1.1

ITU-T G.652B

ESMF (enhanced)IEC 60793-2-50 type B1.3

ITU-T G.652D

1264 –

1277

1284 –

1297

1304 –

1317

1324 –

1337

CWDM1264-1337nm

40GBASE-LR4

DWDM1294-1310nm

100GBASE-L & E

IEEE 802.3ba SMF

Source: IEEE 802.3ba barbieri_01_0908 (Cisco)IEEE 802.3ba HSE roadmap - CISCO

Market forecast – Data Centre servers

Port speed in serverssource Intel HSSG 2007

0

2

4

6

8

10

12

14

16

18

20

2000

2001

2002

2003

2004

2005

2006

2007

2008

2009

2010

2011

2012

2013

2014

2015

Ser

ver

po

rts

(mil

lio

ns/

year

)

100G

40G

10G

1G

100M

10G server speeds grow strongly from 2009

Market forecast – LAN switches

Port speed in switches

0

50

100

150

200

250

300

350

400

450

2000

2001

2002

2003

2004

2005

2006

2007

2008

2009

2010

2011

2012

2013

2014

2015

Ser

ver

po

rts

(mil

lio

ns/

year

)

100G

40G

10G

1G

100M

10M

Sources: Del Oro 2006 & Cisco 2008

10G switches grow share from 2009

40Gbps on Structured cabling?

A further development?

“the imperative of self accelerating growth is limited by the environment”, Morgan-Mercer-Flodin

‘BASE-T’ technology:• 10Mbps 12.5MHz • 100Mbps 31.25MHz• 1G 80MHz

• 10G 416MHz

Ethernet over TP

Frequency (MHz)

Dat

a R

ate

(Mbp

s)

0 200 400 600 800 1000 1200 1400 1600 1800 2000

40Gbps = 2000MHz

• 40G ≈ 2 GHz

U-mediaPlus

Cable Standards U-mediaPlus cables

Class F, 600MHzEN50288-4IEC 61156-5

Class FA, 1GHzDraft EN50288-9, EN50441-3Draft IEC 61156-5 edition 3

UM10, 600/100023 AWG S/FTPS/FTP P27

UM12, 1/1.2 GHz22 AWG S/FTPS/FTP P27

Cable only 1.2GHzIEC 61556-7 (-8 draft)Draft EN50288-12

Cable only 2GHzNWIP in IEC & CENELEC

UM15, 1.2/1.5 GHz22 AWG S/FTPS/FTP P##

UM20, 2 GHz22 AWG S/FTPS/FTP P##

Rectangular connectors IEC 61076

System characteristics• Shannon

– S/N @ 2GHz > 18dB – IL/NEXT– IL/RL– PSD/Background noise

NB: There is no current work in IEEE on twisted pair cabling for 40G

S/N - link with 'square' connector

-100

-90

-80

-70

-60

-50

-40

-30

-20

-10

0

0 500 1000 1500 2000

Frequency (MHz)

dB

50m

100m

Class FA NEXT

IEC 61076-3-105 connector

40GBASE-T = 2GHz Cu cabling?

40Gbps capable cabling

Cat7ACat7Cat6A

Cat6

100 250 600 1000 2000

MHz

1Gbps

10Gbps

40Gbps

Cat5e

500

40GBASE-T = 2GHz Cu cabling?

ISO/IEC

CENELECANSI/TIA/EIA

ECBS

IEEE

Standardisation & Regulation

Design Specification InstallationOperation & Maintenance

EN 50346 & A.1: 2007Testing installed cabling

EN 50310: 2006Application of equi-potential

bonding & earthing

EN 50174-3: 2003Installation planning &

practises outside buildings

EN 50174-2: 2008Installation planning & practises in buildings

EN 50174-1: 2008Specification & Quality

Assurance

EN 50173-5: 2006Data Centres

EN 50173-1: 2007Generic Cabling

EN 50173 Generic IT Cabling:

• EN 50173-1: General Requirements• EN 50173-2: Office Premises• EN 50173-3: Industrial Premises• EN 50173-4: Homes• EN 50173-5: Data Centres

Open projects:

• EN 50173-1 Amm1 – EA & FA channel

• EN 50173-1 Amm2 – EA & FA, OM4, OS1a&b, 40 & 100G

• EN 50173-2 Amm1• EN 50173-3 Amm1• EN 50173-4 Amm1 • EN 50173-5 Amm1

• OM3 & ClassEA recommended• EN 50288-10 & 13: 500MHz Cables• IEC 60603-7-41 & 51: 500MHz

Connectors

Cabling Standardisation

The Class EA standard set is not completed

Brand-Rex has been offering Z50 (OM4) cabled optical fibre for over 4 years in indoor and outdoor cables

Advantages of OM4:• Allows 10GBASE-SX more power budget for 300m, or shorter, links• Allows 10GBASE-SX devices to reach up to 550m• Potential for extended 40G/100G links if IEEE approve

Brand-Rex optical cables with the fibre code Z50 contain optical fibre to the highest 50/125 bandwidth specification – this performance level is now being standardised by ISO/IEC and IEC as OM4 cabled optical fibre

Brand-Rex Z50 (OM4) cabled optical fibre

OM4 cabled optical fibre as defined by ISO/IEC 11801 (draft)

10GbE Optical Loss Budgets

Cabling Maximum channel insertion loss (dB) for 10GBASE-

type Freq. (nm)E L LX4 LRM S

Laser Laser Laser Laser VCSEL

OS1 SMF1550 11.0 x x x x

1310 x 6.2 6.2 x x

OM3 MMF1300 x x 2.0 1.9 x

850 x x x x 2.6

OM2 MMF1300 x x 2.0 1.9 x

850 x x x x 1.8

OM1 MMF1300 x x 2.5 1.9 x

850 x x x x 1.6

9/3/2009 Brand-Rex Copyright 2009

New methods to measure optical links

New Methods• ISO/IEC 11801 & AM1: Generic

Cabling• ISO/IEC 14763-3 & AM1

– Testing Optical Fibre cabling• IEC 61280-4-1

– Multi-mode attenuation measurement

9/3/2009 Brand-Rex Copyright 2009 23

Offset connector

LED

VCSEL

Laser

EF encircled flux - fraction of cumulative near field power to total output power as a function of radial distance from the optical centre of the core

- -1.9 dB2.3 dB

- -1.9 dB2.3 dB

Optical Link Margin Errosion

Upgrading links to 40GbE

10GbE to 40GbE link example:

10GbE → 40GbE

6 x 10GbE connections

6 duplex LC Cords

MPO to LC

MPO to LC

12f cable

MPO to MPO

MPO to MPO

12f cable

1 off 8 fibre MPO Cord

1 x 40GbE connections

802.3af • DC Power at 48V on 45,78• 37V x 350mA = 12.95W at the outlet• End point & mid span 100BASE-T• Cat5 or better cabling

802.3at• 30W power, 25.5W at the outlet on 100m link• End Point & mid span on 1000BASE-T

• Targetting mid span on 10GBASE-T• Operates on Cat5e or better cabling

• temperature rise of cable bundles see draft ISO/IEC TR 29125• Status - Publication expected Sept 2009 (imminent)

IEEE 802.3at Power over Ethernet+

Temperature rise vs. cable category & bundle size (720mA per pair)

“Cabling Guidelines for Remote Powering of DTEs - Guidance on Cable Thermal Behaviour”

ISO/IEC TR 29125

Fire Prevention & Safety

• European Regulation– 18th May 2009 - Mandate 443 issued to CENELEC

• Reaction to fire – 1994/611/EC• Resistance to Fire – 2000/367/EEC• Dangerous substances – 76/769/EEC

CENELEC ‘Reaction to Fire’ Test Methods

Integrated fire test:– Flame Spread– Smoke – Heat

• prEN 50399-2-1– FIPEC 20 scenario1– 20kW burner

• prEN 50399-2-2– FIPEC 20 scenario2– 30kW burner & backboard

Cabling ISO/IEC

Cabling CENELEC

Cabling EIA/TIA

Cabling UK

Cable ISO/IEC

Cable CENELEC

Connectors ISO/IEC

Pre 2009 2009 2010 ………….. 2018Event map

EN 50288-11

IEC61076-4-103 & 104

IEC 61076-4-###

EN 50441-1,2,3

IEC 61156-5 ed2

EN 50288-10

IEC 60603-7-41 & 51 & 71

IEC 61156 ammendmentsIEC 61156-1 ed3IEC 61156-1 ed2

Technology optical

Technology Cu

VCSEL

eMMF

eSMF

Level IIIe

OM4

2GHz 4 pair?

SFF connectors

10GBpstwinax

SFP+

10GBps 4 pair

500MHz 4 pair

Hybrid SMF/MMF?

40GBpstwinax

QSFP

1GHz 4 pair

40GBps4 pair?

EthernetFibre Channel Infiniband

PoE

10GbE

802.3af

10GBASE-T Data Centre switching100G+ &

FCoE?

802.3at

40GbE 100GbE

Office switching 10G & PoE++?

16GFC8GFC4GFC

32GFC10GFC

40GBASE-T?

64GFC20GFC

10G DDR 20G EDR10G QDR60G 12xDDR 120G 12xQDR 240G 12xEDR

IS 11801

EN50173-1 ed2

TSB155TIA 942

EN 50173-5 ammendment

TIA 568CTIA 568B.2-10

EN 50173-5

IS 14763-2

BS 6701 BS 8492

IS 24702

IS 15018

IS 24750

EN50173-1 ed3

BS 7671

TIA 942 ammendment?

IS 24750 IS 24764

IS 11801 Amm 1 Class EA & FA

IS 11801 Amm 2 Class EA & FA

IS 11801 Ed 3

EN50174-1 ed2 EN50174-2 ed2

Forecasts

Copper and Optical LAN cabling

Ou

tlet

s (m

illi

on

s)

Cu Cable – Data Centres (source: BSRIA)

Source: BSRIA 2007

History - Installed Cu Cabling

0

20

40

60

80

100

120

140

160

180

1995

1996

1997

1998

1999

2000

2001

2002

2003

2004

2005

2006

2007

Cat 7

10G

Cat 6

Cat 5e

Cat 5

1000BASE-T 10GBASE-T

Forecasts for Cu cabling

BR forecastSource: BSRIA 2009

10G cabling grows significant share from 2009

BR forecast

Forecasts for Optical cabling (LAN)

Source: BSRIA 2009

Enhanced MMF continues to grows strongly

Review

• Trends– Faster speeds & higher data rates – Switches will quickly adopt the new higher speeds– 40GbE speeds will be in Data Centre servers by 2011– 100GbE in Data Centre servers by 2018

• Technology– 10Gbps technology is established– 40G & 100G devices will appear in 2010– FCoE, Data Centre Ethernet– 40GbE on Cu, if developed, ≈2GHz cabling

• Implications to Cabling– Class EA Cu cabling will grow– OM3 & OM4 fibre will grow– Providing cabling for 40GbE should be considered now