10GBASE-T &Data Centre solutions

K G HodgeR&D Manager

Brand-RexNovember 2009

Brand-Rex Copyright 2009 2

2010 - the year of 10Gbps technologies

9/3/2009

• Dell’Oro Group – “copper-based 10GigE adapter port shipments are expected to grow from 33K in 2008 to 1.5M in 2013”

• Intel - “10GbE connectivity is on a growth path driven by the needs for higher perfromance and supported by falling per-port prices”

• Cisco – “the adoption of Data Center Ethernet will help enable a unified fabric in the data centre, reducing costs and simplifying management”

Brand-Rex Copyright 2009

Cabling for 10GbE technolgies

10GBASE-

Cabling E L LX4 LRM S CX4 T

OS1 SMF 40km 10km 10km x x x x

OM3 MMF x x 300m 220m 300m x x

OM2 MMF x x 300m 220m 82m x x

OM1 MMF x x 300m 220m 33m x x

Class EA x x x x x x 100m

Class E x x x x x x Note 1

Class D x x x x x x xCable

assembly x x x x x 15m x

9/3/2009

Note 1: Standards advise that UTP cabling reaches 37m without mitigation for ANEXT and that screened cabling reaches full channel length

The latest emerging application - 10GBASE-T

10,000,000,000 bps

10GBASE-T Transmission

DigitalSignal

Processor(DSP)

10 Gbit/s

Active Equip Active Equip 2.5 Gbit/s

10 G

bit/

s

2.5 Gbit/s

2.5 Gbit/s

2.5 Gbit/s

NEXT FEXT

DigitalSignal

Processor(DSP)

Return Loss

AlienXT(AXT)

nearbyUTP

cable

EMI10GBASE-T signal spectrum up to 500 MHz

External noise & complex signal - BER 10-12

802.3an - Cabling Channel Spec

-40

-20

0

20

40

60

80

100

1 10 100 1000

MHz

dB

Return loss (dB)

Insertion loss (dB)

NEXT (dB)

PSNEXT (dB)

PSANEXT (dB)

ELFEXT (dB)

PSELFEXT (dB)

AELFEXT (dB)

ACR (dB)

PSACR (dB)

PSAACRN (dB)

10GBASE-T channel - June 2006

Signal attenuation

Alien Crosstalk

Signal = Noise @ 500MHz

Alien XT – UTP

• 10GPLUS AC6 UTP cabling• 90m link

- Cables ‘6 round 1’ • Fluke DTX1800 with Alien XT adaptors• Significant links - all• 7dB margin

PSANEXT - AC6 UTP Cable

30

40

50

60

70

80

90

100

0 50 100 150 200 250 300 350 400 450 500

MHz

dB

PSANEXT - Screened Cabling

0

10

20

30

40

50

60

70

80

90

100

0 100 200 300 400 500

MHz

dB

Alien XT – Screened

• 10GPLUS AC6 screened cabling

• Fluke DTX1800 & Alien XT adaptors

• Significant links- Adjacent links only

• 30dB+ margin

Cabling Type

System Bandwidth AXT Test Strategy Note well:

Installed Cable

Cat6Plus UTP 250MHz IEC 61935-1 ed 3.0 Length limited Class E

Cat6Plus screened 250MHz Proven by Design*Class E - only AXT is

proven by design

New Installations

10GPLUS UTP 500MHz IEC 61935-1 ed 3.0* Class EA system

10GPLUS screened 500MHz Proven by Design* Class EA system

Test Method - draft IEC 61935 ed 3 & draft IEC 14763-2- 15 minimum or 3% of the links

- E.g. 10,000 links = 300 test points

A Practical Alien Crosstalk Test Strategy:

* Assured by Brand-Rex Laboratory testing

10GBASE-T - reach• IEEE802.3an:2006 advises :

– ClassE UTP supports up to 55m, – Class E screened supports up to 100m– Class EA screened or UTP supports up to 100m

• ISO/IEC 11801:2002 Amm1 advises :– ClassEA supports 100m

• ISO/IEC TR 24750 states that :– Class E UTP channels should support 10G up to 55m and >55m with mitigation. – Class E screened should support 100m

• TIA/EIA TSB155 states :– Cat6 operates up to 37m, should operate up to 55m depending on AXT

environment, – >55m requires AXT mitigation

• ANSI/TIA/EIA 568B.2-10 advises :– Cat6a supports 100m

10GBASE-T devices

SMCCat5 UTP 45m 2 connCat6 UTP 55m 2 connCat6a UTP 100m 4 connCat7STP 100m 4 conn

Intel/DellCat6 55mCat6a 100mCat7 100m

Brand-Rex Copyright 2009 12

Copper Links

• 10GBASE-T devices are on the market– 14-15W– Device manufacturers recognise Cat5, 6, 6A and 7

cabling– Standards committees recognise Cat6, 6A and 7

cabling to run 10GBASE-T• 10GBASE-T is limited by signal attenuation and

the noise from adjacent cables.• 10GBASE-T technology is susceptible to EMI9/3/2009

10GBASE-T Alien Crosstalk tests

Brand-Rex LabsJune 2009

Cabling Under Test

• Cabling – ‘Worst’ case condition– ‘6 round 1’ cables in full

length channels– Normal termination– Multiple connector links

NV

N

NN N

N

Basic link configurations

client

EquipmentCord

Horizontal cable

EquipmentCord

connector connector

client

client

Switch

EquipmentCord

Horizontal cable

EquipmentCord

connector connector

client

EquipmentCord

Horizontal cable

EquipmentCord

connector connector

Switch

PatchCord

Extralength

NV

N

NN N

N

42

• Cabling, UTP & screened– Cat6A – Cat6– Cat5e

• Switches– 1000BASE-T– 100BASE-T– 10BASE-T

• NICs– 10GBASE-T

Expected reach per cable type

Cabling SetApplication Class

A B C D E EA

10GPlus 2000m L=260-FX L=185-FX L=111-FX-CY L=102-FX-CY L=102-FX-CY

Cat6Plus 2000m L=260-FX L=185-FX L=111-FX-CY L=102-FX-CY -

Gigaplus 2000m L=250-FX L=170-FX L=105-FX-CY - -

Cable Type Application Class 2 connector 3 connector 4 connector

10GPLUS UTP Class EA 97 96 95

10GPLUS screened Class EA 97 96 89

10GPLUS screened (zone) Class EA 77 76 75

Cat6Plus UTP Class E 100 99 98

Cat6Plus screened Class E 97 96 89

GigaPlus UTP Class D 100 100 99

GigaPlus screened Class D 100 98 96

: F = patchcable IL factor , X = patch length, C= CP cable IL factor, Y = CP length

Cat6A UTP Single channel

+ noise on adjacent cables

Cat6 screened Single channel

+ noise on adjacent cables

ReachCable type 97m0m

+ noise on adjacent cables NV

N

NN N

N

Cat6A screened Single channel V

14m

Cat6 UTP Single channel – 95m

14m 55m 95m

Reach with 10GBASE-T technology

EMC assessment

EN50174-2

EMC environments:

• Transmitters (TV, radio, base stations) <1km E3

• Flourescent lights <0.5m E2

• Flourescent lights >0.5m E1

• Thermostatic switches >0.5m E1

WHO: 10V/m under power lines

Source: Richard Box

MICE levelsBS EN 50173-1:2007 Annex G

• Electromagnetic criteria

– ESD 4kV & 8kV (air)– Radiated RF 3V/m - 10V/m– Conducted RF 3V - 10V– EFT 500V - 1kV– Surge 500V - 2kV– Magnetic field 1A/m - 30A/m

Radiated Emmission - E field30MHz to 1000MHz EN55022: 1998 & A1 & A2

Radiated Emmission - E field

Conducted RF Immunity

150KHz to 80MHz EN 61000-4-6: 1996 & A1

Electrical Fast Transients

• EN 61000-4-4• Noise applied to the signal

cable• 15ms bursts at 5khz• Voltage levels applied:

– 0.5kV (E1)– 1kV (E2 & E3)– 2kV

• 10GbE on all cabling types:– No effect noted

EMC summary

Office environment, E110GBASE-T on the Cable Type

Cat5 U/UTP

Cat6 U/UTP

Cat6AU/UTP

Cat6AU/FTP

Cat6AS/FTP

Radiated Emmissions EN 55022 (30MHz-1GHz) pass pass pass pass pass

Immunity to radiated RF fieldEN61000-4-3 (80MHz-1GHz) stopped stopped stopped pass pass

Immunity to conducted disturbance EN61000-4-6 (150KHz – 80MHz) stopped stopped stopped pass pass

Immunity to fast transientsEN61000-4-4 (noise on signal cable) pass pass pass pass pass

Immunity to fast transientsEN61000-4-4 (noise on power cable) pass pass pass pass pass

EMC

• Emmission requirements - 10GBASE-T devices with UTP and screened cabling passed the requirements of the EMCD

• Immunity requirements - screened cabling is required to assure that the 10GBASE-T devices tested can operate in the general office environment. MICE level E1.

Environmental Noise Survey

• Rural Areas• City Centres• Town Centres• General Offices• Data Centres

• Portable Spectrum Analyser

• Active Receive antenna– Open Area Test Site

Worst measured EM noise

Electromagnetic Field Strengths - Town Centre

-60

-50

-40

-30

-20

-10

0

10

20

30

40

50

60

70

0 100 200 300 400 500

Frequency (MHz)

Fie

ld S

tre

ng

th (

dB

mV

/m) Magnitude

Noisefloor

69.5dBmV/m=3V/m

60dBmV/m=1V/m

30dBmV/m=0.03V/m

E1

EM noise near Transmit Mast referenced to the PSD of 10GBASE-T (Noise level de-rated for Coupling Attenuation of UTP cabling)

-180

-160

-140

-120

-100

-80

-60

0 50 100 150 200 250 300 350 400 450 500

Frequency (MHz)

PS

D (

dB

m/H

z)

PSD upper PSD of 10GBASE-T Attenuated 10G PSD

Noise > signal at

high freq.

Can EMI interfere with 10GBASE-T on UTP?

Worst case noise (EMI) coupled onto UTP cables

Received signal power

10GBASE-T

• 10GBASE-T devices are on the market

• Alien noise– ClassEA screened and UTP cabling support full channel lengths– Class E screened cabling supports full channel lengths

• EMC (cabling is exempt from the EMCD)– Screened cabling - 10GBASE-T operated in MICE level E1 environments– UTP cabling - 10GBASE-T is disturbed by the maximum E1 level (3V/m)

In electro-magnetically noisy environments screened cabling supports 10GBASE-T

Brand-Rex Copyright 2009 32

Standardisation – Data Centre cabling

• ANSI/EIA/TIA 942 Cat6 & OM2– Rev 1 (draft) Cat6A & OM3

• CENELEC EN 50173-5 Class E & OM3– Ammendment 1 (draft) Class EA & OM3

• ISO/IEC 24764 (draft) Class EA & OM3

9/3/2009

TIA 942Telecommunications Infrastructure Standard for Data Centres

• Specifies the minimum requirements for the telecommunications infrastructure of data centres and computer rooms.

• Introduces telecommunications design issues early into the construction cycle

• Enables the long term planning of the data centre to accommodate change and growth and support future applications

Standardisation - TIA

‘Should’ and ‘Shall’Shall:• be located away from sources of electro-magnetic interference• be sized to meet the requirements of the equipment, including

clearances…..and future needs• Minimum room height 2.6m• Minimum clearance from sprinklers 460mm• Floors, walls & ceilings light coloured & sealed against dust• Antistatic floors• Minimum 500 lux lighting• Cabinets have a min width of 1m and door heigth of 1.3m• Min distributed floor loading capacity 7.2kPa• Provide continous 24/365 HVAC • 20 to 25degC, 40 to 55%RH, 21degC max dew point, max temp change 5degC/hr• Racks & Cabinets arranged in ‘hot’ and ‘cold’ isles• Monitor Temperature in the cold isles• Etc., etc …………..

Standardisation - TIA

Tiering – Generic CablingTier I Tier II Tier III Tier IV

Cabling, Racks & Cabs to TIA specs Dual access provider (maintenance separated by 20m )

X

Secondary distribution area X X X optional

Dual power supply to switches X redundant switches X X redundant backbone pathways X X redundant horizontal cabling X X X optional

Rack, Panel, Cable, Cord, Identification scheme per TIA 942

Patchcords labelled both ends X

Ref: TIA 942

Standardisation - TIA

Product Solution Sets

Brand-Rex Copyright 2009

Product Set Voice GigaPlus Cat6Plus 10GPlus UmediaPlus

UmediaPlus

FibrePlus

Application Class CCat 3

Class DCat 5e

Class ECat 6

Class EACat 6A

Class FCat 7

Class FACat7A

Optical class

>10Gbe 10GbE 1GbE Voice PoE & PoEP * AnalogueBroadcast

* PoE only

Source: Cambridge Online

Source: Anon

The High Speed Environment

Fibre X connect

1/2U

newMDC cables

Cu X connectZone

cablesMT Connect

IIMSSmartpatch

Cat6PLUS

10GPLUS

FibrePLUS

Blolite

Cabling Solutions

‘V12’ Angled Technology Panels

Secure, High Density, Cu Cabling Cabinet

• Up to 864 ports per cabinet

• Vertical management, pathways and space for 432 patchcords

• Configuration options:• Stand alone

• 45U 900x500mm Cabinet • Back to Back

• 900x1000mm• Side to Side

864 Cu ports per cabinet

Cu X-connect solutionsCross-connect solutions

Small DC model

Basics:• 1000sq ft• 2ft high plenum space• 3kw server racks• 10,000CFM CRACs • 25% aperture tiles • 100 cables per rack

Simulation outputs include:• Rack & room temperatures • Press. and vol. flow above &

below the floor• Flow rates & estimated cooling

capacity per tile

Effects of cabling on cooling air flow rates through tiles

Simulation air flow rates

• No data cables underfloor– 382 to 431 CFM

• 5.5mm OD cables on trays– 381 to 437 CFM

• 5.5mm OD cables on the floor– 380 to 436 CFM

• 7.2mm OD cables on trays– 391 to 424 CFM

• 8.5mm OD cables on trays– 361 to 392 CFM

10% improvement in cooling air flow rates through tiles

• Reduced space taken in pathways– AC6 UTP 8.3mm 50 links– AC6 DCZ 5.4mm 118 links

• Reduced weight in trays – AC6 UTP 79 kg/km– AC6 DCZ 33 kg/km

• Standards Conformant• Xconn – LDP – EO 77 m

Zone Cable

UTP8.3

FFTP7.2

Zone5.4

Space saving ‘Zone’ cabling

½ U height panels

Features: – Category 6 performance– ½ U height 24 port panels

Benefits:• to the installer:

– logical and quick installation– Standard termination methods

• to the end user:– Reduces height in rack– Reduces depth in rack– Reduces blockage of exhaust air

Description Catalogue Number

Cat6 ½ U Unshielded Panel Black C6CPNLU240K2H

Cat6 ½ U Unshielded Panel Grey C6CPNLU240K8H

Cat6 ½ U Shielded Panel Black C6CPNLF240K2H

Cat6 ½ U Shielded Panel Grey C6CPNLF240K8H

• Micro Distribution Cables (12f & 24f)

• Dual Loose Tube (24f)

• Multi-Loose tube (48f)

Diameter over the buffered fibre: 600 um

12f Cable Diameter :24f Cable OD :

4.0 mm5.8 mm

Tube Diameter: 2.5 mm

Cable Diameter: 9.4 mm

Cable Weight: 84 kg/km

Tube Diameter: 2.5 mm

Cable Diameter: 7.2 x 8.1mm

Cable Weight: 60 kg/km

Fibre Optic Cables

• Pro’s–Modularity–Faster installation–Quicker repair time–Shorter maintenance time–Less downtime–MT ferrule based

• 12 or 24f

• Con’s–Higher initial cost–MT ferrule based

• 0.36dB (LED launch)• 12 or 24f

MT ConnectModular FO system - MT Connect

• Optimised solution for main distributor locations

– Small footprint– 500x900mm

– 1824 ports per cabinet

– 3648 ports in 1m x 900mm

• Cable Management

– Large patching field– 70mm bend management

• Installation friendly

– Front of rack working– Logical routing

High Density FO cross-connects

Data centre – FO solution Installation

6 cabinets = 6x1824 fibre ports or 6x864 Cu ports or a mix

Higher Speed, Future Proof, Cabling Networks

• Demand for 10Gbps speeds is increasing – Data Centres, HPC & Corporate Backbones

• 10GbE technologies are established in the market– 10GBASE-T devices are now available

• Selection of the right infrastructure solution to run, or future proof for, higher speeds is critical– Up to 100m - Class EA cabling– In building - OM3 or OM4– Between buildings - SMF

1Gbps → 10Gbps → 40Gbps → 100Gbps → 400Gbps → TeraBit?

Brand-Rex Copyright 2009 51

Thankyou for listening

Questions ?

9/3/2009