sm ®. data centers trends © panduit corp. 2009 all rights reserved critical vectors operation...

SM

®

Data CentersTrends

© PANDUIT Corp. 2009 All Rights Reserved

Critical Vectors• Operation closer to the “edge” to realize savings

• Real time knowledge• Autonomic response

• Fabric architectures• FCoE (SAN/FC performance expectations)

• Two tier architectures –virtualization driven• ToR• Fat Trees

• Private “cloud”• Power/cooling – more than just reporting• Infrastructure as a “CMDB element”


Data Center Evolution/Trends

Mainframe

Centralized

IT R

elev

ance

and

Con

trol

Decentralized

Client-Server and Distributed Computing

Virtualized

Service Oriented

Application Architecture Evolution

Consolidate

Virtualize

Automate


Data Center/Converged Ethernet facilitates I/O Consolidation for increased Efficiency, Simpler Operations

UnifiedFabric

Unified Fabric and I/O

Storage Network

Mgmt Network

Back-End Network

Front-End Network

BackupNetwork

Storage Network

BackupNetwork

Back-End Network

Mgmt Network

Front-End Network


Fewer NICs and Cables Unified Management Model

Less Power and Cooling

FC TrafficFC Traffic

Enet TrafficEnet Traffic

FCoEFCoE

FCoE SAN

SAN A

SAN BFCoE

FCoE

I/O Consolidation: Benefits to Users

40 & 100 Gig Standard EthernetUpdate

SM

802.3ba 40/100Gigabit Ethernet Overview

• IEEE 802.3ba was ratified June 2010• 8 PMDs are included• Multimode requires MPO/ribbon to port• Short reach copper cable assembly is included• Traditional Structured Twisted pair cabling is

not included

SM

802.3ba Summary of Options

Reach 1m Backplane 7m copper cable assembly

100m OM3/150m OM4

10km SMF 40km SMF

40 Gigabit Ethernet

PMD Name 40GBASE-KR4 40GBASE-CR4 40GBASE-SR4 40GBASE-LR4

Signaling 4 x 10Gbps 4 x 10Gbps 4 x 10Gbps 4 x 10Gbps

Media Backplane Twin-ax Parallel MMF Duplex SMF

Module QSFP QSFP CFP

100 Gigabit Ethernet

PMD Name 100GBASE-CR10 100GBASE-SR10 100GBASE-LR4 100GBASE-ER4

Signaling 10 x 10Gbps 10 x 10Gbps 4 x 25Gbps 4 x 25Gbps

Media Twin-ax Parallel MMF Duplex SMF Duplex SMF

Module CXP CFP or CXP CFP CFP

SM

40GBE over Copper

• Included in 802.3ba standard• 8-pair Twin-ax Cable Assembly• QSFP Modular Interface• 7m (23ft) reach• Similar application space as 10GSFP+Cu for

ToR/POD layouts• Larger OD vs. SFP+• Planned release Q4 10 (prototypes available

Q3)

QSFP Cable Assembly

QSFP OD: 0.36in/9.2mm (24AWG)SFP+ OD: 0.22in/5.6mm (24AWG)

SM

100GBE over Copper

20-pair twinax, approx 0.5 in. OD

CXP Form Factor

• 20-pair twin-ax cable assembly• Cable is large approx 0.5in OD• CXP Modular Interface (similar to 12X IB)• Under research to understand market need• May transition to 25G x 4 in QSFP form

factor in future

SM

40GBE over Multimode Fiber

• OM3: 100m, OM4: 150m• QSFP transceiver with 12 fiber MTP/MPO

connector• Uses outside 4 fibers on each side for Tx and Rx• Existing Panduit OM3 and OM4 MTP cables are

good for 40GBE• Since 10G TCVRs use duplex fiber more ribbon

fiber is required in the cable plant for 1 to 1 migration (6x)

QSFP SR Transceiver

MTP Cable Assembly

SM

100GBE over Multimode Fiber

• 100G over MMF requires CFP module today

• Most CFP will use 24 fiber MTP interface

• Will need to breakout 24 fiber to 2 x 12 fiber patch to connect to fiber plant

10GBASE-SR10 CFP with24 fiber MTP Interface

Fiber plant connections


• Connectivity and Cabling

• Cabinets and Racks

• Cable Management

• Physical Infrastructure Management

• Zone Cabling

• Routing

• Grounding

• Labeling and Identification

• Security and Identification Accessories

• Design Tools and Services

Innovative technology leadership

End-to-end physical infrastructure solutions


Comprehensive Copper and Fiber Cabling Systems

• High Performance Technology– 10 Gigabyte Ethernet

– Fiber Channel

– InfiniBand

• Pre-Terminated Options– 75% Faster Deployments

– Integrated Copper/Fiber Optic Combinations

– High-Density Applications


High Speed Data Transport

Horizontal Cable Patch CordsJack Modules Patch Panels• Innovative matrix tape

technology to suppress alien crosstalk

• 0.30 in. O.D. diameter• Round cable design• Extended temperature

range (75oC)• Channel & component

compliant

• Innovative matrix tape technology to suppress alien crosstalk

• 0.290 in. O.D. diameter• Stranded, flexible

cable design• centre de-embedded

plug with internal pair manager

• 100% performance tested

• High-density applications --

48 ports 1RU

• Angled or straight• 100% performance

tested• Channel &

component compliant

• Advanced electrical compensation technology

• Innovative foil technology to suppress alien crosstalk

• 100% performance tested

• Channel & component compliant

TX6A 10Gig Cabling System With MaTriX TechnologyComplete End-to-End Cabling Solution

TX6A 10Gig Copper Cabling SystemEvolution of MaTriX TechnologyChanges to MaTriX Tape• MaTriX Tape’s key feature: Discontinuous Metallic

Elements help suppress Alien Crosstalk• New Manufacturing Technology: LASERS!• Advanced Manufacturing process uses

lasers to create new MaTriX tape • Larger Discontinuous Metallic Elements

= Improved Alien Crosstalk• Thinner tape = Smaller Cables


10GBase-T EcoSystem Launch

Cost Effective, High Performance, Highly Available Next-Generation Server Connectivity

Category 6 UTP/STP Type Cabling with distances of up to 55m

Category 6A UTP/STP and Category 7 STP Type Cabling with distances of up to 100m

Twisted Wire Pairs

Cross-Web

Barrier layer improves attenuation

Matrix Tape suppresses alien xtalk

Outer Jacket


Cisco Catalyst 6500 16-Port 10GBase-T Line Card

Deployment Areas• Data Center Access • Distribution

Key Features• 16 port, 4:1 oversubscribed 10Gbase-T line card• 802.3an compliant• Up to 100 meters reach• Same fit form and function as other line cards for the Catalyst 6500• Interoperability – works with all 802.3an standard NIC and MAC


Cisco Catalyst 4900M 8-Port 10GBase-T Line Card

Deployment Areas• Data Center Access • Data Center Distribution

Key Features• 8 port, 2:1 oversubscribed 10GBase-T line card• 1/10GE auto-negotiating• 802.3an compliant• Up to 100 meters reach• Same fit form and function as other half cards for the Catalyst 4900M• Interoperability – works with all 802.3an standard NIC and MAC


Intel 10 Gigabit AT2 Server Adapter

• Intel’s second-generation 10GBASE-T server adapter

• Based on the Intel® 82598 10 Gigabit Ethernet Controller

• Designed for multicore processors, optimized for virtualization, and supports iSCSI

• Delivers cost-effective, low power single port 10GbE performance

SM

High Speed Twinax Cable Assemblies

• High frequency, up to 10GHz/pair• Parallel shielded pair (twinax)• Factory soldered terminations• Point to point interconnects• Applications

◦ 10GBE-CX4◦ InfiniBand◦ 10G SFP+◦ 40GBE

SM

Panduit 10Gig™ SFP+ Cable Assembly Benefits• SFF-8431 compliant• Passive - no additional power per port• Low latency• Robust easy to use latching• 100% tested for performance and quality assurance• Superior performance margin assures data integrity• 1 – 7 m(33ft) in 0.5m increments

◦ Max. operating length depends on host ports and application; 7m for 10GBE, 5m for FCoE

• 2 colors for A & B networks (Blue/White)• Longer cables in development

10GigTM Server Connection Options

PMD/Conn. Cable Type Power Module/port

Latency/port Reach Standard

10G SFP+(CX1)cable assembly

Twinax 2 pair 0/1W 0.1 us 7m SFF-8431

X2 CX4cable assembly

Twinax 8 pair 0/2W 0.1 us 15m 802.3ak

SFP+ SRDuplex LC

MMF OM2MMF OM3

1W/1W 0.1 us 82m300m

802.3ae

XFP SR Duplex LC

MMF OM2MMF OM3

2W/1W 0.1 us 82m300m

802.3ae

X2 SR Duplex SC

MMF OM2MMF OM3

4 W (incl. Module)

0.1 us 82m300m

802.3ae

10GBASE-TRJ45

Cat6A UTP 5.5 W 2.5 us 100m 802.3an

SFP+ copper solution• Low cost• Low power and low latency• Up to 7m (23ft) for in-rack

and in-row cabling

NEW!

Switch Server

CX1-SFP+ CX1-SFP+PHY PHY

OM3 SFP+ OM3 SFP+PHY PHY

RJ45PHY PHYRJ45 RJ45 RJ45

10m Per Channel Cost/Price (PHY to PHY) Technology Comparison

2010 2000 server (2 NIC Cards)

Media CapX(cost)

CapX(price)

OpX CapX(cost)

Power OpX

Cooling OpX

10G Base-T $159 $279 8W($8.4)

$636k 32kW($34k)

11kW($11k)

CX1-SFP+ $200 $270 1.5W($1.6)

$800k 6kW($6.3k)

2kW($2.1k)

10G Base-SR (SFP+)

$470 $1940 2.5W($2.6)

$1880k 10kW($11k)

3.3kW($3.7k)

0.75W ($35)

0.75W ($35)

4W ($60) 4W ($60)

0.75W ($35)

0.75W ($35)

0.5W ($175) 0.5W ($175)

0.0W ($130)

0.0W ($50)

1 m 1 m8 m

10 m

10 m

0.0W ($27)0.0W ($6) 0.0W ($6)

CapX Assumptions: - PHY cost to Price =2x - PHY/Trans cost red. = 10%/yr - Transceiver cost to Price = 5x - Cabling is price - Cabling cost red. = 2.5%/yr

OpX Assumptions: - 12 cents per kWh - $ per year

SM

Panduit Confidential and Proprietary

Parameters limiting channel performance:

Fibre Bandwidth / Dispersion (chromatic and intermodal)Connector Insertion LossFibre AttenuationOptical Impairments / Power Penalties (RIN, MPN, MN, RN & PN)Transceiver output power levels, sensitivity and ISI

Conditions influencing Link Loss, Power Penalties, Fibre BWMode Power Distribution (affects IL and fibre bandwidth)Spatial Mode Filtering (affects IL and MN)Defects in fibre core – location & type (affects fibre bandwidth)New Effect Discovered by Fibre Research (previously unknown)

Research Tools Used To Study Link PerformanceBit Error Rate (BER) Analysis (measures channel performance)Differential Mode Delay (DMD) Measurements (fibre bandwidth) Near-field Imaging (optical power distribution)Optical Spectrum Analysis

Fiber Cabling Systems

Research in Optical Link Performance


1.E-14

1.E-13

1.E-12

1.E-11

1.E-10

1.E-09

1.E-08

1.E-07

1.E-06

1.E-05

1.E-04

1.E-03

-14

.5

-14

.0

-13

.5

-13

.0

-12

.5

-12

.0

-11

.5

-11

.0

-10

.5

-10

.0

-9.5

-9.0

-8.5

-8.0

-7.5

-7.0

BE

R

Rx Power (dBm)

Vendor C Verification, 548m, BER (6/29/07-7/16/07)

BL-300m-SX+ 07/16/07

Blue-4020 MHz*km-07/13/07

Brown-4020 MHz*km-07/03/07

1. Explore parameters effecting fiber bandwidth

• Inter modal dispersion• Chromatic dispersion• attenuation

2. System Performance Parameters

• BER versus EMBc• DMD versus BER

3. Channel Certification• Panduit specification• Field testing

4020 MHzhkm

4020 MHzhkm

Quantification /Verification of contributing factors to 10G-Base-SR channel performance:

27

SM


BER, 300m Draka OM3 Sample Fiber Reels, 1/19/07

1.0E-14

1.0E-13

1.0E-12

1.0E-11

1.0E-10

1.0E-09

1.0E-08

1.0E-07

1.0E-06

1.0E-05

1.0E-04

1.0E-03

-14.5

-14.0

-13.5

-13.0

-12.5

-12.0

-11.5

-11.0

-10.5

-10.0

-9.5

-9.0

-8.5

-8.0

-7.5

-7.0

Rx Power (dBm)

BE

R

BL-300mSX+05/19/05 Reel#1-300m

Reel#2-300m Reel#5-300m





PASS

EMBc = 2199 MHz km

EMBc = 2829 MHz km

EMBc = 2790 MHz km

EMBc = 4952 MHz km

Failure

MarginallyGood

EMBc = 10324 MHz km

Good

1390 MHzhkm

1629 MHzhkm

6494 MHzhkm


BERT - Fiber Manufacturer Approval and Compliance

SM


Laser spectral and temporal widths optimized for 300m length – 10GBASE-SR reach requirement

Highest spatial resolution in the world (0.1 micron)


High Resolution/World Class DMD Test Capability

SM



Fiber DMD Testing

Commercial DMD Test Set

EMBc = 10,324 MHzhkm

Panduit DMD

EMBc = 6,343 MHzhkm

SM


1400

1600

1800

2000

2200

2400

2600

2800

3000

3200

3400

3600

3800

4000

4200

4400

4600

4800

5000

5200

5400

5600

5800

6000

Mor

e

0.00

0.01

0.02

0.03

0.04

0.05

0.06

0.07

0.08

0.09

0.10

Panduit OM3

Effective Modal Bandwidth (EMB)

Fre

qu

ency

11.8%Failed

Distributors: Anixter Graybar Prysmian FIS

Competitor’s OM3 and OM4

Panduit OM3


Bandwidth Competitive Analysis

PIM / PVIQ Solution

33

Software & Appliance Market Evolution – 2010 to 2015

Single converged

physicalinfrastructuremanagementsoftware by2012 / 2013

Source: Gartner ITOM Report

3/09

Rel

ativ

e C

usto

me

r B

usin

ess

Va

lue

Hi

HiLo Breadth of Functionality/Scope

Systems Management Software

• Provisioning, configuration, change management

• Security& policy management

• Focus on agility & total economic investment

PI Policies

Physical Resource

Infrastructure Management

Data Center Infrastructure Management

Intelligent Physical Layer Management

Integrated Functionality

Open APIs for systems software integration

What Leading Industry Analysts are Saying…

“Infrastructure and operations (I&O) leaders must now go beyond performance management of IT equipment and begin to manage the entire data center infrastructure. Tools for data center infrastructure management (DCIM) will provide detailed monitoring and measurement of data center performance, utilization and energy consumption, supporting more-efficient, cost-effective and greener environments.”

–David J. Cappuccio, Gartner March 2010

What Leading Industry Analysts are Saying…

“The long-term value of DCIM is tied to a product’s ability to integrate with other system management tools or orchestration tools that optimize data center workloads.”

–Galen Schreck of Forrester Research December 2009

http://www.clker.com/clipart-torn-paper4.html

http://www.clker.com/clipart-torn-paper4.html

Software Functionality

Panduit Physical Infrastructure Software & Appliances Strategy

Open APIs and Integration with Systems Software Leaders (IBM, HP, Microsoft, EMC, and others)

Refe

renc

e Ar

chite

ctur

es &

Des

ign

Tool

s

Network connectivity (Datacentre &

enterprise)

Real-time information& related

automation

Energy monitoring & management, space, speed management

Energy aware, high performance

Provisioning, change, configuration, problem,

events, security

Efficiency & effectiveness of operations

Monitoring and Event Managment

Data Center Automation

Asset Lifecycle Management

Chargeback and Accounting

Business Impact / Service Level Management

Connected Smart BuildingsUnified Physical

Infrastructure (UPI)Smart Data Centers

Integration of Panduit Solution with System Software


Cabinet Top Temps vs. Used Power

ASHRAE recommendations.(18-27 C or 64.4 deg F through 80.6 deg F)


Cabinet Elevation View


% diff between Top & Bottom Cabinet Temp

Area of interest – room for improvement

Using PUE to Help Measure Efficiency

Total Facility Power

IT Equipment Power

• The PUE (Power Usage Effectiveness) is a simpleratio for assisting in measuring datacenter efficiency.It compares total electrical power at the intake topower delivered to IT equipment.• PUE is a snapshot in time and is entirely influencedby a site’s M&E configuration, environmentalconditions and Tier rating, PUE cannot be readilyused to compare one site with another but is used totrack the efficacy

Pushing the envelope Exploring the ASHREA Window

• 2004 specifications bound between 20-25 Degrees C• ASHREA worked closely with IT manufacturers to expand this window/region. This

included decreasing the dry bulb lower limit to 18 degree C and increasing the upper limit to 27 degrees C.

• DRY BULB LOWER LIMITThere is no concern from an IT standpoint in lowering the operating condition from 20 to 18°C (64.4°F). The goal here was to extend the control range of economized systems by not requiring a mixing of hot return air to maintain the previous limit.

• DRY BULB UPPER LIMITThe justification for increasing the dry bulb limit was to increase hours of economizer use per year. Concerns about increasing inlet temperature causing lower reliability are not well founded. IT Equipment manufacturers test, confirm, and state, through ASHRAE, that operation within the recommended limits will not affect equipment reliability


Manage, Protect, and Showcase Installations:

• Accessible Pathways– Improve Speed of

Installations/Maintenance

• Thermal Management– Cabinet System Ducting

– Ventilation Paths

– Perforated Doors

– Raised Floor Grommet

– Reduces operating costs up to 14%


Cabinets and racks


Integrated solutions


Manage, Protect, and Showcase Cable Routing

• High Density– Works with flat and angled patch

panels to maximize density and utilization of cabinet and rack space

• Reduced Real Estate– Can Minimize Floor Space and

Costs by 23%

• Integral Bend Radius– Helps Maintain Network Reliability


Cable management


Shorten Horizontal Cables Using Main Distribution Points

• Zone Distribution Areas– Reduces Cable Congestion

– Rapid Deployment of Connections

• Server Cabinet Deployments– Creates Staging Areas

– Plug and Play Deployments

• Storage Area Isolation– Accessibility to Connections

– Security from Intrusion/Damage


Zone cabling


Manage High Performance Communication, Computing and Power Cables

• Overhead Pathways– High Density Applications

– Quick Assembly Features

– Up to three times faster than traditional bolt-together systems

• Under floor Pathways– Protection of High Cable Capacities

– Grounding Features


Routing Systems


Protect Network Equipment and Personnel

• Provides Protection of Personnel and Equipment

– Critical Factor for Reliable & Efficient Network Performance

– NEBS Level 3 Compliant Components

– May Prevent up to $500M/Year of Property/Equipment Damage Due to Lightning


Grounding Systems


Properly Identify Networks to Simplify MACs and Trouble-Shooting

• Hand-Held Thermal Transfer Printers

• Software and Labels for Desktop Printers

• Faceplates

• Marker Ties

• Patch Panels

• Surface Mount Boxes


Labeling and identification



Security & Identification Accessories

Patch Cord Color Band• Fits any PANDUIT patch cord• Easily attached and removed• 8 colors for multiple layers

Lock-In / Block-Out Device• Fits any RJ45 jack• Requires special removal tool


Thank You

http://www.thedcofthefuture.com/

sm ®. data centers trends © panduit corp. 2009 all rights reserved critical vectors operation...

Documents

sm slide

awg slide

cxpcfp slide

future slide

fiber patch

cable plant

duplex fiber

ribbon fiber