ucs fabric fundamentals - alcatron.net live 2013 melbourne/cisco live content/data centre...

© 2013 Cisco and/or its affiliates. All rights reserved. BRKCOM-1001 Cisco Public

UCS Fabric Fundamentals BRKCOM-1001


State abstracted from hardware

Hardware “State” Abstraction

LAN Connectivity Storage Connectivity OS & Application

BMC Firmware MAC Address

NIC Firmware

NIC Settings

Drive Controller F/W

Drive Firmware

WWN Address

HBA Firmware

HBA Settings

UUID

BIOS Firmware

BIOS Settings

Boot Order


Agenda

Introduction

UCS Key Features

Hardware Overview

Ethernet Connectivity

Storage Connectivity

Introduction


UCS Manager Embedded – manages entire UCS

UCS Fabric Interconnect 10GE unified fabric switch

UCS Fabric Extender (I/O Module) Remote line card

UCS Blade Server Chassis Flexible bay configurations

UCS Blade and Rack Servers x86 industry standard

Patented extended memory

UCS I/O Adapters Choice of multiple adapters

Building Blocks of Cisco UCS


Physical Architecture

FI A FI B

Half blade Full blade

CNA1

IO

M

A CNA1 CNA2

IO

M

B

IO

M

A

IO

M

B

SAN A SAN B ETH 1 ETH 2

MGMT MGMT

Chassis 1 Chassis 20

Fabric Switch

Fabric

Extenders

Uplink Ports

Compute Blades

Half / Full width

OOB Mgmt

Server Ports

Virtualised Adapters

Cluster

UCS Key Features


Cisco Unified Computing System

Virtual Adapters

UCS Manager

Virtualised I/O

Single Management Domain

Unified Fabric Consolidated I/O

Service Profiles Just-in-time Provisioning

Hardware Abstraction “Stateless” Computing


Chassis-

1/Blade-2

Chassis-

8/Blade-5

LAN SAN

UUID: 56 4dcd3f 59 5b…

MAC : 08:00:69:02:01:FC

WWN: 5080020000075740

Boot Order: SAN, LAN

Chassis-

1/Blade-2

Chassis-

8/Blade-5

LAN SAN

UUID: 56 4dcd3f 59 5b…

MAC : 08:00:69:02:01:FC

WWN: 5080020000075740

Boot Order: SAN, LAN

“Stateless” Computing Hardware “State” Abstraction

Same identity

moved


Service Profiles Logical container of server state

information

User-defined Each profile can be individually created

Profiles can be generated from a template

Applied to physical blades at run time Without profiles, blades are just anonymous hardware components

Benefits :

Consistent and simplified server deployment

Simplified server upgrades

Enhanced server availability

Run-time association

Server Name

UUID

MAC

WWN

Boot info

LAN Config

SAN Config

Server Name

UUID

MAC

WWN

Boot info

LAN Config

SAN Config

UUID, MAC,WWN

Boot info

LAN, SAN Config

Firmware…


UCS

LAN SAN A SAN B

Chassis

2 Chassis

4

LAN

MGMT

Chassis

3

Chassis

1

LAN SAN A SAN B

Legacy Blade Vendors

MGMT

Chassis

1/2

Chassis

3/4 Chassis

5/6

Chassis

7/8

Chassis 4 10

Network Devices 8 20

Chassis Management

Devices 8 20

Chassis

10

Chassis 4 10

Network Devices 2 2

Chassis Management

Devices 2 2

Chassis

19/20

…160 blades

…160 blades

Cisco Confidential – Internal Use Only

Unified Fabric Consolidated I/O

Convergence inside each chassis True FCoE of LAN/SAN & MGMT


Server Health Monitoring (SIM)

Multi-Chassis Server Identity Manager (VCEM)

Servers 1-8

Servers 17-24

Ethernet Ethernet

Fiber Channel Fiber Channel

Server Health Monitoring

Multi-chassis Server Identity Manager

Blade & Chassis Management

Enet Switch Enet Switch

FC Switch FC Switch

CMC/OA CMC/OA

Enclosure 2: Servers 17-32

Logical Chassis 1


FC Switch FC Switch

CMC/OA CMC/OA



FC Switch FC Switch

CMC/OA CMC/OA



FC Switch FC Switch

CMC/OA CMC/OA



FC Switch FC Switch

CMC/OA CMC/OA



FC Switch FC Switch

CMC/OA CMC/OA



FC Switch FC Switch

CMC/OA CMC/OA



FC Switch FC Switch

CMC/OA CMC/OA



FC Switch FC Switch

CMC/OA CMC/OA



FC Switch FC Switch

CMC/OA CMC/OA


Servers 9-16

Servers 25-32

Servers 33-40

Servers 49-56

Servers 65-72

Servers 81-88

Servers 97-104

Servers 113-120

Servers 129-136

Servers 145-152 Servers 153-160

Servers 41-48

Servers 57-64

Servers 73-80

Servers 89-96

Servers 105-112

Servers 121-128

Servers 137-144

Fabric Interconnect A Fabric Interconnect B

Legacy Blade Architecture

UCS Manager: Single Management Domain


LAN SAN B Mgmt

SAN A

All of the benefits of blades applied to rack servers

Single point of management

Firmware management

Service profiles – “stateless” agility

UCS Manager: Single Management Domain

(Rack)


UCS Manager: Multi-Domain Management

Do It Yourself

SDK & Emulator

GoUCS

PowerShell & .NET

Most flexible

Most powerful

UCS XML API UCS XML API UCS XML API UCS XML API

Open Source

UCS Dashboard

Flexible

Leverage power of community

Cisco Product

Multi UCS Manager

Cisco CIAC

Cisco NSM

Cisco support and roadmap

ISV Partners

System Centre plug-in

BMC Integration

CA integration etc

Multi-vendor support

Incumbency

Broadest use cases

Multi-UCS Management Solutions


Cisco UCS Virtual Interface Card

Creates multiple x16 PCIe Ethernet and FC

interface adapters

Provides redundant path to fabric interconnect

using dual 10 Gigabit Ethernet ports

Centralised management of virtual interfaces from

UCS Manager

Offers Virtualisation aware networking with best

performance (VM-FEX)

10GbE/FCoE

Eth

0

FC

1 2

FC

3

Eth

127

vNICs

/vHBAs


Emulated Mode PCIe Pass-Thru or VMDirectPath

Each VM gets a dedicated PCIe device

12%-15% CPU performance improvement

Appears as distributed virtual switch to hypervisor

vMotion supported

VM-FEX with VMware

Co-exists with Standard mode

Bypasses Hypervisor layer

30% improvement in I/O performance

Appears as distributed virtual switch to hypervisor

Currently supported with ESX 5.0 only

vMotion supported

Hardware Overview


Flexibility to configure any port at Ethernet (1/10 Gigabit with SFP+) or FCoE or Native FC Ports (8/4/2/1G with FC Optics)

All ports on UCS 6200 Series

16-port expansion module (E16UP)

Uses existing Ethernet / Fibre Channel SFP and SFP+ transceiver

Compared to 6100 Series, Fibre Channel is standard. No requirement to buy FC module

Simplify fabric purchase by removing port ratio estimates Increase design flexibility

Customer benefits

Feature details

Unified Ports

Unified Port

Native Fibre Channel Lossless Ethernet:

1/10GbE, FCoE, iSCSI,

NAS


Double the port density at 1RU compared to UCS 6100 Series

32 fixed unified ports and 1 expansion module

All ports are usable as uplinks/downlinks

Reduced port latency to 2µs

Dual power supplies

DC option introduced

Layer 3 ready via daughter card

Higher density and performance Unified ports

Customer benefits

Feature details

UCS 6248 Fabric Interconnect


Power Entry Power Entry Fan Module Fan Module

Out of Band Mgmt

10/100/1000

Console

Fabric Interconnect

Cluster Connectivity

N + N Redundant Fans N + N Power Supplies

32 x Fixed ports: 1/10 GE or 1/2/4/8

FC Expansion Module (GEM)


Front Panel

Rear Panel


High density, 96 ports in 2RU

48 fixed unified ports and 3 expansion modules

Increased 2Tbps Switching Performance

All ports are usable as uplinks/downlinks

Reduced port latency to 2µs

Dual power supplies, AC/DC option

Layer 3 ready via daughter card

Higher density and performance Unified ports

Customer benefits

Feature details



UCS FI 6296 Front Panel

Power Entry Power Entry

N + N Power Supplies

Out of Band Mgmt

10/100/1000

Fabric Interconnect USB Flash

Fan Module

N + 1 Redundant Fans

Fan Module Fan Module Fan Module

Console


UCS FI 6296 Rear Panel

Expansion Module

48 x Fixed ports 1/10 GE or 1/2/4/8 FC

Expansion Module Expansion Module


16 unified ports can be configured as either Ethernet/FCoE or Native FC ports

Ethernet operations at 1/10 Gigabit Ethernet

Fibre Channel operations at 8/4/2/1G

Uses existing Ethernet SFP+ and Cisco 8/4/2G and 4/2/1G FC optics

Not backwards compatible with 6100 Series

Slider based FC port configuration

Simplify fabric purchase by removing port ratio estimate

More ports

Customer benefits

Feature details

UCS 6200 Series Expansion Module


UCS 5108 Blade Chassis

Up to 8 half slot blades

Up to 4 full slot blades

4x power supplies, N+N grid

redundant

8x fans included

2x UCS Fabric Extender

All items hot-pluggable

AC / DC


4 to 8 Blades

4 Power

Supplies

6U

, 19” R

ack

8 Fan Modules

4 Power

Connectors

2 Fabric Extenders

(I/O modules)

UCS 5108 Blade Chassis Parts

6U

, 19” R

ack

Rear

Front


Redundant data and management paths

I/O Modules

Blade Connectors

PSU Connectors

UCS 5108 Blade Chassis Backplane


UCS 2104 Fabric Extender (I/O Module)

Connects UCS blade chassis to the Fabric Interconnect

Four 10 Gigabit Ethernet, FCoE capable, SFP+ ports

Up to 2 Fabric Extenders per chassis for redundancy and up to 80 Gbps

of bandwidth per chassis

Built-in chassis management functionality

Fully managed by UCS Manager through Fabric Interconnect

No local switching


Block Diagram: Next Gen UCS Fabric

Details

Mezz Card

IOH

CPU CPU

x16 Gen 2

x16 Gen 2

16x SFP+ 16x SFP+ Expansion Module 16x SFP+ 16x SFP+

UCS Blade Chassis

UCS 6248

Expansion Module

UCS 6248

2208XP 2208XP

8 x Network Interface (NIF) Up from 4 to 8 Double the Fabric Uplinks

Mezzanine

Server Blade

Midplane

IO Modules

Fabric

Interconnects

Host Interface (HIF) Up from 8 to 32 Quadruple the Downlinks


Customer benefits

2208XP Fabric Extender (I/O Module)

Feature details

Double the uplinks

8x 10GE uplinks to FI

Total 160 Gbps per chassis

Quadruple the downlinks

32x 10GE to blades

Lower latency (0.5µs within IOM)

Backward compatible

Double the uplink bandwidth to the FI

Quadruple the downlink bandwidth to the server slots

Lower latency and better QoS



Details

Mezz Card

IOH

CPU CPU

x16 Gen 2

x16 Gen 2


UCS Blade Chassis

UCS 6248

Expansion Module

UCS 6248

2204XP 2204XP

Mezzanine

Server Blade

Midplane

IO Modules

Fabric

Interconnects

16 X Host Interface (HIF) From 8 to 16 Double the Downlinks

4 X Network Interface (NIF) No change


Customer benefits

2204 Fabric Extender (I/O Module)

Feature details

80 Gbps per chassis

Double the downlinks

16x 10GE to blades

Increased support for 8 egress CoS queues

Lower latency (0.5µs within IOM)

Backwards compatible

Double the downlink bandwidth to the server slots Lower latency and better QoS


Compute Serves : B series

Database Consolidation Virtualisation

UCS B440 M2

UCS B230 M2

Database and Virtualisation

RAS and Performance Optimised

Mission Critical

Web/IT Infrastructure Proxy/Caching

UCS B22 M3

Scale-Out

Price / Performance Optimised

Enterprise Class

UCS B200 M3

IT/Web Infrastructure, distributed database, ERP and

CRM

Performance Optimised

UCS B420 M3

Virtualisation, VDI, database, ERP and

CRM


Compute Servers : C-Series


UCS C460 M2

UCS C260 M2


Web/IT Infrastructure Proxy/Caching

UCS C22 M3

Scale-Out

UCS C24 M3

Big Data Storage Server

Price / Performance Optimised

RAS and Performance Optimised

Mission Critical

Enterprise Class

UCS C220 M3

Distributed DB Middleware

Collaboration

UCS C240 M3

Data Warehouse Middleware

Collaboration Big Data

Performance Optimised

UCS C420 M3

Virtualisation, Database and high-

end HPC


Dual 4x10 GE port-channels to a single server slot

Host connectivity PCIe Gen2 x16

HW Capable of 256 PCIe devices

OS restriction apply

PCIe virtualisation OS independent (same as M81KR)

Single OS driver image for both M81KR and 1280 VIC

Fabric Failover supported

Dual 4x10 GE (80 Gb per host) VM-FEX scale, up to 112 VM interfaces /w ESX 5.0

Customer benefits

Feature details

Virtualisation Interface Card 1200

UCS 1280 VIC / 1240 + Exp

UCS 2208 IOM

Side A Side B

256 PCIe devices

UCS 2208 IOM

Ethernet Connectivity


Switching Modes: End Host

Server 1

VNIC 0

Server 2

VNIC 0

Fabric A

L2 Switching

6100 A

MAC Learning

MAC Learning

VLAN 10

Spanning Tree

LAN

vEth 3 vEth 1

UCS connects to the LAN like a server, not like a switch

Server vNIC pinned to an uplink port

– No Spanning Tree Protocol

Reduces control plane load on FI

Simplified upstream connectivity

Maintains MAC table for servers only

– Eases MAC table sizing in the access layer

Allows multiple active uplinks per VLAN

Doubles effective bandwidth vs STP

Prevents loops by preventing uplink-to-uplink switching

Completely transparent to upstream LAN

Traffic on same VLAN switched locally


End Host Mode : Pinning

Dynamic pinning

‒Server ports pinned to an uplink

port/port-channel automatically

Static pinning

‒Specific ping groups created and

associated with adapters

‒Static pinning allows traffic

management, if required for

certain applications/servers

Oracle

VNIC 0

Server X

VNIC 0

3 1

Fabric A

6100 A

vEth 3 vEth 1 Pinning

Switching

2 4

APPLIED: PinGroup Oracle

DEFINED: PinGroup Oracle


End Host Mode: Upstream Connectivity

6100 A 6100 B

7K/5K1 7K/5K 2

vPC Domain

vPC peer-link

keep alive

EHM EHM 6100 A 6100 B

EHM EHM

Without vPC With vPC

PO PO PO

PO vPC vPC


Static or dynamic vNIC pinning based on VLAN membership of the uplink

A VLAN can exist only in one L2 disjoint network, i.e. no overlap

A vNIC is mutually exclusive to a L2 network upstream, i.e. a L2 network per vNIC

More than two L2 disjoint networks supported per host with virtual interface card

Ability to support multiple layer 2 disjoint networks upstream to UCS in End Host Mode

Customer benefits

Feature details

End Host Mode: Disjoint Layer 2 Networks

Production Vlan 10,20

Public Vlan 31,32

Backup Vlan 40,41

End Host

End Host


Switch Mode

Certain application like MS-NLB (unicast mode) have the need for

unknown unicast flooding, which is not done in EHM(End Host Mode)

Certain network topologies provide better network path out of the Fabric

Interconnect due to STP root placement and HSRP L3 hop

Switch Mode is “catch all” for different scenarios when EHM is not an

option

Application Specific Scenarios


Block Diagram: Host To Network Pinning

Mezzanine Card

IOH

CPU CPU

x16 Gen 2

x16 Gen 2


UCS Blade Chassis

UCS 6200

Expansion Module

UCS 6200

2X0X XP 2X0X XP

Mezzanine

Server Blade

Midplane

IO Modules

Fabric

Interconnects

Network Interfaces (NIF) to FI

Host Interface (HIF) to blades


UCS 2X0X (Gen 1/2 FEX) : Host to Network

Pinning Fabric Interconnect 1 link

2 links

4 links

Server slots pinned to uplink

Uplink: slots 1,2,3,4,5,6,7,8

Uplink 1: slots 1,3,5,7

Uplink 2: slots 2,4,6,8

Uplink 1: slots 1,5

Uplink 2: slots 2,6

Uplink 3: slots 3,7

Uplink 4: slots 4,8

slot 1

slot 2

slot 3

slot 4

slot 5

slot 6

slot 7

slot 8

slot 1

slot 2

slot 3

slot 4

slot 5

slot 6

slot 7

slot 8

slot 1

slot 2

slot 3

slot 4

slot 5

slot 6

slot 7

slot 8

NIF

NIF

NIF

F

E

X

F

E

X

Fabric Interconnect

Fabric Interconnect

F

E

X


UCS 2208 (Gen 2 FEX) : Host to Network

Pinning Server slots pinned to uplink

8 links Uplink 1: slot 1

Uplink 2: slot 2

Uplink 3: slot 3

Uplink 4: slot 4

Uplink 5: slot 5

Uplink 6: slot 6

Uplink 7: slot 7

Uplink 8: slot 8

slot 1

slot 2

slot 3

slot 4

slot 5

slot 6

slot 7

slot 8

NIF

F

E

X

Fabric Interconnect


Up to 8 * 10 Gb aggregated bandwidth to each fabric in a chassis

Port-channel is a user configurable choice, default mode discrete

Addition of links does not require chassis re-acknowledge

Supported number of links in a port-channel: 1,2,3,4,5,6,7 or 8

Load balancing

Resilience and flexibility

Customer benefits

Feature details

Port-Channel

FI 6200 FI 6200

80 Gb 80 Gb

Fabric Port-Channel

Port-Channel

FI 6200 FI 6200

40 Gb 40 Gb

2208

2204


UCS 2200 (Gen 2 FEX): Host to Network

Pinning

8 links Uplink 1: slots 1-8

Uplink 2: slots 1-8

Uplink 3: slots 1-8

Uplink 4: slots 1-8

Uplink 5: slots 1-8

Uplink 6: slots 1-8

Uplink 7: slots 1-8

Uplink 8: slots 1-8

slot 1

slot 2

slot 3

slot 4

slot 5

slot 6

slot 7

slot 8

NIF

F

E

X

Fabric Interconnect

Server slots channelled across

all uplinks

4 links

Server slots channelled across

all uplinks

Uplink 1: slots 1-8

Uplink 2: slots 1-8

Uplink 3: slots 1-8

Uplink 4: slots 1-8

slot 1

slot 2

slot 3

slot 4

slot 5

slot 6

slot 7

slot 8

NIF

F

E

X

Fabric Interconnect


UCSM C-series Integration (Nexus 2232)

DelMar and C-Peak MR6

Required for VIC 1225

Default CIMC Settings

‒ Shared-LOM-EXT

Dual Wire Mode still

supported

Multiple VIC 1225 supported

‒ C240, C260, C420, C460

NO Direct FI SUPPORT

Mgmt Traffic

Data Traffic

(LAN and FCoE)

OS or Hypervisor

PCIe Adapter GE LOM

CIMC

Nexus 2232 Nexus 2232

UCS 6100 or 6200 UCS 6100 or 6200


Block Diagram: Fabric Failover

1280 VIC

IOH

CPU CPU

x16 Gen 2

x16 Gen 2


UCS Blade Chassis

UCS 6248

Expansion Module

UCS 6248

2208XP 2208XP

Mezzanine

Server Blade

Midplane

IO Modules

Fabric

Interconnects

Fabric Failover


End Host Mode: Fabric Failover for Ethernet

Fabric provides NIC failover capabilities

when defining a service profile

Traditionally done using NIC bonding

driver in the OS

Provides failover for both unicast and

multicast traffic

Works for any OS on bare metal

Recommended in case of bare metal OS

Hyper - V

LAN SAN B SAN A

Half Width Blade Half Width Blade

Fabric Extender Fabric Extender

vN

IC

vN

IC

vN

IC

vN

IC

Adapter

BMC

Adapter

BMC

UCS Fabric

Interconnects

Chassis



Details

1280 VIC

IOH

CPU CPU

x16 Gen 2

x16 Gen 2


UCS Blade Chassis

UCS 6200

Expansion Module

UCS 6200

2200 2200

4x10 Gbps Ether channel from VIC 1200 to 2208 IO Modules 2 x 10 Gbps Ether channel from VIC 1200 to 2204 IO Modules

No user configuration required

vNIC flows are Load Balanced across links

Each individual flow limited to 10Gb

Fabric Failover available

Mezzanine

Server Blade

Midplane

IO Modules

Fabric

Interconnects


Adapter Port Channel

UCS 1280 VIC

2208 IOM

Side A Side B

vNIC1

VM 1. 10 Gb FTP traffic

2. 10 Gb UDP traffic

VM Flows

Up to 32 Gbps throughput per vNIC using flow based port-channel hash

2208 IOM

Implicit Port-channel between UCS 1280 VIC adapter and UCS 2200 IOM

Flow based hash

A vNIC is active on side A or B

A vNIC have access to up to 32 Gbps throughput


Block Diagram: VM-FEX

1280 VIC

IOH

CPU CPU

x16 Gen 2

x16 Gen 2


UCS Blade Chassis

UCS 6200

Expansion Module

UCS 6200

2200XP 2200XP

VM-FEX

Mezzanine

Server Blade

Midplane

IO Modules

Fabric

Interconnects


Available with RHEL 6.1

Default cluster for standard based port extenders

No UCSM and RHEV-M interactions in UCS 2.0

Virtual machine management via Libvirt tool

Ability to unify virtual and physical network

infrastructure for Red Hat KVM

Customer benefits

Feature details

VM-FEX with RedHat KVM

UCS 6k + VIC + VM Mgmt Link

Man

ag

em

en

t

Pla

ne

Inte

gra

tion

UCS Manager

VM Host

Hypervisor

VM

VM

FEX

VM

1 2 54

1 2 54 …

… Switch

Storage Connectivity


NPV N-Port Virtualiser (NPV) utilises NPIV functionality to allow a “switch” to act like a server

performing multiple logins through a single physical link

Physical servers connected to the NPV switch login to the upstream NPIV core switch

‒ Physical uplink from NPV switch to FC NPIV core switch does actual “FLOGI”

‒ Subsequent logins are converted (proxy) to “FDISC” to login to upstream FC switch

No local switching is done on an FC switch in NPV mode

FC edge switch in NPV mode does not take up a domain ID

UCS Fabric Interconnect FC NPIV Core Switch

Eth1/1

Eth1/2

Eth1/3

Server1

N_Port_ID 1

Server2

N_Port_ID 2

Server3

N_Port_ID 3

F_Port

N-Port

F-Port

F-Port NP-Port


SAN “End Host” NPV Mode N-Port Virtualisation Forwarding

Fabric Interconnect operates in N_Port Proxy mode

‒Simplifies multi-vendor interoperation

‒Simplifies management

SAN switch sees Fabric Interconnect as an FC End

Host with many N_Ports and many FC IDs assigned

Server facing ports function as F-proxy ports

Server vHBA pinned to an FC uplink in the same

VSAN. Round Robin selection

Provides multiple FC end nodes to one F_Port off an

FC Switch

Eliminates the FC domain on UCS Fabric Interconnect

One VSAN per F_port (multi-vendor)

F_Port Trunking and Channelling with MDS, 5K

SAN B SAN A

Server 1 VSAN 1

vFC 1 vFC 1

N_Proxy N_Proxy

F_Proxy F_Proxy

N_Port N_Port

6100-A 6100-B

F_Port

vFC 2 vFC 2

Server 2 VSAN 1

vHBA 1 vHBA 0 vHBA 1 vHBA 0

F_Port

NPIV NPIV FLOGI FDISC

VSAN 1 VSAN 1


SAN “End Host” NPV Mode N-Port Virtualisation Forwarding with MDS, Nexus 5000

F_Port Channelling and Trunking from MDS or Nexus

5000 to UCS

FC Port Channel behaves as one logical uplink

FC Port Channel can carry all VSANs (Trunk)

UCS Fabric Interconnects remains in NPV end host

mode

Server vHBA pinned to an FC Port Channel

Server vHBA has access to bandwidth on any link

member of the FC Port Channel

Load balancing based on FC Exchange_ID

‒per flow

SAN B SAN A

Server 1 VSAN 1

vFC 1 vFC 1

N_Proxy

F_Proxy

N_Port

6100-A 6100-B

F_Port

vFC 2 vFC 2

Server 2 VSAN 2


VSAN 1,2 VSAN 1,2

F_ Port Channel & Trunk

NPIV NPIV


SAN FC Switch Mode

UCS Fabric Interconnect behaves like an FC fabric

switch

Storage ports can be FC or FCoE

Light subset of FC Switching features

‒ Select storage ports

‒ Set VSAN on storage ports

No zoning configuration inputs in UCSM

Connection to an external FC switch is required:

‒Zoning configured and pushed to UCS from MDS

Fabric Interconnect uses a FC Domain ID

SAN

Server 1 VSAN 1

vFC 1 vFC 1

F_Port

N_Port

6100-A FC Switch

vFC 2 vFC 2

Server 2 VSAN 2


FC FCoE

6100-B FC Switch

F_Port

TE_Port

VSAN 1 VSAN 2 N_Port

MDS MDS


NAS Direct Attach

Default (recommended) - End Host Mode

‒ Superior traffic engineering

‒ Easier integration into network

‒ 1.4 Introduced Appliance Ports which allow direct

connect NAS filers

Options - Ethernet Switching Mode

‒ As of 1.4, no need to use this mode for NAS direct

connect

‒ Previous releases required switching mode for direct

connect NAS

Server 1 Accessing

Volume A

vEth 1 vEth 1

FI_A vEth 2 vEth 2

Server 2 Accessing

Volume B

vNIC

1

vNIC

0

vNIC

1

vNIC

0

NAS

FI-B

Appliance Port

A A

C1 C2

Volume

A Volume

B

LAN

U U A A

NetApp EMC


Adapters

Virtual Interface Card

iBFT, no iSCSI offloads

Broadcom 57112

Full offload, iSCSI HBA

Operating System support

VMware 4.1U1

Windows 2008 R2

Linux Red Hat 5.6, 6.0, 6.1

Comprehensive storage protocol support

Customer benefits

Feature details

iSCSI Boot Support in UCS Manager


Support for EMC and NetApp direct attached FC/FCoE storage (other vendors planned)

Local Zoning OR Upstream Zoning

UCS Configured in FC Switch Mode

Ethernet and FC switching modes are independent

Support to directly connect FC/ FCoE Lower cost point for small deployments

Customer benefits

Feature details

Direct Connection of FC/FCoE Storage

UCS B-Series

UCS 61xx/62xx UCS 61xx/62xx

FCoE Storage FC Storage


Key Considerations of FC/FCoE Direct

Connect As of April 2011 Default Zoning Not Supported

Default Zoning Explicitly set to DENY in 2.1.1a

Default Zoning GUI/CLI Controls Removed

Do Not Upgrade to 2.1.1a if Default Zoning is being Used

Local Zoning OR Upstream Zoning

Parallel Local and Upstream Zoning Currently NOT Supported

Upstream Zoning Provided by MDS/N5k

Migrating from Upstream to Local Zoning

CLI Commands to Remove Residual Upstream Zoning

Supported FC/FCoE Direct Connect Arrays

Check Note 5 on HCL for Updated List

63


Unified Appliance Support

64

File and block data over a single

port/cable

FCoE, iSCSI, NFS, CIFS

Port and cable consolidation

New port type: Unified Appliance Port

Appliance port of today + FCoE

Initial support for NetApp storage and

their Unified Target Adapter

UCS B-Series

UCS FI UCS FI

Storage

FCoE iSCSI NFS CIFS Unified Appliance Port


Complete Your Online Session

Evaluation

Give us your feedback and receive

a Cisco Live 2013 Polo Shirt!

Complete your Overall Event Survey and 5

Session Evaluations.

Directly from your mobile device on the

Cisco Live Mobile App

By visiting the Cisco Live Mobile Site

www.ciscoliveaustralia.com/mobile

Visit any Cisco Live Internet Station located

throughout the venue

Polo Shirts can be collected in the World of

Solutions on Friday 8 March 12:00pm-2:00pm

Don’t forget to activate your

Cisco Live 365 account for

access to all session material,

67

communities, and on-demand and live activities throughout

the year. Log into your Cisco Live portal and click the

"Enter Cisco Live 365" button.

www.ciscoliveaustralia.com/portal/login.ww

http://www.ciscoliveaustralia.com/mobile

http://www.ciscoliveaustralia.com/portal/login.ww

ucs fabric fundamentals - alcatron.net live 2013 melbourne/cisco live content/data centre...

Documents