the fibre generations of fibre channel · 2019-12-19 · according to the research firm dell’oro,...

1
Find out more about the Fibre Channel Roadmap at www.fibrechannel.org/roadmap.html SINGLE-MODE FIBER LINKS For distances over 100 meters which are usually outside of rooms or between data centers, Fibre Channel uses single-mode links. Distances of 10km or longer have always been supported for every speed except 128GFC and vendors often surpass the standard to support even longer metro-distances. Fibre Channel has proven solutions for mapping Fibre Channel over intercontinental distances for disk mirroring and data synchronization. 128GFC 64GFC 32GFC 16GFC 8GFC 4GFC 2GFC 1GFC 256GFC 0 100 1,000 10,000 Single-mode Fiber Link Distance (meters) MULTIMODE FIBER LINKS Over 90% of Fibre Channel links are based on multimode fiber and vertical cavity surface emitting lasers (VCSELs). Fibre Channel has deployed more optical bandwidth than any other protocol and benefits from the reach capabilities and reliability of each generation of Optical Multimode (OM) fiber. Fibre Channel is maintaining multimode link distances of 100 meters to support common architectures in data centers. 128GFC 64GFC 32GFC 16GFC 8GFC 4GFC 2GFC 1GFC 0 100 200 300 256GFC 100 meters on parallel OM4 0.5 and 2? km 0.5 and 2 km 2 and 10 km 1.4 and 10 km 4 and 10 km 10? km 10 km 10 km 10 km 100 meters on OM4 100 meters on parallel OM4 100 meters on OM4 100 meters on OM3 150 meters on OM3 150 meters on OM2 300 meters on OM2 300 meters on OM1 Multi-mode Fiber Link Distances (meters) FIBRE CHANNEL SHIPMENTS According to the research firm Dell’Oro, Fibre Channel port shipments will to continue to grow and reach over 12 million ports in 2016 for the first time. Throughout their 5-year forecast to 2019, Dell’Oro expects the industry to continue shipping over 12 million ports per year. Despite predictions and forecasts, Fibre Channel continues to grow with each shipment and delivers the scalability, speed and reliability on which thousands of companies depend. Fibre Channel Speed Speed in Development Future Speed FCoE Speed Speed in Development Possible Future Speed 8GFC 2005 2010 2015 2020 2025 16GFC 32GFC 64GFC 128GFC 256GFC 512GFC 1TFC 100GFCoE 200GFCoE 400GFCoE 100GFCoE 50GFCoE 25GFCoE 10GFCoE 40GFCoE Quad Lanes in QSFP Serial Lane in SFP 1995 OM 2.5M Annual Fiber Channel Ports Shipped 5M 7.5M 10M 12.5M 2000 2005 2010 2015 2020 ANNUAL PORT SHIPMENTS 1GFC 2GFC 4GFC 16GFC 32GFC 8GFC 10GFCoE Fibre Channel has a laser-focus on speed and continues to progress at a blistering pace. Fibre Channel is continu- ally evolving to higher speeds to meet the high bandwidth needs of storage applications. When large blocks of data are moved between servers and storage, the performance of the application is directly dependent on how fast the data can fly. The storage industry has come to rely on Fibre Channel to deliver superior performance and reliability for mission-critical applications. Fibre Channel has traditionally doubled link throughput when the available technology can fit in the SFP form factors. The two lower lines on the graph at the left show the exponential growth in serial speeds of Fibre Channel and Fibre Channel over Ethernet. 8GFC and 10GFCoE require the SFP+ form factor that supports speeds up to 10 Gb/s since the SFP form factor only supported up to 5 Gb/s. 32GFC requires the SFP28 that supports 28Gb/s and 25GbE. The SFP form factor will continue to evolve and support speeds over 100 Gb/s in the next decade. With Gen6 Fibre Channel, the T11 technical committee has developed the 32GFC SFP28 as well as the 128GFC QSFP28 that aggregates 4 lanes into a single module. Fibre Channel and Ethernet are both adopting these 4X technologies in QSFP form factors to meet the needs of inter-switch links that aggregate bandwidth from multiple sources. The upper two curves on the chart on the left show how the 4X technologies are creating incredibly high speeds needed for core networking. Instead of running 4 SFP-based links, the industry uses parallel optics in the MPO connector to deliver over 100Gb/s of bandwidth in one QSFP port. FIBRE CHANNEL SPEEDMAP MEDIA AND MODULES 2W 4W Duplex LC Cable Parallel MPO Cable 1GFC-256GFC 128GFC-1TFC Fibre Channel is focused on storage in the data center and uses the latest fiber optic technologies to deliver massive bandwidth. Every few years, Fibre Channel doubles its data rate to provide exponential growth in speeds. In 2016, Fibre Channel introduces “Gen6 Fibre Channel”, which consists of two speeds — 32GFC in the SFP28 form factor, and 128GFC in the QSFP28. 32GFC uses duplex fibers while 128GFC is based on quad lanes that use the MPO connectors. This trend is expected to continue with serial lanes for connectivity to servers and storage and quad lanes for network connections. FIBRE CHANNEL Designed by Scott Kipp © Fibre Channel Industry Association 2015. All rights reserved. Thanks to the Ethernet Alliance for sharing graphics from www.ethernetalliance.org/roadmap/ $10.95 Fibre Channel Speed Speed in Development Future Speed FCoE Speed Speed in Development Possible Future Speed THE PAST, PRESENT AND FUTURE OF FIBRE CHANNEL 1 GFC 1990 2000 2010 2020 2GFC 4GFC 8GFC 16GFC 32GFC 64GFC 128GFC 256GFC 512GFC 200GFCoE 50GFCoE 25GFCoE 10GFCoE 40GFCoE 100GFCoE Quad Lanes in QSFP Serial Lane in SFP THE ROADMAP www.fibrechannel.org/roadmap.html GENERATIONS OF FIBRE CHANNEL POD 1 POD 2 POD 3 MAIN DATA CENTER Fibre Channel is at the heart of the data center connecting servers to storage, and relied upon for the most strenuous workloads. For example, Fibre Channel is deployed in many high-end applications in financial and governmental institutions where reliability and scalability are paramount. Fibre Channel consistently delivers greater than "five 9s" or 99.999% uptime as measured by vendors and customers in data center deployments worldwide. Fibre Channel storage area networks are often completely redundant to ensure constant service and uncorrupted data without single points of failure. Server Racks Ethernet Switch and Router Racks Patch Panels Transport Equipment Storage Racks Fibre Channel MAINFRAMES Mainframes are still at the heart of most financial transactions because of their proven reliability and scalability. Often considered a different data center within a data center, mainframes have reliability requirements over “five-9s” and FICON (Fibre Channel used in mainframes) connects to storage, tape libraries and printers reliably and securely. DUAL FABRICS To ensure application uptime and highly reliable access to data, Fibre Channel fabrics are usually configured with an “air gap” between redundant fabrics. The air gap means that fabric “A” can completely fail and the backup fabric “B” will become the primary so that servers don’t lose access to their valuable data. DISK MIRRORING To ensure that every transaction is reliably processed, disk arrays are mirrored between data centers. Often spanning thousands of miles, primary disk arrays are mirrored so that the secondary disk array contains the exact same information upon failure of the primary. SERVER CONNECTIONS Servers are connected to Fibre Channel networks with host bus adapters (HBAs) or converged network adapters (CNAs). HBAs adapt Peripheral Component Interconnect (PCI) connections to Fibre Channel ports. CNAs support Fibre Channel over Ethernet (FCoE) and have Ethernet ports that typically connect to edge switches that connect the Fibre Channel traffic to the core of the SAN. HBAs and CNAs often have multiple ports that are connected to dual fabrics to ensure high availability. DISASTER RECOVERY SITE This disaster recovery site mirrors data via Fibre Channel to multiple sites and archives data in tape libraries and virtual tape libraries. In the case of a remote site failure, the disaster recovery site goes live and secondary servers are activated to become primary servers. Fibre Channel uses Fibre Channel Internet Protocol (FCIP) and transport (DWDM or long haul) networks to connect multiple data centers around the world to keep data synchronized and highly available. Solutions based on Fibre Channel have proven their effectiveness in ensuring highly reliable data transfers at gigabit/second speeds. Storage Array Area Server Area Patch Panel Area Ethernet Switching Area Transport Area FCIP Switch Mainframe Area Fibre Channel Switching Area Archival Area Fabric A Fabric A Fabric B Fabric B Tape Library Virtual Tape Library STORAGE HIERARCHY The venerable storage triangle shows how flash has traditionally been used for the highest performing applications while hard disk drives are used for mainstream storage and tape for archiving. The rapid growth in capacity and reduction in cost of NAND Flash technology could turn the storage triangle upside down by enabling flash-based archival storage products. Delivering higher throughput, lower latency and low power, the flash based storage should enable >10TB SSDs in 2016 and drive the need for high speed Fibre Channel. Flash-based Storage Storage Array Tape Library Disk-based Storage Tape-based Storage Just a Bunch of Disks (JBOD) Hard Disk Drive (HDD) Tape Tape Drive Solid State Drive (SSD) Flash Chip Link Start End Connections # of Fibers 1 Server (S1) Edge Switch (E1) 0 2 2 Edge Switch (S2) Core Switch (E2) 3 12 3 Core Switch (S3) Storage Array (E3) 4 2 3 1 3 2 4 1 2 S2 S1 E1 E2 E3 S3 QSFP Module MPO Connector MPO to MPO Connection LC to LC Connection Trunk Cables Patchcord Patchcords LC Connector SFP Module CABLING SYSTEMS The diagram on the right shows three typical links between servers and storage. Link 1 from a server to an edge switch has no fiber optic connections and is a simple point-to-point link. Link 2 is a 128GFC Inter-Switch Link (ISL) from a QSFP28 to a QSFP28 that is connected with MPO connectors. Link 3 connects switches to storage via two trunk cables and has 4 LC connections with up to 1.5dB of connector loss to support 100 meters. STORAGE AREA NETWORKS Find out more about the Fibre Channel Roadmap at www.fibrechannel.org/roadmap.html

Upload: others

Post on 24-Jul-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: THE FIBRE GENERATIONS OF FIBRE CHANNEL · 2019-12-19 · According to the research firm Dell’Oro, Fibre Channel port shipments will to continue to grow and reach over 12 million

Find out more about the Fibre Channel Roadmap at www.fibrechannel.org/roadmap.html

S I N G L E - M O D E F I B E R L I N K S

For distances over 100 meters which are usually outside of rooms

or between data centers, Fibre Channel uses single-mode links.

Distances of 10km or longer have always been supported for

every speed except 128GFC and vendors often surpass the standard

to support even longer metro-distances. Fibre Channel has

proven solutions for mapping Fibre Channel over intercontinental

distances for disk mirroring and data synchronization.

128GFC

64GFC

32GFC

16GFC

8GFC

4GFC

2GFC

1GFC

256GFC

0 100 1,000 10,000

Single-mode Fiber Link Distance (meters)

M U LT I M O D E F I B E R L I N K S

Over 90% of Fibre Channel links are based on multimode fiber

and vertical cavity surface emitting lasers (VCSELs). Fibre Channel

has deployed more optical bandwidth than any other protocol and

benefits from the reach capabilities and reliability of each generation

of Optical Multimode (OM) fiber. Fibre Channel is maintaining

multimode link distances of 100 meters to support common

architectures in data centers.

128GFC

64GFC

32GFC

16GFC

8GFC

4GFC

2GFC

1GFC

0 100 200 300

256GFC 100 meters on parallel OM40.5 and 2? km

0.5 and 2 km

2 and 10 km

1.4 and 10 km

4 and 10 km

10? km

10 km

10 km

10 km

100 meters on OM4

100 meters on parallel OM4

100 meters on OM4

100 meters on OM3

150 meters on OM3

150 meters on OM2

300 meters on OM2

300 meters on OM1

Multi-mode Fiber Link Distances (meters)

F I B R E C H A N N E L S H I P M E N T S

According to the research firm Dell’Oro, Fibre Channel port shipments

will to continue to grow and reach over 12 million ports in 2016 for the

first time. Throughout their 5-year forecast to 2019, Dell’Oro expects the

industry to continue shipping over 12 million ports per year. Despite

predictions and forecasts, Fibre Channel continues to grow with each

shipment and delivers the scalability, speed and reliability on which

thousands of companies depend.

Fibre Channel Speed Speed in Development Future Speed FCoE Speed Speed in Development Possible Future Speed

8GFC

2005 2010 2015 2020 2025

16GFC

32GFC

64GFC

128GFC

256GFC

512GFC

1TFC

100GFCoE

200GFCoE

400GFCoE

100GFCoE

50GFCoE

25GFCoE

10GFCoE

40GFCoE

Quad Lanesin QSFP

Serial Lanein SFP

1 9 9 5

OM

2.5M

Annual Fiber Channel Ports Shipped

5M

7.5M

10M

12.5M

2 0 0 0 2 0 0 5 2 0 1 0 2 0 1 5 2 0 2 0

AN

NU

AL

PO

RT

SH

IPM

EN

TS

1GFC2GFC

4GFC

16GFC

32GFC

8GFC

10GFCoE

Fibre Channel has a laser-focus on

speed and continues to progress at a

blistering pace. Fibre Channel is continu-

ally evolving to higher speeds to meet

the high bandwidth needs of storage

applications. When large blocks of data

are moved between servers and storage,

the performance of the application is

directly dependent on how fast the

data can fly. The storage industry has

come to rely on Fibre Channel to deliver

superior performance and reliability for

mission-critical applications.

Fibre Channel has traditionally doubled

link throughput when the available

technology can fit in the SFP form

factors. The two lower lines on the

graph at the left show the exponential

growth in serial speeds of Fibre Channel

and Fibre Channel over Ethernet. 8GFC

and 10GFCoE require the SFP+ form

factor that supports speeds up to 10

Gb/s since the SFP form factor only

supported up to 5 Gb/s. 32GFC requires

the SFP28 that supports 28Gb/s and

25GbE. The SFP form factor will continue

to evolve and support speeds over 100

Gb/s in the next decade.

With Gen6 Fibre Channel, the T11

technical committee has developed

the 32GFC SFP28 as well as the

128GFC QSFP28 that aggregates 4

lanes into a single module. Fibre Channel

and Ethernet are both adopting these

4X technologies in QSFP form factors

to meet the needs of inter-switch links

that aggregate bandwidth from multiple

sources. The upper two curves on the

chart on the left show how the 4X

technologies are creating incredibly

high speeds needed for core networking.

Instead of running 4 SFP-based links,

the industry uses parallel optics in the

MPO connector to deliver over 100Gb/s

of bandwidth in one QSFP port.

F I B R E C H A N N E L S P E E D M A P

M E D I A A N D

M O D U L E S

2W

4W

Duplex LC Cable

Parallel MPO Cable

1GFC-256GFC

128GFC-1TFC

Fibre Channel is focused on storage in

the data center and uses the latest fiber

optic technologies to deliver massive

bandwidth. Every few years, Fibre

Channel doubles its data rate to provide

exponential growth in speeds. In 2016,

Fibre Channel introduces “Gen6 Fibre

Channel”, which consists of two speeds

— 32GFC in the SFP28 form factor, and

128GFC in the QSFP28. 32GFC uses

duplex fibers while 128GFC is based on

quad lanes that use the MPO connectors.

This trend is expected to continue with

serial lanes for connectivity to servers

and storage and quad lanes for network

connections.

F I B R EC H A N N E L

Designed by Scott Kipp© Fibre Channel Industry Association 2015. All rights reserved.

Thanks to the Ethernet Alliance for sharing graphics from www.ethernetalliance.org/roadmap/

$10.95

Fibre Channel Speed Speed in Development Future Speed

FCoE Speed Speed in Development Possible Future Speed

T H E P A S T , P R E S E N T

A N D F U T U R E

O F F I B R E C H A N N E L

1 GFC

1990 2000 2010 2020

2GFC

4GFC

8GFC

16GFC

32GFC

64GFC

128GFC

256GFC

512GFC

200GFCoE

50GFCoE

25GFCoE

10GFCoE

40GFCoE

100GFCoE

Quad Lanesin QSFP

Serial Lanein SFP

T H E

R O A D M A P

www.fibrechannel.org/roadmap.html

G E N E R A T I O N S O F F I B R E C H A N N E L

POD 1

POD 2

POD 3

MAIN DATA C E NTERFibre Channel is at the heart of the data center

connecting servers to storage, and relied upon for

the most strenuous workloads. For example, Fibre

Channel is deployed in many high-end applications

in financial and governmental institutions where

reliability and scalability are paramount. Fibre

Channel consistently delivers greater than "five 9s"

or 99.999% uptime as measured by vendors and

customers in data center deployments worldwide.

Fibre Channel storage area networks are often

completely redundant to ensure constant service

and uncorrupted data without single points of failure.

Server Racks Ethernet Switchand Router Racks

Patch Panels Transport EquipmentStorage Racks

Fibre Channel

MAINFRAMES

Mainframes are still at the heart of most financial

transactions because of their proven reliability and

scalability. Often considered a different data center within

a data center, mainframes have reliability requirements

over “five-9s” and FICON (Fibre Channel used in

mainframes) connects to storage, tape libraries

and printers reliably and securely.

DUAL FABRICS

To ensure application uptime and highly reliable

access to data, Fibre Channel fabrics are usually

configured with an “air gap” between redundant

fabrics. The air gap means that fabric “A” can

completely fail and the backup fabric “B” will

become the primary so that servers don’t lose

access to their valuable data.

DISK M IRRORING

To ensure that every transaction is reliably processed,

disk arrays are mirrored between data centers. Often

spanning thousands of miles, primary disk arrays are

mirrored so that the secondary disk array contains the

exact same information upon failure of the primary.

S ERV ER CONNECTIONS

Servers are connected to Fibre

Channel networks with host bus

adapters (HBAs) or converged

network adapters (CNAs). HBAs adapt

Peripheral Component Interconnect

(PCI) connections to Fibre Channel

ports. CNAs support Fibre Channel

over Ethernet (FCoE) and have

Ethernet ports that typically connect

to edge switches that connect the

Fibre Channel traffic to the core of the

SAN. HBAs and CNAs often have

multiple ports that are connected to

dual fabrics to ensure high availability.

DISASTER RECOVERY S ITE This disaster recovery site mirrors data via Fibre

Channel to multiple sites and archives data in

tape libraries and virtual tape libraries. In the case

of a remote site failure, the disaster recovery site

goes live and secondary servers are activated to

become primary servers. Fibre Channel uses

Fibre Channel Internet Protocol (FCIP) and transport

(DWDM or long haul) networks to connect multiple

data centers around the world to keep data

synchronized and highly available. Solutions

based on Fibre Channel have proven their

effectiveness in ensuring highly reliable data

transfers at gigabit/second speeds.

Storage Array Area

Server Area

Patch Panel Area

Ethernet Switching Area

Transport Area

FCIP Switch

Mainframe Area

Fibre ChannelSwitching Area

Archival Area

Fabric A

Fabric A

Fabric B

Fabric B

Tape Library

Virtual Tape Library

STORAGE H IE R ARCHY The venerable storage triangle shows how flash has traditionally

been used for the highest performing applications while hard

disk drives are used for mainstream storage and tape for

archiving. The rapid growth in capacity and reduction in cost of

NAND Flash technology could turn the storage triangle upside

down by enabling flash-based archival storage products.

Delivering higher throughput, lower latency and low power, the

flash based storage should enable >10TB SSDs in 2016 and drive

the need for high speed Fibre Channel.

Flash-based Storage

Storage Array

Tape Library

Disk-based Storage

Tape-based Storage

Just a Bunch of Disks (JBOD)Hard Disk Drive (HDD)

Tape Tape Drive

Solid State Drive (SSD)

Flash Chip

Link Start End Connections # of Fibers

1 Server (S1) Edge Switch (E1) 0 2

2 Edge Switch (S2) Core Switch (E2) 3 12

3 Core Switch (S3) Storage Array (E3) 4 2

3

1

3

2

4

1

2S2S1

E1 E2

E3

S3

QSFPModule

MPOConnector

MPO to MPO Connection

LC to LC Connection

Trunk Cables

Patchcord

Patchcords

LCConnector

SFPModule

CABL IN G SYSTEM SThe diagram on the right shows three typical links between

servers and storage. Link 1 from a server to an edge switch has

no fiber optic connections and is a simple point-to-point link.

Link 2 is a 128GFC Inter-Switch Link (ISL) from a QSFP28 to

a QSFP28 that is connected with MPO connectors. Link 3

connects switches to storage via two trunk cables and has 4

LC connections with up to 1.5dB of connector loss to support

100 meters.

S T O R A G E A R E A N E T W O R K S

Find out more about the Fibre Channel Roadmap at www.fibrechannel.org/roadmap.html