dsn xstack training das,san,nas nyári egyetem. d-link europe dsn storage array training – march...

DSN xStack Training

DAS,SAN,NAS

Nyári egyetem

D-Link Europe DSN Storage Array Training – March 2010

Evolution of Storage Technology

Direct Attached SCSI

Network Attached Storage Fibre Channel Storage

IP SAN Storage

SCSIFC

EthernetFibre Channel Switch

Ethernet Switch

DAS

NAS

IP-SAN

FC-SAN

AP+File System

RAID

RAID

RAID + File System + AP

File System+ RAID

AP

AP+File System

initiator

target


DAS/NAS/SAN I/O Differences

(NFS/CIFS)

Block I/O

Block


SAN

Business Critical Applications

Email & Department Level & Remote DatabaseFile / Image & Content Management

Leadership, Management & Customer DatabaseMedical Database Management

Scientific Data Collection

NA

S/SA

N

Working Group Applications

DA

S

Office applications, Department File-Share

EnterpriseMission Critical Applications


DAS or Direct Attached Storage is connected directly to a server Data storage devices normally use SCSI/FC technology direct attached to the server Data backup and recovery typically utilize 20-30% of resources (CPU, system, IO, etc.) Good performance characteristics suitable for the SOHO environment Expansion of DAS is problematic

SCSIFC

EMAIL ERP FINANCE

SCSIFC

EMAIL ERP HR FINANCE

Exp

• Creates islands of storage difficult to manage

• Capacity expansion cannot be shared

DAS Applications


NAS Applications

NAS or Network Attached Storage connects through a standard Ethernet connection

NAS is typically configured as a file service for servers and workstations

NAS can allocate a shared storage space for different server or workstation

NAS does not perform well in typical block-level applications (transactions, streaming)

EMAIL ERP FINANCE

EMAIL ERP FINANCE

EXP

NAS provides simple means of capacity expansion


FC-SAN Applications

FC-SAN or Fiber Channel-Storage Area Network provides high performance shared storage

Provides security features allowing multiple hosts access of the shared storage pool

Provides block-based data access ideally suited for enterprise class applications

FC-SAN is the choice for storage infrastructure by large enterprises and service providers

FC HBAs in each server connect to the FC switch to form the FC-SAN

FC-SAN solutions are expensive, complex and costly to manage

EXPFC SWITCH

MAIL ERP FINANCE

MAILERP

FINANCE

FC SWITCH

MAIL ERP FINANCE

FC-SAN provides centralized expansion and management

FINANCE

HR

MAILERP


IP-SAN Applications

IP-SAN or Internet Protocol-Storage Area Network provides shared storage

Use of existing Ethernet infrastructure and server's Ethernet ports lowers costs

Provides block-based storage ideally suited for enterprise applications

Use of the existing network infrastructure means simple, rapid deployment of storage

IP development continues at 10 times the speed of Fibre Channel projecting 40G networks in the next 2-3 years

EXPEthernetSwitch

MAIL ERP FINANCE

ERP

EthernetSwitch

MAIL ERP FINANCEHR

Expansion is very simple and can be integrated into an existing Ethernet network

FINANCE

MAIL

ERP HR

MAIL FINANCE


Evolution of Ethernet

40G

100G

Ethernet has a long history of development from the emergence of Ethernet in 1983 to 10GB-T introduction in 2006Gigabit devices are now the standard with a new generation of 40G/100G Ethernet technology in the next 2 ~ 3 years


Storage Architecture Comparison

DAS NAS FC-SAN IP-SAN (iSCSI)

Technology SCSI Ethernet Fiber Ethernet

Performance High Low High High

Disk Utilization

Low, 30% Medium, 60% High, 70% High, 70%

Distance <25M Unlimited 100KM (No Repeater)

Unlimited

Centralized Poor Average Excellent Excellent

Data Sharing Poor Average Excellent Excellent

Scalability Poor Average Excellent Excellent

Backup Complex Average Simple Simple

DR Design Poor Average Excellent Excellent

Security Low Average High High

Management Low Average High Average

TCO Low Average High Average

Apply General Storage Data Share, Backup, Redundancy

Mission Critical Data, Backup, Redundancy

Mission Critical Data, Backup, Redundancy

Markets SMB/SME， SOHO SMB/SME， SOHO SMB/SME SMB/SME

Comparison of all relevant factors in selecting the most appropriate storage architecture.


DAS/NAS/SAN Summary

DAS – SMB/SME application, limited flexibility

NAS - focused on shared storage and addressing increasing demand for storage capacity

FC-SAN - focused on scalable storage optimizing data sharing and management

IP-SAN – focused on affordable scalable storage without restrictions

RAID

File System

Application

DAS

SCSI / FC

RAID

File System

Application

NAS

EthernetSwitch

FC-SAN

RAID

File System

Application

FC Switch

IP-SAN

RAID

File System

Application

EthernetSwitch

Ethernet

NFS/CIFS


IP-SAN versus FC-SAN


Competing Architectures

FC-SAN is highly manageable and deterministic but inflexible

IP-SAN is more flexible with simplified management


What is iSCSI?

Internet Small Computer Systems Interface Provides storage access over TCP/IP networks

Maps SCSI functionality to TCP/IP Protocol Similar to mapping SCSI over Fibre Channel (FCP)

Network Protocol–Peer to HTTP, NFS, FTP, Telnet, etc. (uses TCP)

Can be used with existing IP & Ethernet networks–NICs, Switches, Routers, etc.

Reuses networking and storage concepts


What is iSCSI ?

iSCSI is a transport for SCSI Commands iSCSI is an End to End protocol iSCSI can be implemented with current TCP/IP Stacks iSCSI can be implemented completely in a HBA iSCSI has the concept of Human readable SCSI Device (Node)

naming iSCSI adds its own CRC checking to ensure correct Data

iSCSI Transport includes Security as a base concept Link Authentication (e.g. CHAP) iSCSI Authentication for Access Control IPSec Packet Security (packet authentication and encryption)


What is iSCSI?

iSCSI (Internet SCSI) specifies a way to “encapsulate” SCSI commands in a TCP/IP network connection


Generic iSCSI PDU Format

BYTE 01234567

00 -- 03

04 -- 07

20 -- 23

16 -- 19

08 -- 15

01234567 01234567012345673210

Total AHSLength

Logical Unit Number (LUN)

Initiator Task Tag (ITT)

Expected Data Transfer Length

. I Opcode

hex 01F R W 0 0 Reserved

DataSegmentLength

Reserved ATTR

24 -- 27 Command Seq. Num. (CmdSN)

28 -- 31 Expected Status Seq Num. (ExpStatSN)

48 -- 51

or null

Header Digest (if Any) -- CRC32c

48 or 52

to n

Data-Segment (if Any) - Command Data

32 - 47

SCSI Command Descriptor Block (CDB)

n+1 to n+4

Data Digest (if Any) -- CRC32c


iSCSI Login

Two types of Login sessions Discovery (SendTargets) Normal (after any discovery mechanism)

Normal login phases Security negotiation Operational parameter negotiation Full Feature (perform I/O)

Login uses text-based parameter negotiation Syntax: key=value (or list of values) Designed for extensibility


iSCSI Security

Secure IP connection Integrity, authentication, and confidentiality Based on ESP (component of IPsec)

Authentication Mutual Authentication (CHAP)

Initiator to Target AND vice-versa

Integrity Cryptographic integrity, not just checksum or CRC Linked to authentication to prevent regeneration attack

Authorization iSCSI: Who can connect to which Target LUN masking & mapping handled by SCSI, not iSCSI


iSCSI Message TypesProtocol Data Unit (PDU)

Initiator to Target NOP-out SCSI Command

Encapsulates a SCSI CDB

SCSI Task Mgmt Cmd Login Command Text Command

Including SendTargetsUsed for iSCSI Discovery

SCSI data Output Data for Writes

Logout Command

Target to Initiator NOP-in SCSI Response

Can contain status

SCSI Task Mgmt Rsp Login Response Text Response SCSI data

Input Data from Reads Logout Response Ready to Transfer

R2T Async Event


iSCSI PDU Sequence

CMD PDU Write

R2T PDU

Data-Out PDU

Data-Out PDU

Cmd Rspse PDU, Status=good

CMD PDU Read

Data-In PDU ,Status=Good

Data-In PDU

CMD PDU Read

Cmd Response PDU , Status=Good

Data-In PDU, Status=Good

CMD PDU Write , Immediate Data

iSCSI

Initiator

iSCSI

Target


iSCSI Adapter Options

Copyright 2003 Storage Networking Industry Association. All Rights Reserved.

SCSI Port to OS SCSI Port to OS SCSI Port to OS

Software iSCSISoftware iSCSI

with TCP Off-load

iSCSI and

TCP Off-loadH

ost P

rocessin

g

Media Interface

Ethernet

Media Interface

Ethernet

Media Interface

Ethernet

Ad

apter C

ard

Adapter Driver

TCP/IP

iSCSI

Adapter Driver

TCP/IP

iSCSI

Adapter Driver

TCP/IP

iSCSI

iSCSI with Simple NIC

iSCSI with TOE iSCSI HBA


iSCSI Multi-Pathing Mechanisms

Ethernet Link Aggregation or Trunking Link layer (2), below TCP, transparent to iSCSI

Multiple TCP connections In a single iSCSI session Same or different Ethernet ports

Multiple iSCSI sessions Multipathing software (e.g., MPIO) above iSCSI Same or different hardware (e.g., Ethernet) ports


Link Aggregation SupportApplication

802.3ad1 8

Direct-attach GbE

2x servers w/2x GbE LAG direct-attach

2x GbE LAG direct-attach w/switch

802.3ad

8x GbE LAG direct-attach w/switch

2 GbE LAG

8 GbE LAG

802.3ad

2x2 GbELAGs

Trunking

DSN-2100

DSN-3200

DSN-5210

DSN-5220


Single-Session Multiple Connection per Session

• MC/S load balancing for a passive switch

• MC/S can provide dynamic load balancing

• MC/S can provide one or more paths to

storage

D-Link 8-port configurations maximize multiple

paths

Multiple-Connection SupportMC/S

Operating System support for MPIO, MC/S

AP MC/S1 MC/S AP2

12

C1 C2 C1 C2

MC/S (Multiple connections / session) support is setup on servers and storage at the same time providing incremental increases in available bandwidth.

Connections defined by

IP Address + TCP Port #


High-Availability Multi-Path

Multi-path solutions provide fully redundant physical

path components including NIC/adapters, cables and

switches, server and storage devices to create the

logical “path.” If one or more of these components

fail causing a path failure, the MPIO driver will

redirect all I/O to use an alternate path allowing

uninterrupted storage access.

Servers and storage provide

multiple connections

MultiPath(MPIO)

Servers and Storage must support MPIO

Fault tolerance: Upon port or switch failure, IO to the storage can be routed through an alternate path

Fault-tolerant: MPIO will take the initiative to switch to an alternate path

AP MPIO MPIO AP

Load balancing can be provided on LUNs with multiple sessions

Multi-gigabit ports can provide multiple dual-path configuration and/or multiple sessions

MPIO Layer


IP-SAN Pros and Cons

For: Runs over existing, ubiquitous Ethernet, TCP/IP fabrics. Internetworking built in Lots of fabric management tools IT folks understand TCP/IP

Against TCP Slow Start impacts I/O latency, throughput Lossy fabrics impact I/O latency through re-transmission and

complicate receive endpoint data placement. Bridging to legacy FC SANs slow/expensive because of TCP

termination overhead.


Fibre Channel over Ethernet (FCoE)

Enables interfacing with current FC infrastructure Lossless Ethernet improves Quality of Service Takes advantage of emerging 10G infrastructure and

pervasive Ethernet skill set


SCSI Read/Write Example over FC

SCSI Read

Host

FCP_CMND

Target

FCP_DATA

FCP_DATA

FCP_DATA

FCP_RSP

FCP_CMND

Host Target

FCP_XFER_RDY

FCP_DATA

FCP_DATA

FCP_RSP

SCSI Write

FCP_DATA

Unsolicited data(modest amount)

Exchange

Sequence (maybe out of order)


FCoE = lossless Ethernet

Switch or Endpoint

Eth

Tx

Switch or Endpoint

Port transmitbuffer

Port receivebuffer

Port receive packet buffer

Eth

Rx

HWM LWM

Outbound PAUSE generator

Eth

Tx

Eth

Rx

Ethernetlink

Port transmitbuffer

Inb

ou

nd

PA

US

E

Inb

ou

nd

PA

US

E

Outbound PAUSE generator

When port receive bufferfills to a high watermark,

issue PAUSE XOFF to linkpeer; when buffer drains to

low watermark, issuePAUSE XON to peer


FCoE Pros and Cons

For: Presents new but familiar PHY and Link Layers for FC Core switching discipline remains FC-SW-5 Higher FC layers almost completely unchanged

Against: Lossless fabrics are prone to congestion Ethernet-FC gateways with their different port speeds

are natural bottlenecks Heavy costs associated with:

FCoE or Converged Network Adapters (CNA) Implementing lossless fabric


Storage Array Components


HDD Interfaces - parallel → serial

SAS (Serial Attached SCSI) is a point-to-point

serial technology supporting full-duplex

operations up to 6Gb/s.

SCSI supports up to 16 devices cascaded at

speeds up to 320MB

ATA (IDE) for desktop computers is a point-to-

point interface. Main disadvantages include

thermal and cable length.

Serial topologies have effectively replaced parallel topologies due to the complexities of eliminating signal cross-talk issues that affect both performance, scalability and reliability.

SATA (Serial ATA) is a point-to-point serial

interface technology supporting half-duplex

operations up to 3Gb/s.


HDD Storage Systems Evolution

1986: UC BerkleyRAID Paper

2000: IBM Deskstar, 75GB1999: Maxtor ATA, 10.2GB1991: IBM ThinkPad, 1.2G

IBM #11968: Winchester HDD1956: RAMAC HDD 5M

1979: IBM 3370/2300M1973: IBM 3340/140M

2008

2000

1990

1980

1950

1989/ATA1986/SCSI-1

1983: IBM PC/XTMFM Drives, 10M

1997/Ultra ATA1995/SCSI-31991/SCSI-2

2006/SATA 2.52002/SAS 1.02001/SATA 1.0

2009: SATA 2TB2008: SATA 1TB2006: SAS, 500G2003: SATA, 100G

2003/iSCSI1995/FC

RAMAC PC/XT RAID SCSI-1 ATA FC SATA SAS iSCSI


HDD Interface OverviewType ATA SATA SCSI SAS FC

Xmit Type Parallel Serial Parallel Serial Serial

Addressing 2 1or16 (SATA II) 16 128 16M

Distance(M)

1 1 25 10 50km

Speed (MB/s)

100 150, 300, 600 160, 320 150, 300, 600

100, 200, 400, 1000

Ports 90 Pin 7 Pin 68 Pins 7 Pins Copper/Fiber

Dual Port No No NO Yes Yes

Topology Bus P-to-P Bus P-to-P Loop, Switched

Duplex Half Half Half Full Half/Full

Max Conn 2 1 or 15Port Multiplier

16 4096 w/expanders

Loop – 4096Switched - 16M

协议 ATA ATA SCSI SCSI SCSI

SAS

20??


Disk Drive Comparison

Read Write Read WriteIO/Sec (4K) MB/Sec (128K)

340

275

123108

155

125 117101

155

93105 104

iStor Performance BenchmarkDisk Drive Baseline - 50% Capacity

ST3300655SS 15K SAS - ST3750630SS 7.2K SAS - ST31000340NS 7.2K SATA

Seagate ST3300655SS Seagate ST3750630SS Seagate ST31000340NS


Typical Read/Write Data Path

Host I/F

Memory, I/O Bus

Processor

Cache

Cache

RAIDSystem

Interrupt

HDD

1

2 3 45

6The host transmits data to the target

device. The host interface Ethernet

(TCP/IP) interface decodes and processes

the packet. The layer also handles error

recovery such as re-transmission requests

due to packets errors (CRC, length, etc.)

TCP or iSCSI engine moves data to cache

1

2

Processor decodes SCSI command and

starts operation

Processor Cache mechanisms to start IO

data movement 5

DMA engines used to move data

to/from the cache and HDD

3

4

IO to/from HDD

6

The processor can touch the data several times during the processing of the iSCSI command consuming resources and available bandwidth. TCP/IP offload engines have helped to significantly reduce the bandwidth but processors are still directly involved with the setup of all hardware mechanisms to move the data through the RAID system thereby consuming valuable memory bus bandwidth.

Multiple touches of the data is the primary cause

of poor performance


Advanced SoC Technology

Network storage solutions have limited

performance and are comprised of a

motherboard, RAID cards, iSCSI or NICs

and storage virtualization software.

Single-chip SoC technology includes array

processors providing host network interface,

RAID features, HDD control and dual-

channel features in a single chip

The only SoC in the iSCSI storage market

that supports both 1 Gb and 10 Gb networks

that provides a high performance, reliable

and cost effective solution.

D-Link iSCSI IP-SAN Array


High Speed SoC Array Processor

iSNP8000

12 processor cores in the

iSNP8000 SoC provides a

parallel computing architecture

with a RAID processing unit for

best in class performance.

Built-in 1GbE and 10GbE

• Highest Gigabit port density

• Direct connect 8-port Gigabit

• No costly switches required

• No costly HBAs

• Simplified SAN structure

High-Speed/Bandwidth Design

Storage / Network Array ProcessorUp to 4GB of system memory for high performance applicationsIndependent high-speed cache and system memory to maximize the overall performance.


Redundant Support – Zero Downtime

Active

Passive

10G Link provides

zero latency cache

coherency

Supports Hot-swappable controllers

Active-Passive provides no loss of

performance on hardware failure

Redundant controllers provide the

highest reliability and availability

DSN-5220/DSN-5420 Dual Controllers

The 10G Reflective Memory Channel

(RMC) is a patented high-speed bus

providing low latency cache updates.

Upon a controller failure the surviving

controller will automatically take over

operations for zero downtime and

maximum in data security.

Active-Active双机运作模式下Zero Down Time


xStack Virtualization


Complete Virtualization

48

Virtualized storage is managed at the Storage Pool level Make QoS decisions at volume

creation Drives consolidated into one

available pool Deploy new volumes efficiently Manage storage resources

strategically Fully utilize storage capacity

Complete Virtualization Includes Servers and Storage

Free Space

RAID 1 Volume 100 GB



RAID 0 Volume 500 GB 450 GB

Virtualization

Virtualization

RAID 5RAID 10

End to End Virtualization


Virtual Storage Approach


Virtual Storage Benefits

Shared Virtual Pool

Shared Pool

Vol 1

Vol 2

Vol 3 12 disks

Isolated Islands of Storage

6 disks

Unused Storage

Unused Storage

Unused Storage

Vol 1

Vol 2

Vol 3

6 disks

6 disks

Lower Cost Decreased management

requirements Requires fewer disks Less power Uses full capacity of all disks

Higher Performance Optimized RAID level for

each application Volumes can span all disks Greater disk utilization


Virtual Storage Benefits

Ability to configure any combination of volume types; no need to make any global decisions up front

Allows all of the available storage capacity to be utilized without any wasted space

No need to pre-allocate drives to a specific storage pool

Ability to reconfigure any volume when needed; you are not locked into anything

All volumes are on-line during any grow or reconfigure operation


Easy to Use Management

No RAID group pre-configuration simplifies resource planning Create volumes in seconds Pre-defined applications for volume creation “On the Fly” RAID migration and volume expansion


Simple Volume Creation


xStack Performance


Advanced iSCSI Storage Engine

Eliminates performance bottlenecks of traditional storage architectures Wire rate 10GbE or 8x1GbE High transaction rates and bandwidth H/W TCP/IP, iSCSI & RAID acceleration Performance scales linearly with drive count Utilizes performance capability of SSD drives High Availability support [5 issued patents]

True Storage Virtualization Storage pools provide device independence Supports mixed device technologies: SAS/SATA/SSD

Low Power – 11 Watts Enables high density architectures


….

DSN xStack Base Architecture

Redundant Memory Channel

iSNP8000iSNP8000

Management

Processor

Management

Processor

10 GE

PHY

10 GE

PHY

sATA/SAS

Controller

sATA/SAS

Controller

Buffer MemoryBuffer Memory

XGMII Interface

8 x GE

PHY

8 x GE

PHY

OR

RGMII Interfaces

10 Gb/sBackplane

PHY

10 Gb/sBackplane

PHY

XGMII Interface

System MemorySystem Memory

…

….

sATA or SAS

Drives

sATA/SAS

Controller

sATA/SAS

Controller


DSN xStack Throughput

4 Port 8 Port 10Gb0

200

400

600

800

1000

1200

1400

448

896

1160

Sequential Performance

Jumbo Frame


DSN xStack 8-Port Performance

0.5K 1K 2K 4K 8K 16K 32K 64K 128K 256K 512K 1M

IO Transfer Size in Byte

4 Volumes

3 Volumes

2 Volumes

1 Volume

RAID-0 Sequential ReadMB/s

0.5K 1K 2K 4K 8K 16K 32K 64K 128K 256K 512K 1M

4 Volumes

3 Volumes

2 Volumes

1 Volume

RAID-0 Sequential Write



RAID-5 Sequential Write


MB/s

MB/sRAID-5 Sequential Read

MB/s4 Volumes

3 Volumes

2 Volumes

1 Volume

0.5K 1K 2K 4K 8K 16K 32K 64K 128K 256K 512K 1M

MB/s

0.5K 1K 2K 4K 8K 16K 32K 64K 128K 256K 512K 1M

4 Volumes3 Volumes2 Volumes

1 Volume


DSN xStack Transaction Rates

59

28K

84


xStack Data Protection Features


Non-Redundant RAID Support

JBOD Acronym for “Just a Bunch Of Drives” Stand-alone drive or concatenation of multiple drives (for a volume that is larger than a

single drive) Just provides storage capacity; no data redundancy or performance improvements

Stripe (RAID-0) Data is striped across two or more drives for improved performance (simultaneous I/O

across multiple drives)

Stripe is the same size on all drives

Total capacity is the stripe size times the number of drives

Volume is vulnerable to any drive failure; one drive failure will take the volume off-line

No rebuild is available in the event of a drive failure


Redundant RAID Support

Mirror (RAID-1) Data is mirrored across an even number of drives (complete copy)

Depending on which drives fail, a mirrored volume can sustain up to half of drives failing

Provides the maximum data protection, but consumes double the storage capacity

Rebuild will automatically begin onto other available drives (if sufficient capacity exists)

Parity (RAID-5) Similar to RAID-0, but requires one additional disk for parity data

Volume can sustain one drive failure, and it will continue to be available (in reduced mode)

Rebuild will automatically begin onto another drive, if sufficient capacity exists

Stripe-Mirror (RAID-10) Combination of stripe (RAID-0) and mirror (RAID-1)

Depending on which drives fail, a mirrored volume can sustain up to half of drives failing

Provides the maximum data protection and performance

Rebuild will automatically begin onto other available drive(s), if sufficient capacity exists


RPV2: RAID Protected Virtual Volume200GB RAID-5

DiskRAID 1

RAID 5

RAID 0

RPV2 automatically allocates 200GB space

Traditional RAID 5 Reconstruction RPV2 rebuild of RAID-5 volume

RAID 1

RAID 5

RAID 0

HDD Failure

Time-consuming reconstruction of entire HDD capacity affecting performance

RPV2 rebuilds only active volumes saving significant time

RAID Protected Virtual Volumes


Intelligent Drive Removal (Down Drive)

I need more

Capacity!

SMART Threshold Exceeded

Down Drive

Down drive can be used to move user data from HDD prior to failure avoiding costly volume rebuild

After successful data migration the HDD is automatically removed from service

Volume Micro Rebuild

The HDD may not respond within the timeout period due to media defects.

HDD will automatically revector media defects to

available space of the disk

Down Drive and Micro-Rebuild are proactive features that attempt to avoid time consuming operations that affecting system reliability and performance. These intelligent data protection mechanisms substantially improve system utilization.

Intelligent Data Protection


DSN xStack Systems Overview


D-Link IP-SAN Products

DSN-2100

DSN-3200DSN-3400

DSN-5210DSN-5410DSN-5000

DSN-1100

DSN-5220DSN-5420DSN-520DSN-540


DSN xStack Systems Overview

High-Performance IP-SAN Systems for the SMB Market DSN-5410: 1 x 10GbE port with 12 SAS or SATA-II drives in a 2U enclosure DSN-5210: 8 x 1GbE port with 12 SAS or SATA-II drives in a 2U enclosure DSN-3400: 1 x 10GbE port with 15 SATA-II drives in a 3U enclosure DSN-3200: 8 x 1GbE port with 15 SATA-II drives in a 3U enclosure DSN-2100: 4 x 1GbE port with 8 SATA-II drives in a 2U enclosure DSN-1100: 4 x 1GbE port with 5 SATA-II drives in a desktop enclosure

iSCSI Connectivity Less costly and much easier to manage than Fibre Channel Gigabit Ethernet infrastructure is readily available in all office buildings Compatible with all major host platforms (Windows, Macintosh, Linux,

VMware, etc.)

Storage Virtualization Ability to allocate volumes from a pool of available storage No pre-configuration or pre-allocation is needed


DSN-1100 Physical Characteristics

Rear View

Front View (with door closed) Front View (with door open)

iSCSI Data Ports(4x1GbE ports)

SerialDiagnostic

Port

ManagementEthernet Port(10/100 Mbps)

Power and Fault LED’s

Powerbutton


DSN-2100 Physical Characteristics

Rear View

Front View (with bezel) Front View (without bezel)

Hot-SwappableRedundant AC Power

Supplies (2)

iSCSI Data Ports(4x1GbE ports)

Serial Diagnostic Port


Power LED Fault LEDPower LED Fault LED

Power and Reset Switches


DSN-3XXX Physical Characteristics

Rear View

Front View (with bezel) Front View (without bezel)

Hot-SwappableRedundant AC Power

Supplies (3)

iSCSI Data Ports(8x1GbE-ports shown)

Serial Diagnostic Port


Power and Reset Switches

Power LED Fault LEDPower LED Fault LED



Internal View(cover removed for clarity)

Hot-SwappableCooling Fans (3)

Hot-SwappableRedundant AC

Power Supplies (3)


iSCSI Data Ports



Front View(Primary Array and Expansion Array)

Power, Fault, Ready LED’s

Modular Design and ExpandabilityPrimary Array with 12 drives and one or two RAID controllers

Dual Controllers provide High Availability in the event of a failure on one controllerUp to six (6) Expansion Arrays with 12 drives in each for a maximum of 84 drives

No need to add more RAID controllers as drives are added; performance scales linearly



Rear View – 8 x 1GbE

Rear View – 1 x 10GbE

Redundant power supplies (2)

Primary ControllerSecondary Controller

EnclosureServicesModule

Redundant power supplies (2)

Primary ControllerSecondary Controller

EnclosureServicesModule

Mute Audio Alarm Button

Mute Audio Alarm Button



Primary Array Controller(shown with cover removed for clarity)

Management Port(10/100/1000Mbps)

iSCSI Network Ports(8 x 1GbE shown)

SASExpansion

Ports (2)

RS-232 SerialDiagnostic Port



Expansion Array (rear view)

Primary I/O ModuleSecondary I/O Module

Redundant power supplies

Expansion Array I/O Module

Connection from Primary or Expansion

Array

Connection tonext Expansion

Array


DSN-5XXX Redundant Controllers

Active / Passive The primary controller services all system I/O The secondary controller is constantly being updated, so its cache memory is

up-to-date, with no performance degradation A failure on either controller will automatically transfer all network traffic to

the surviving controller, with no interruption to host I/O If the primary controller fails, the secondary controller will send “gratuitous

ARP’s” from all network ports, to redirect host communication to the network ports of the secondary controller

After replacing the failed controller it will automatically boot to return to a fully-redundant state (v2.8 or later)

Firmware updates are automatically applied to both controllers at the same time

A system restart for dual-controller systems will be eliminated in an upcoming firmware version

No performance degradation after a failover occurs All volumes are always accessible, even after a failover


Mini-SAS to SAS Cable

SAS to SAS Cable


SAS to SAS CablePrimary Array

Expansion Array #1Expansion Array #2

EXP-1 EXP-0

Primary Controller in Slot # 0

Blank-Off Plate

HOST EXPHOST EXP

Drives12-23

Drives24-35

Drives0-11


HOST EXPHOST EXP

Drives36-47

Drives48-59


HOST EXPHOST EXP

Drives60-71

Drives72-83

Expansion Array Cabling (single controller)

Blank-Off Plate

Blank-Off Plate

Blank-Off Plate

Blank-Off Plate

Blank-Off Plate

Blank-Off Plate

Single-ControllerSystem



SAS to SAS Cable


SAS to SAS CablePrimary Array


EXP-1 EXP-0EXP-1 EXP-0

Primary Controller in Slot # 0

Redundant Controller in Slot # 1

HOST EXP HOST EXPHOST EXP HOST EXP

Drives12-23

Drives24-35

Drives0-11



Drives36-47

Drives48-59



Drives60-71

Drives72-83

Expansion Array Cabling (dual controller)Dual-Controller

System


Cabling Topology (dual controllers)

IMPORTANT: All network cables must be connected BEFORE a failover occurs

To Host Servers

GbE Switch

To Management Network

Network Switch


Cabling Topology (dual controllers)

GbE Switch GbE Switch

Host Server


Compatibility

Total adherence to industry standards Certified with leading applications

Choice of data protection applications Use functionality included with operating system

Why this matters Works with existing best-in-class storage system infrastructures Manage advanced functionality with familiar tools

http://www.doubletake.com/pages/default.aspx

http://www.falconstor.com/en


OS/ApplicationsOS/ApplicationsConnectivityConnectivity Data ProtectionData Protection

DSN xStack Ecosystem

82

HardwareHardware

http://www.neterion.com/index.html

http://www.falconstor.com/en

http://www.doubletake.com/pages/default.aspx


Green Storage

RoHS = no hazardous substancesISO14001 = pollution control and

improved energy efficiency

D-Link Green Storage

D-Link Green Switches

66W

12WD-Link

Other MFG 150W 300W

Green Setup Green Technology

Smart Enclosures

Green Cooling Requirements

Low Power ConsumptionGreen Supply Chain

D-Link switches require 40% less energy than competitive products

Green Packaging

DSN products save energy with feature/functions that improve overall efficiency

The industry‘s lowest power consumption

Intelligent fan speed control reducing noise in the IT room

WEEE CompliantUse of recyclable package material

Simplified WEB design enables paperless operation

Very low power consumption reduces cooling requirements

and the carbon footprint.


DSN xStack Management Center


Getting Started

Java 6 Run-Time Environment Available from http://java.com

Launch any Internet Browser at the system Default IP address of 192.168.1.1 Requires a host that can communicate on the 192.168.1.x subnet

Startup Wizard Walks you through the first-time system configuration

Password for the Administrative Login (default password of “admin”) Management Port: IP Address, Network Mask and Gateway IP Address IP Address for one or more iSCSI data ports E-mail Notification (SMTP Server IP Address, STMP Server Port Number)

Alternative to the Startup Wizard Connect the RS-232 Serial Cable to the Diagnostic port

9600 bps, 8/N/1, no hardware handshake At the Login prompt, login as “admin” with a password of “admin” Select item “3” to set the out-of-band port configuration Note: This method does not allow you to set the other parameters (network portals, admin password, etc.)

Other Setup Activities Launch Java GUI from Default Web Page Set the system date, time and time-zone

http://java.com/


Startup WizardDefault IP Address is

192.168.1.1


Default Web Page

Click here to launch the

Java GUI


Java Management Center

Navigation Pane

Actions Pane

Details Pane

SummaryPane


GUI Capabilities

Platform Independent– Runs on Windows, Linux, Solaris, or Macintosh platforms– Just need to install the Java 6 Run-Time Environment

Easy-to-Use– Navigation pane allows you to manage multiple systems with a single GUI– Four views

Volume View: shows all volumes, iSCSI initiators, and active iSCSI sessions/connections Physical Storage View: shows all hard drives System Administration View: shows current hardware and software revisions, Event Log,

etc. Network Settings View: shows the IP addresses, gateways, network masks for the

management port and all iSCSI data ports– Target names are automatically generated by the system– All volumes are presented on all network ports– Controlled access from a single host initiator, several initiators, or all initiators– Optional CHAP password authentication for additional access security


GUI Capabilities

Volume Creation Wizard Pre-Defined Recipes -- commonly used applications (e.g., file server,

web server, etc.) Walk Me Through The Choices – selects the volume composition

based on answers to questions about performance and data redundancy expectations

Advanced Mode – allows you to completely define all of the volume characteristics

Down Drive

Provides the ability to systematically move all volumes off of a drive, so it can be gracefully removed from the system

Allows drives to be replaced while the system is running, without ever taking any volumes off-line

Used when replacing a smaller-capacity drive with a larger-capacity drive, or when a drive is reaching the end of its useful life


GUI Capabilities

Grow Volume– Allows the capacity of a volume to be increased, while still

maintaining the existing volume composition– The volume remains on-line during the grow operation– Some additional effort will be needed on the host operating

system to increase the size of the file system Reconfigure Volume

Allows you to change the volume composition (including RAID type, drive selections, etc.)

Also allows you to increase the capacity, if desired The volume remains on-line during the reconfiguration process If the volume size was increased, some additional effort will be needed

on the host operating system to increase the size of the file system


GUI Capabilities

Allocate Spare Drive Provides the ability to reserve a drive as a “spare” that cannot be

used for creating new volumes Volume rebuilds look for a spare drive of the same technology type

first (v2.7 and later) If no spare drive is allocated, volume rebuilds will look for any other

available capacity Create a Network Portal

Select Network Settings View Add Portal IP Address, Network Mask and Gateway IP Address to a

physical port Grant initiator access to the volume (default is “All Initiators”) Assign a CHAP password to the volume (optional)


GUI Capabilities

E-mail Notification and SNMP Traps Provides the ability to send an e-mail message when serious or

failure events occur Requires an external SMTP (Simple Mail Transport Protocol)

server for e-mail notification

Provides the ability to send an SNMP (Simple Network Mgmt Protocol) when serious or failure events occur (v2.7 and later)

Date, Time and Time-Zone Setup You should set these during initial system installation Ability to configure a third-party Time Server (NTP) such as

“time.nist.gov”


Host System Configuration


LAGs, MCS and MPIO

LAG (Link Aggregation Group) Link Aggregation allows for multiple Ethernet ports to be

combined to form one high-speed logical link to another network device

iStor LAG support is vendor unique so the switch MUST be configured or network errors will occur

Link aggregation works on a connection basis so overall performance will not be realized unless the number of server connections exceeds the number of data ports to the storage

Note: LACP is not supported. Switch must be manually configured


LAGs, MCS and MPIO

MCS (Multiple Connections per Session) MCS creates multiple connections within a single iSCSI session to

manage load balancing and path failover The feature is similar to LAGs in that it links multiple Ethernet ports

to form a higher speed link to the network device For increased performance, the Ethernet ports must be on separate

subnets (the round-robin algorithm is normally subnet centric) MCS can improve performance without the need for LAGs in some

configurations MPIO (Multi-Path IO)

MPIO creates two separate sessions to the iSCSI array to manage load balancing and path failover

MPIO provides link redundancy for path failover MPIO can be used in conjunction with LAGs


Microsoft iSCSI Initiator Configuration

Latest version is 2.08

Use Persistent Targets to automatically reconnect on reboot

Supports MPIO and MCS: MPIO creates 2 separate sessions to

the iSCSI array to manage load balancing and path failover

MCS creates multiple connections within a single iSCSI session to manage load balancing and path failover


iSNS (iSCSI Storage Name Service)

Modeled on Fibre Channel Nameserver Discovery domains (i.e., ability to separate resources)

Scalable discovery and configuration management Asynchronous notification of changes

Initiator retrieves all iSCSI target info from iSNS Rich information repository (e.g., IPsec config info, etc.) Central resource management


iSNS Domains

iSNS

iSNS is part of the infrastructure or a specific

management server

Different Discovery Domains

Host A

Host B

Host C

Storage B

Storage A

Host B and C will not discover

Storage A

Host A will not discover Storage B


Linux Configuration

After you have installed the open-iscsi Software Initiator you may need to make some modifications

Check the parameters in the Volume Advanced Settings for target volume with the values found in the iscsid.conf file, and make changes to the iscsi.conf file as needed


Macintosh Configuration

Third-party iSCSI initiators GlobalSAN

Free iSCSI Initiator from Studio Network Solutions

ATTO Technology Not free…

Easy-to-Use Persistent Target support MCS support for path

redundancy


VMware – Basic Configuration

Provides full path redundancy for a 3-server configuration

For the IP-SAN, each ESX Server uses 2 network ports that must be teamed to support path failovers (IP addresses in use must be a single subnet)

The bandwidth between the ESX servers and each switch is 3x the bandwidth between the switch and the storage array

Applications that are heavy in I/O can result in a high usage of processor 0

Significant improvement in performance can be realized by setting the affinity of a Virtual Machine to disallow processor 0

ESX Svr 1

ESX Svr 2

ESX Svr 3

Switch 1

Switch 2

xStackStorageArray


VMware - High Bandwidth Configuration

Provides full path redundancy and maximum bandwidth for 3 servers configured with a modest number of VMware LUNs (aka: Volumes)

The ESX Servers Virtual switches and port groups are configured as described in the Basic configuration

The storage controller is configured with 6 Network Portals (IP addresses) on one subnet providing a balanced configuration

ESX Svr 1

ESX Svr 2

ESX Svr 3

Switch 1

Switch 2

xStackStorageArray


VMware - LAG Configuration Provides full redundancy, maximum

bandwidth and a balanced network load for a 3-server configuration

The ESX Servers Virtual switches and port groups are configured as described in the Basic configuration

The controller is configured with Link Aggregation Groups (LAGs)

Each LAG has 3 Ethernet Ports and 1 Network Portal (IP address); only one subnet is used

The LAG support is vendor specific so the switch must be manually configured for LAG support, sometimes called “trunking”

ESX Svr 1

ESX Svr 2

ESX Svr 3

Switch 1

Switch 2

xStackStorage

Array

LAG

LAG


Best Practice and Troubleshooting


IP-SAN Best Practices

Host Servers Use server-class NICs designed for storage applications Use of Jumbo Frames can reduce the overhead on both your servers and

iSCSI targets; for end-to-end support, each device in the network needs to support Jumbo frames including the NIC and Ethernet switches

Network Switches Use non-blocking Ethernet switches and set the negotiated speed on the

switches Enable Flow Control on network switches and NIC/adapters Disable uni-cast storm control on iSCSI ports


IP-SAN Best Practices

Network Infrastructure Segregate IP-SAN and LAN traffic

Minimizes congestion and latency Configure additional Paths for High Availability

Use OS MPIO or MCS (multiple connections per session) Additional NICs in the server create additional connections Redundant Ethernet switches for maximum redundancy

Use CAT6 rated cables for GbE Network Infrastructures Use CAT6a or CAT7 for 10Gigabit installations

required for distances > 55 meters


DSN xStack Best Practices

Save a System Configuration File Allows you to recover the system configuration in the

event of a controller replacement: Network Portals, LAG’s, etc.

System Advanced Settings

Initiator access for all volumes

Avoids having to manually re-enter that information

A new System Configuration File should be saved after making any configuration changes

In the System Administration View, select “Settings” then select “Save”


DSN xStack Best Practices

Always operate the system with a fully-charged battery Default behavior will change to “write-thru” mode when the

battery is charging or missing, which results in SLOWER PERFORMANCE (unless you select “Ignore Battery Status”)

Battery may not be fully charged upon initial system installation, so wait for the battery to become fully charged before evaluating performance

Disable Windows Firewall during Firmware Upgrade The system will display a pop-up warning message if the

firewall is enabled

Firewall can be re-enabled after completing the firmware upgrade


System Troubleshooting Tools

Save Event History Download the Event Log and other system information from the GUI

Select “Save Event History” from the System Actions pane

Forward the file named EventHistory.log to iStor Technical Support

System Diagnostic Capture Active link on the Default Web Page to download the diagnostic capture from

each controller

Forward the captured file(s) to iStor Technical Support for analysis

256MB NAND Flash memory required Older controllers may only have 128MB

Serial Console Output Any error messages will be helpful

Version 2.7 (and later) will automatically include this information as part of the System Diagnostic Capture


System Troubleshooting Tips

Always have the customer save the event history when requesting help Required Information from the Customer:

Product Model Operating system General configuration (NIC, switch) Application

In some cases a capture of the serial console output may be needed to resolve an issue

If customers using LAGs ensure the switch is configured and flow control is enabled Lack of proper switch configuration can result in poor

performance due to packet dropping



Use of Jumbo Frames The 4-port and 10G products support 9K frames. The 8-port

products support a 4K frame (remember switch and NIC must also be configured).

Redundant Controllers require a Switch The switch is required for path failover. Management ports from BOTH controllers must be connected

to the network The management ports are not connected internally so therefore

both must be connected to maintain communication on a failover

SATA supported on single controller ONLY Installing a SATA drive in a dual controller system will cause a

‘Fail to Bind’ error on a boot or restart of the system.



The customer can ping the management port but cannot display the default web page Have the customer lower the security level of the browser

Have the customer reboot if a volume has gone offline due to a drive failure or drive removal The system updates meta-data on the 1st drive failure to

remove that drive as a volume member The system does not update meta-data when a drive failure

results in a volume offline state A failed drive may stay operational long enough to copy the

data to another volume If the wrong disk is removed causing the volume(s) to go

offline, re-insert the disk and then restart the system.



Cannot bring up GUI from remote Host Host maybe on different subnet requiring a gateway IP

address for the management port.

E-mail notification not working Must be able to ping mail server IP address from Management

Port. Can use ‘Test’ button in Management Center

Host doesn’t recognize Volume Maybe due to 2TB limit (Linux/Vmware/XP) Check access controls

Can ping Management port IP address but cannot access GUI Ensure system is ready (Ready/Fault LED)



SAN automatic File Sharing File sharing software is required to manage multiple host

access to the same volume (MSCS, Vmware, etc.)

dsn xstack training das,san,nas nyári egyetem. d-link europe dsn storage array training – march...

Documents

storage infrastructure

fcsan applications fcsan

fcsan fcsan solutions

direct attached storage

blockbased storage

shared storage pool

shared storage space

ipsan applications ipsan