storage overview & architecture

8/12/2019 Storage Overview & Architecture

1/57

Storage Overview AndArchitecture

Arvind Shrivastava


2/57


3/57

Direct Attached Storage(DAS)

Low Cost Solution

Simple to Configure

De-Centralized Storage

No Storage Consolidation

No High Availability

Low Performance


4/57

Network Attached Storage(NAS)

Heterogeneous Environment

Centralized Storage

Low Performance

Limited scalability

Network Congestion during backups & Restore

Ethernet Limitations


5/57

Storage Area Network

Heterogeneous environment

Centralized Storage Management

High Degree of Fault Tolerance

Best and superior performance

Storage Consolidation

Fast and efficient backups and restores

Dynamic Scalability

Expensive solution for small setups


6/57


7/57

Mid-Range Storage Features

Excellent ease of use Virtualization Dynamic virtual disk expansion

Business Copy functions Continuous Access functions High availability features

High, middle*, and low models and configurations Multiple operating system support Single pathing support for all operating systems Coexistence with heterogeneous configurations


8/57


9/57


10/57


11/57

Continuous Access-Overview


12/57

Flex Copy Concept

Features Allows use of low end storage

for low-cost point-in-time copiesof production data

Point-in-time copy to and restorefrom Low end storage

CLI or GUI ConfigurationBenefits

Reduced TCO in mixedproduct/non-production

Offloads production data fromsecondary operations

Allows for distributed remotedata and hi performance two-stage backup/archiveconfigurations

Cost-effective, externalpoint-in-time copies

Low endstorage

P

C1

Enterprisestorage


13/57

Product Positioning


14/57


15/57


16/57

Additional Features EVA4000/6000/8000

Additional features unique to the second generation EVA

New controllers with improved performance, higher capacity support, larger cache, more FC ports Up to 200TB of presented capacity (versus 35TB for the first generation EVA)

Support for 1024 LUNs (first generation EVA was 512) Support for active -active failover using multipath softwarefor all operating systems Increased support for boot from SAN (AIX, Solaris) Direct Connect support for Windows Additional CA functionality Support for native HBAs and HBA drivers Additional snapshot and snapclone functionality


17/57

Useful Links

Information sources :-

HP Enterprise Virtual Arrayhttp://h18006.www1.hp.com/storage/arraysystems.html

HP Command View EVAhttp://h18006.www1.hp.com/products/storage/softwar e/cmdvieweva/index.htm

Whitepapershttp://h18006.www1.hp.com/storage/arraywhitepapers.html


18/57

Storage backup OverviewAnd Architecture

Arvind Shrivastava


19/57

BACKUP SOFTWARE

What is it? Software that provides automated data protection for businesseswith 24x7 availability needs.

What does it do? Data Protection : copies data onto a storage device, so that in

case of a need (loss, corruption, disaster), data can be easilyrecovered and made accessible.

Media management: easily manages the library catalogues tokeep track of all media and copies of data for fast recovery.

Most important features: Automated backups that scale from small workgroups to multi-

site, heterogeneous SAN & NAS environments with thousands ofservers.

Fully-integrated Zero-Downtime backup with Instant-Recovery .


20/57

Architecture Components

manager ofmanagers

distributedGUI

operationsconsole

cellmanager

cellclients


21/57

Client-Server Modules

media agent(MA)

disk agent(DA)

cell console(CC)cell manager(CM)


22/57

Inter-process Communication (IPC)

sessionmanager

cell manager

tcp/ip

tcp/ip

tcp/ip

disk agent

media agent

disk agent

media agent

tcp/ip

tcp/ip

scheduler

cell console

networkbackup/restore

localbackup/restore

sharedmemory

sessionmanager


23/57

How to choose between tape drives and tape librariesservers

Tape drives Autoloaders Tape Libraries

Servers are configuredindividually andbackup device is

connected directly tothe server

Disk capacity to bebacked up is less than200 GB

Cost consciouscustomer

Single/Multiple servers Unattended backup LAN based Backup Disk capacity to be

backed up is 200 GBto 1 TB

Consolidation isrequired

Multiple servers areconfigured together

Unattended backup LAN or SAN based

backup Disk capacity to be

backed up is morethan 1 TB

Consolidation andcentralizedmanagement isrequired

Storage external toservers in JBOD ordisk arrays


24/57

25GB

100GB

50GB

6 10025 50 200Speed GB/hour (compressed)12

C a p a c

i t y

( c o m p r e s s e

d )

Relative Performance

Ultrium 215

Ultrium 230

DAT 40

Ultrium 460SDLT 320

DAT 24

400GB

200GB

DLT VS80

Workstations

Office Servers

Departmental/

local network

Corporate/networked

backup

DAT 72


25/57Complied by Ranganath Sadasiva

Tape DeviceN a tive Com pressed N a tive Com pressed N a tive Com pressed

DAT 12/ 24 1.2 2.4 12 24 4.32 8.64DAT 20/ 40 2.4 4.8 20 40 8.64 17.28DAT 72 3 6 32 72 10.8 21.6DLTvs80 3 6 40 80 10.8 21.6DLTvs160 8 16 80 160 28.8 57.6

DLT 80 (obs) 6 12 40 80 21.6 43.2SDLT 110/ 220(obs) 11 22 110 220 39.6 79.2Ultrium 215 7.5 15 100 200 27 54Ultrium 230 15 30 100 200 54 108SDLT 160/ 320 16 32 160 320 57.6 115.2SDLT 600 36 72 300 600 129.6 259.2Ultrium 448 24 48 400 800 86.4 172.8Ultrium 460 30 60 200 400 108 216Ultrium 960 80 160 400 800 288 576

Date Transfer Speed MB/ Sec Data Capaci ty in GB

Ba ck up capa city GB / hour-

m a x

Tape drives Speeds and feeds - Comparison


26/57

Features

Features Required in any Backup software Advanced backup to disk Oracle/SAP Integrations Zero Downtime Backup

Split mirror Snapshot Snapclone Filesystem / application backup on inactive MC/SG node


27/57

Overview Advanced backup to disk

Why backup to disk?Benefits

Fast random access allowing: Fast single file restore Space efficient backup

Instant recovery e.g. switching for recovery instead of restoring

data from tape Faster restore of backup chains No tape streaming problems Ideal for RAID 5 Easy to detect disk failures More protected, e.g. it s not easy to steal a disk


28/57

Advantages of ZDB

The advantages of using Data Protector Oracle ZDB

integration are the following: ZDB reduces the performance degradation of theapplication system. The tablespaces are in backup mode (online backup) or

the database is shut down (offline backup) only during theshort period required to create a replica (split the mirrordisks or create snapshots). The time to create a replica is significantly reduced.

Following its creation, tape backup can be created on thecopied data, at leisure , using a separate backup system.The Data Protector Oracle ZDB integration offers onlineand offline backup of your Oracle Server System(application system).


29/57

BACKUP CONCEPT-SPLIT MIRROR BACKUP


30/57

ZDB Setup

P

P primary LDEV

M mirror copy (MU0-2)

True online backup for

integrated applications Split mirrors may used for

instant recovery or resynced

No performance impact onapplications during backup

Mirror synchronization beforeor after backup

Automatic mirror rotation

API based integration

Backup host

Application host

MM

XP

M0 21


31/57

Backup Software and Storage Integration Concept

Client 1 Client 2


32/57


33/57

Questions?


34/57

New HP Storage Products

Arvind Shrivastava


35/57

RISS

Introducing

HP StorageWorksReference InformationStorage System

What is RISS is and who wants it?

Th HP St g W k


36/57

The HP StorageWorksReference Information Storage System (RISS)

A cornerstone of HP ILM

(Information LifecycleManagement )A fully integrated and uniquely

scalable system for access to

reference information that reduces Total cost of

Ownership, mitigates risk andturns data into information

HP St g W k


37/57

HP StorageWorksReference Information Storage System

Manage Costs Remove static data from application

servers/storage Shorten backup windows

Eradicate duplicate data objects

Mitigate Risks Automated retention of messages &

attachments Data is digitally signed, time stamped &

protected Assist customers to meet their compliance

requirements

Exploit Data Assets Power indexing!

Grid computing for fast search/retrieval


38/57

AB C

AB C A

B C

AB C

As the number of information objects grows

cost of management increases accessibility to the information decreases

Scale is the Problem

TCO $

# of content objects managed

Access

Time

TCO

Performance

HP StorageWorks RISS


39/57

HP StorageWorks RISSarchitectural benefits

back end '

front end'

Modular, redundant, self healing gridcomputing and storage (smart cells)

Application-independent indexing, search andretrieval of information

Objects in the RISS cannot be modified or deleted

until end of retention period

Content is digitally signed and time stampedfor regulatory compliance

User Application

Application Integration

RISS

Open protocol API

Clients

smart cell

Application integrationwith e-mail and MS Office

Client applications get added archive functionality(architecture transparent to them)

smart cell


40/57

hp StorageWorksFile System Extender (FSE)

A General Overview

Arvind Shrivastava


41/57

What is FSE?

HP StorageWorks File System

Extender (FSE) is new-generationdata management software that ispart of the HP InformationLifecycle Management portfolio. Enables automatic andtransparent data movementbetween production (primary)storage media and secondarystorage media, using simple user-defined rules.


42/57

Changing digital storage demands

Time

S t o r e

d d a

t a

Reference

Operational

Majority is reference

information

FSE attacks thecosts of

reference data


43/57

FSE Basics

Based on Client/Server architecture.

Infinite File System FSE software supports LTO drive technologies for

LTO Ultrium 1 and LTO Ultrium 2 media.

WORM Support. Automatic error detection FSE automatically detects drive and mediahardware errors. NFS & CIFS support


44/57

Managing storage spaces

FSE storage spaces


45/57

MSA/EVA & FSE

productionstorage SCSI

disk

MSA1500/EVA

secondary

storageSATA/FATA disk

secondarystorage

MSL tape library

1. Inactivefiles movedfrom SCSI toSATA disk

2. Optionalsecond copyto tape

3. Automatic &transparentrecall ofmigrated files

4. File recallfrom second

copy if firstunavailable


46/57

HP EFS WAN Accelerator


47/57

HP EFS WAN AcceleratorHow Does it Work?

Removes All Redundant TCP Traffic on WANs

Files, Emails, Backup, Web Traffic, FTP, Applications Stores All TCP Traffic On Disk Never Send The Same Data Twice Reduces WAN Traffic By Up To 98%

Optimizes Application Protocol Behavior Removes Most Round Trips for Chatty Apps Like Windows Highly Effective for the Most Common Applications

Optimizes the Behavior of TCP Reduces Chattiness in TCP Implements Latest TCP Optimizations

Up to 100 Times Faster Throughput



48/57

HP EFS WAN AcceleratorThree-part Solution

The Problem HPs Solution What it Does

1. Not EnoughBandwidth

Scalable DataReferencing (SDR)

Remove repeatedbytes from the WAN forall TCP traffic

2. TCP Chattinessand Inefficiency

Virtual WindowExpansion (VWE)

Optimizes performanceof TCP

High speed TCPoptimizations

Enables much higherthroughput on LFNs

3. ApplicationChattiness andInefficiency

Transaction Prediction(CIFS, MAPI)

Optimizes theperformance of specificapplications



49/57

HP EFS WAN AcceleratorManagement Features Overview

EFS WAN Accelerator Manager

Provides central management of up to 500 appliances Provides fleet management

Monitors health, throughput & acceleration done Performs SW updates to groups of nodes

Separate product packaged as an appliance

HP Proliant Management HP Systems Insight Manager

Full Integrated Lights-out (iLO) support


50/57

HP Storage Essentials Suite

Storage Software DivisionHewlett-Packard

Unified Management of Server and Storage


51/57

Unified Management of Server and StorageInfrastructure

Storage Island

Efficiency

Consolidate infrastructuremgmt tools

Centralize and automate

routine tasksImprove deployment costs

Lower training costs

Deploy resources faster andmore reliably

Enable IT agility

Single point of integrationbetween business process and ITinfrastructure

Specify SLAs across entireinfrastructure

Consistent security model forentire infrastructure

Quick access to businessoperation metrics (e.g., audit andusage reports)

Increase availability

Quicker time to problemresolution

Manage systems remotelyfrom any location

Server Island
http://www.skyscraperpicture.com/gg3.jpg


52/57

Introducing HP Storage Essentials

Chargeback

OracleViews

CustomizeReports

ExchangeViews

File SystemViewsProvisioning

Capacity Performance TopologyMaps

SybaseViews

CentralizedReporting

Policy Mgr GUI & CLUI

3 rd Party/HP Developed

Main console for open , he terogeneousSAN management

Enterprise Edition

Provisioning Mgr

Chargeback Mgr

Oracle Viewer

Main console for o pen ,heterogeneousSAN management

Heterogeneous host to array pathp rov is ion ing wizard

Asset based chargebackmanagement . Assig n t ie rs

Oracle database availability andperformance v iews

Exchange d atabase avai lab i l i ty andperform ance v iews

Exchange Viewer

Sybase database availability andperform ance v iews

File System Viewer

Global Reporter

Report Designer

Sybase Viewer

File sys tem scannin g rec la imwasted space

Rollup report ing o f mult ip le StorageEssent ia ls Server ins tances

Develop cust om repor ts for s torageinfras truc ture


53/57

HP St g E ti l O l Vi


54/57

HP Storage Essentials Oracle Viewer

Capabilities:

Discovers databaseinstances, hosts,databases &tablespaces

SAN dependency &path management

Closed loop capacitymanagement

Real-time performancemonitoring

Role-based securityPolicies, events,

reports

Extends StorageEssentials capabilities

"inside" Oracle databasesto ensure availability and performance of databaseapplications

Wh i h P i ?


55/57

Where is the Pain ?

Under-utilized assets

Storage infrastructure IT staff

Cost of heterogeneous management isexpensive and inefficient

Application down time issues angers thecustomer

Troubleshooting is time consuming Help desks are flooded

Server consolidation/data center movesdrives the budgetOn-going justification of the budget

What happened to all the storage? Why do we need more now? When

again?

Key Qualification Questions


56/57

y Q QIdent i fy ing the Pain Poin ts

How do you manage increasing storage capacity with flat or shrinkingIT headcount?

Do you have a SAN? Can you tell what the impact of a lost SANelement will be on your applications and users?

How do you keep your staff trained on a wide range of device-specificelement managers and tactical SRM tools that, right now, only addcomplexity?

Do you want to replace the whiteboards and spreadsheets yourecurrently using for SAN management with something that is morescalable and reliable?

How do you avoid vendor lock-in and heavy, proprietary agents thatcome with other solutions?

Can you provision storage in real time to support new applications andprojects?

How do you comply with SAN change control and internal audits?


57/57

storage overview & architecture

Documents