getting more (and less) from virtual provisioning …...2012/08/08  · getting more (and less) from...

27
Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation Wednesday 11:00 Noon 08/08/2012 Session Number 11170

Upload: others

Post on 15-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering

Tony Negro

EMC Corporation

Wednesday 11:00 – Noon 08/08/2012

Session Number 11170

Page 2: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Objectives

At the end of this session, you will better understand

• Virtual Provisioning and Virtual Pools for Count

Key Data (CKD) devices

• Advanced utilities for Virtual Pools

• Fully Automated Storage Tiering for Virtual Pool

(FAST VP) theory of operation

• Potential benefits that can be achieved when

deploying these technologies

Page 3: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Agenda

• Storage Provisioning Overview

• Provisioning terminology

• Thin Provisioning mapping

• Provisioning challenges

• Storage Tiering Consideration

• Why use different tiers

• Data mobility between storage tiers

• Automated Storage Tiering Concepts

• Fully Automated Storage Tiering for Virtual Pool

(FAST VP) components

• FAST VP Implementation

Page 4: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Architectural view of array components

5

Front End

(FICON)

Cache

Back End

Disks

Page 5: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Standard Provisioning Concept

6

Front End

(FICON)

Cache

Back End

Disks

101D -3390-9

…… 101E -3390-9

……

Host

addressable

devices

Single

RAID rank

Track

mapping

tables

Page 6: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Virtual (thin) Provisioning Concept

7

101D -3390-9

…… 101E -3390-9

……

Front End

(FICON)

Cache

Back End

Disks

Thin

devices

Track group

mapping

tables

Virtual Pool

Data

devices

Page 7: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Virtual Provisioning Terminology

8

TERM DESCRIPTIONHost Accessible

Device

A „device‟ that is presented on a FICON channel for host use

Thin Device (Virtual

Device)

A „Host accessible device‟ that has no storage directly associated

with it

Internal Device A „device‟ used for internal function of the array

Data Device An „Internal Device‟ that provides storage capacity to be used by a

„Thin Device‟

Thin Pool (Virtual

Pool)

A collection of „Data Devices‟ that provide storage capacity for

„Thin Devices‟

Track Group The size of the smallest contiguous region of a „device‟ for which

an extent mapping can occur

Extent Mapping Specifies the relationship between the „Thin Device‟ and „Data

Device‟ extents.

Bind The process by which one or more „Thin devices‟ are associated

to a „Thin Pool‟

Thin Device

Allocated Capacity

The capacity that has been allocated from the thin pool capacity

for the exclusive use of a thin device.

Thin Device Written

Capacity

The capacity on a 'Thin Device' that was written to by a host. In

most implementations this is a subset of the 'Thin Device Allocated

Capacity'.

Page 8: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Standard Provisioning issues

• Slow process

• Complex physical layout

• Physical disk contention (“hot spots”)

• Expanding physical capacity can be a

challenge

Page 9: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Virtual Provisioned Environment

10

101D -3390-9

…… 101E -3390-9

……

Front End

(FICON)

Cache

Back End

Disks

Thin

devices

Track group

mapping

tables

Virtual Pool

Data

devices

REBALANCE

Page 10: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Virtual Provisioned Environment (Rebalanced)

11

101D -3390-9

…… 101E -3390-9

……

Front End

(FICON)

Cache

Back End

Disks

Thin

devices

Track group

mapping

tables

Virtual Pool

Data

devices

Page 11: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Virtual Provisioned Tiered Environment

12

101D -3390-9

…… 101E -3390-9

……

Front End

(FICON)

Cache

Back End

FC

Thin

devices

Track group

mapping

tables

EFD

SATA

Virtual

Pools

Page 12: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Disk Drive Characteristics

13

Technology Latency (MS)

IOPS (read miss,

single thread)

Sequential Read

from disk (MBPS)

SATA 7.2K 12.5 80

FC/SAS 15K 5.8 180

EFD 0 2500

Page 13: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Virtual Provisioned Tiered Environment

14

101D -3390-9

…… 101E -3390-9

……

Front End

(FICON)

Cache

Back End

FC

Thin

devices

Track group

mapping

tables

EFD

SATA

Virtual

Pools

Thin

devices (64

P-I-T copies)

201D -3390-9

……

Page 14: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

SATA Pool thin device allocation and DSS Backup throughput

15

Running a “special” DB

query for the CIO

(against the daily P-I-T

copy of PROD DB), and

it‟s REALLY running

S_L_O_W….Help!

Page 15: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Let’s have a closer look….

16

Page 16: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Non-disruptive volume mobility (VLUN)

17

101D -3390-9

…… 101E -3390-9

……

Front End

(FICON)

Cache

Back End

FC

Thin

devices

Track group

mapping

tables

EFD

SATA

Virtual

Pools

Thin

devices (64

P-I-T copies)

201D -3390-9

……

MOVE with

REBIND

Page 17: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Has Random Workload picked up?

18

Page 18: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Has Response Time improved?

19

Page 19: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Virtual Provisioning Benefits

• Enables efficient utilization of available resources

• Virtual Pools

• Wide striping distributes I/O across spindles and back

end processors

• Advanced utilities allow greater flexibility

• Provides flexibility when deploying multiple tiers

• Opportunity for „Over provisioning‟

• Provision more space than actually exists

• Consume space as required

• Basis for FAST VP

• Active performance management at a sub-volume, sub

dataset level

Page 20: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Automation at all Layers

SMS &

HSM

FAST VP

Page 21: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Basis for FAST

• With information growth trends, all Fibre Channel (FC) configurations will: • Cost too much

• Consume too much energy

• Take up too much space

• FAST helps by leveraging disk drive technologies

• What makes FAST work in real-world environments? • Skew: At any given time, only a

small address range is active – the smaller the range, the better

• Persistence: If an address range is active (or inactive), it remains so for a while – the longer the duration, the better

Work

load

EFD FC SATA

80% of IO’s on 20% of capacity

Page 22: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

• Symmetrix Tier – a shared storage resource with common technologies (Virtual Pools)

• FAST Policy – manage Symmetrix Tiers to achieve service levels for one or more Storage Groups

• FAST Storage Group – logical grouping of thin devices for common management

FAST Policies

Storage Elements

Automatic

<100%

100%

Custom

x%

y%

z%

FAST Storage

Groups

VP_Prod_DB2

VP_QA_DB2

Symmetrix Tiers

R66_SATA_1TB

1 TB SATA

RAID 6 (6+2)

R1_FC_450GB

450 GB 15K FC

RAID 1

R53_EFD_200GB

200 GB EFD

RAID 5 (3+1)

Page 23: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

FAST VP Time Windows

• Performance time window defines when statistics are

collected and decayed

• Workload Analysis Period

• Affects decay rates

• Affects time to respond to changes

• Default of 7 days (168 hours)

• Data movement time window defines when FAST VP is

allowed to move data

• Windows can be customized, but recommendation for initial

implementation is 24x7

Page 24: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

FAST VP Implementation

• Performance data collected by

the system

• Intelligent Tiering algorithm

generates movement requests

based on performance data

• Allocation Compliance

algorithm generates movement

requests based on capacity

utilization

• Algorithms continuously assess

I/O statistics and capacity use,

and make decisions for

promotion and demotion

Performance Data

Collection

Analyze

Performance Data

Allocation

Compliance

Algorithm

Execute Data

Movement

Intelligent Tiering

Algorithm

Page 25: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Remote Replication Awareness for FAST VP

• Align FAST VP performance

between R1 and R2 sites

• Performance metrics are

shared from the R1 to the R2

site

• In case there is a swap

where production is run from

the R2 site, the performance

on the R2 site will closely

match the R1 performance

FAST VP SRDF

Coordination

FAST FAST

R1 R2

Page 26: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Summary

• FAST VP is a policy-based system that promotes and

demotes data at the sub-volume, and more importantly,

sub-dataset which makes it responsive to the workload

and efficient in its use of control unit resources

• FAST VP introduces active performance management, a

revolutionary step forward in storage management

• FAST VP delivers all these benefits without using any host

resources

Page 27: Getting more (and less) from Virtual Provisioning …...2012/08/08  · Getting more (and less) from Storage Virtual Provisioning and Automated Storage Tiering Tony Negro EMC Corporation

Follow Us!

• Follow EMC Symmetrix

@EMCSymmetrix

www.facebook.com/Symmetrix

28