actual trends in backup protection solution ibm tivoli storage management ondřej bláha tivoli...

Actual trends in backup protection solution

IBM Tivoli Storage Management

Ondřej BláhaTivoli Storage Community of Practise

[email protected]

IBM Forum 2012 – EstoniaTallinn, October 9, 2012

mailto:[email protected]

Market Share for Overall Storage Software

IBM held its #3 share rank position in 2011, growing slightly faster Y/Y than the total market at 12%.

-10.0% 0.0% 10.0% 20.0% 30.0% 40.0% 50.0%

TOTAL MARKET

HP + Autonomy

NetApp

IBM

Symantec

EMC2011 y/y growth

HP’s “true” growth is about 10.5%, factoring in Iron Mountain pre-acquisition revenue (lumped into “others” in the tracker).

IDC estimates total Storage Software market for 2011 at $14.2B, with 11.3% growth year-to-year

Overall Storage SW Market includes the following segments Data Protection and Recovery Archiving Software Storage Infrastructure Software Storage and Device Management Software Storage Replication Software File System Software,

Market Share for Data Protection and Recovery

This segment includes Tivoli Storage Manager DfSMS XIV ProtecTier SW

Source: IDC Quarterly Storage Software Tracker; IBM Market Insights

IBM held its #2 share rank position, growing faster than EMC, Symantec and the overall market rate at 14.3%.

IBM grew faster than HP, w/o Iron Mountain archiving revenue. CA is pushed out of the top 5 by CommVault growth and HP acquisition of Autonomy.

0.0% 10.0% 20.0% 30.0% 40.0% 50.0% 60.0% 70.0%

TOTAL MARKET

HP+Autonomy

CommVault

EMC

IBM

Symantec 2011 y/y growth

HP’s “true” growth is about 4%, factoring in Iron Mountain pre-acquisition revenue (lumped into “others” in the tracker).

Gartner Magic Quadrant (2012)

Current Situation: The Tidal Wave of Data Continues …

The amount of digital information continues to grow at 40%-60% per year And we need to keep more of it, longer

–Regulations and governance–Data mining and analytics (“Big Data”)–Don’t know what can/should be expired

And the costs of losing data are increasingly unacceptable …–Lost revenues–Lost customer confidence–Embarrassment in the market–Fines from contracts, government agencies

Source: Various external consultant reports

We Need to do More with Less, and we We Need to do More with Less, and we need to do it smarterneed to do it smarter

2006 2008 2010 2012

IBM Storage Management Portfolio

Offering efficient utilization and automated management of all IT resources

Virtualizing storage for ease of administration, capacity utilization and transparent data migration

Enabling business continuity at all times while aligning recovery costs based on business risk and information value

Retaining information automatically to enable future business leverage, or to comply with internal or external regulations

Data Protection & Data Protection & Recovery Recovery

ManagementManagement

Data Protection & Data Protection & Recovery Recovery

ManagementManagement

Information Information Retention & Retention &

Lifecycle Lifecycle Management Management

Information Information Retention & Retention &

Lifecycle Lifecycle Management Management

Storage Resource Storage Resource & Infrastructure & Infrastructure

Management Management

Storage Resource Storage Resource & Infrastructure & Infrastructure

Management Management

TSM HSM For Windows

TSM For Space Management

System Storage Archive Manager

Information Archive Manager

Storewize7k With Fastback and easy tier

SAN Volume Controller (SVC)

Tivoli Storage Productivity Center(TPC) and SSPC

TPC for Replication

Omegamon XE for Storage (z/OS)

Tivoli Storage Manager (TSM) family

TSM FastBack

TSM FastBack for Workstations (CDP)

Flash Copy manager

Leading the Way in Data Protection and RecoveryIBM Tivoli Storage Manager has been a leader in helping organizations protect,

retain and assure availability of their most important asset, their data, for more than 19 years.

Comprehensive SolutionComprehensive Solution•Data Protection: Backup / Restore•Data Retention: Archive•Disaster Recovery•HSM / ILM•Application Protection•Database Protection•Continuous Data Protection (CDP) •Bare Machine Recovery•Robust Remote Office Recovery

Proof PointsProof Points•More than 20,000 loyal customers, including 60% of the Fortune 500

•1st disk-based backup solution•Unified recovery across:

─The broadest range of OS and HW platforms: from laptop to mainframe

─All storage tiers•Four consecutive years of growing faster than the market*

* Source: IDC

Leading the Way in Data Protection and RecoveryIBM Tivoli Storage Manager has been a leader in helping organizations protect

their data, for more than 19 years.

* Source: IDC

TSM FastBack for Workstations: data protection for desktops & mobile users

FastBack for Workstations

Mobile Office

End to End Recovery End to End Recovery Management Management


TSM FastBack: Block Level Incremental Forever & CDP protection for critical servers

WAN / LAN


FastBackServer(s)

FastbackClients

ApplicationsFile Servers

VMware Servers

FastbackClients

FastBackServer(s)

Remote Office(s) Data CenterMobile Office


FastBackDR Server



FlashCopy Manager: Robust application protection using hardware snapshot

WAN / LAN


FastBackServer(s)

FastbackClients

FlashCopyManager


VMware Servers

FastbackClients

FastBackServer(s)

FlashCopyManager

Remote Office(s) Data CenterMobile Office


FastBackDR Server



FlashCopy Manager: Robust application protection using hardware snapshot

Tivoli Storage Manager: Industry leading scalability, performance, availability, deduplication Advanced tape and Disaster Recovery support Broad OS and HW platform support, application protection

WAN / LAN


TSM Server

TSMClients

ProtecTIER

Tiers of Storage

Information Archive

FastBackServer(s)

FastbackClients

TSMClients

FlashCopyManager


VMware Servers

FastbackClients

FastBackServer(s)

FlashCopyManager

DR Operations Archive / Off SiteRemote Office(s) Data CenterMobile Office


WAN / LAN


TSM Server

TSMClients

ProtecTIER

Tiers of Storage

Information Archive

FastBackServer(s)

FastbackClients

TSMClients

FlashCopyManager


VMware Servers

FastbackClients

FastBackServer(s)

FlashCopyManager



Tivoli Storage Manager Administration center Implements a task-oriented WEB user interface. Provides a server status Health Monitor, which makes

Tivoli Storage Manager server status easier to visualize. Has integrated management of policies between Tivoli

Storage Manager FastBack and Tivoli Storage Manager. Makes learning Tivoli Storage Manager easier for the

new users..

WAN / LAN


TSM Server

TSMClients

ProtecTIER

Tiers of Storage

Information Archive

FastBackServer(s)

FastbackClients

TSMClients

FlashCopyManager


VMware Servers

FastbackClients

FastBackServer(s)

FlashCopyManager



Real-time monitoring leverage proven IBM components Real-time monitoring of all TSM and FastBack servers Predefined dashboards with customization Agent builder tool for additional monitoring No additional licenses required

WAN / LAN


TSM Server

TSMClients

ProtecTIER

Tiers of Storage

Information Archive

FastBackServer(s)

FastbackClients

TSMClients

FlashCopyManager


VMware Servers

FastbackClients

FastBackServer(s)

FlashCopyManager



Historical customer reporting based on customer needs Stores historical data obtained from TSM servers that are

reported using IBM Tivoli Monitoring Leverages Cognos Business Intelligence

Reporting to create custom reports Scheduler to export reports in various formats No additional licenses required

TSM support from A to Z

TSM supports from Apple to xSeries TSM supports from Apple to xSeries to pSeries, to zSeriesto pSeries, to zSeries

TSM supports all major TSM supports all major versions of versions of critical critical applicationsapplications

StorageWorks

StorEdge

TSM supports over 500 devices TSM supports over 500 devices diskdisk, , tape tape oror optical optical

TSM – Extensive Policy Management

Enabling flexible policy management to meet challenging serviceEnabling flexible policy management to meet challenging service level level agreements and business requirementsagreements and business requirements

TSM Progressive Incremental Backup Progressive Incremental Backup

•Only new or changed files are backed up•No redundant or wasteful full backups•Data tracked at file level•Accurately restores files to a point in time

Day 13

Day 12

Day 11

Day 10

Day 9

Day 8

Day 7

Day 6

Day 5

Day 4

Day 3

Day 2

Day 1

Full + Incremental versus Progressive Incremental

200 GB

18 GB

22 GB

25 GB

15 GB

20 GB

200 GB25 GB

510 GBWeek one

20 GB

25 GB

20 GB

22 GB

18 GB

200 GB

320 GBWeek two

135 GBWeek two

2 WeekTOTAL830 GB

2 weekTOTAL445GB

200 GB

18 GB

22 GB

25 GB

15 GB

20 GB

20 GB25 GB

20 GB

25 GB

20 GB

22 GB

18 GB

15 GB

1 MonthTOTAL

1659 GB

310 GBWeek one

1 MonthTOTAL

740 GB

Benefits Requires less storage space, less

network bandwidth and less time Shorter backup windows Fast accurate restores

The unique TSM function from beginningThe unique TSM function from beginning

Benefits of Upgrading to the latest version of TSM

Improved Return on Investment Scalability increased by 800%

– Support up to 4 Billion data objects per TSM Server

Built-in Data Deduplication – no extra charge– Source and target deduplication– Combines with progressive incremental backup to reduce data

by 95% or more

Simplify Administration– Automated client software updates across all platforms– New reporting and monitoring across the family with custom

report creation

Improve service levels and availability– New client data/metadata replication for warm standby disaster

recovery – Faster backups and restores reduces downtime

Improved Performance and Reliability DB2 database ‘under the covers’

Eliminates most database administration

Unified Recovery Management Seamless integration with other parts of the family

– Advanced support for VMware, Windows, NAS– Integrated protection of remote offices, employee

workstations

Tivoli Storage Manager for z/OS Media Enable z/OS clients to take advantage of latest TSM

features while leveraging existing mainframe-attached storage resources

Benefits of Upgrading to the latest version of TSM

YesYesNoNoNoR em oves redundant data

for files from different c lient nodes ?

YesYesNoNoNoAvoids s toring identic al

files renam ed, c opied, or re loc ated on c lient node?

R edundant data from any files in

s torage pool


s torage pool

S ubfiles that do not c hange

betw een bac kups

F iles that do not c hange betw een

bac kups

R edundant data w ithin s am e file on

c lient nodeS c ope of data reduc tion

B ac kup, arc hive, AP I

B ac kup, arc hive, HS M, AP I

B ac kup (W indow s only)B ac kup

B ac kup, arc hive, HS M, AP ID ata s upported

YesNoYesYesYesC ons erves netw ork

bandw idth?

C lient and s erver elim inate

redundant data c hunks

S erver elim inates redundant data

c hunks

C lient only s ends c hanged s ubfiles

C lient only s ends c hanged files

C lient c om pres s es files

How data reduc tion is ac hieved

C lie nt-s id e d e d up lic atio n

S e rve r-s id e d e d up lic atio n

S ub f ile b ackup

Inc re m e ntal fo re ve r

C lie nt c o m p re ss io n

All o f these data reduction methods conserve s to rage poo l space

A vailab le prio r to V 5 A vailab le 6 .1 A vailab le 6 .2

YesYesNoNoNoR em oves redundant data

for files from different c lient nodes ?

YesYesNoNoNoAvoids s toring identic al

files renam ed, c opied, or re loc ated on c lient node?


s torage pool


s torage pool

S ubfiles that do not c hange

betw een bac kups

F iles that do not c hange betw een

bac kups

R edundant data w ithin s am e file on

c lient nodeS c ope of data reduc tion

B ac kup, arc hive, AP I

B ac kup, arc hive, HS M, AP I

B ac kup (W indow s only)B ac kup

B ac kup, arc hive, HS M, AP ID ata s upported

YesNoYesYesYesC ons erves netw ork

bandw idth?

C lient and s erver elim inate

redundant data c hunks

S erver elim inates redundant data

c hunks

C lient only s ends c hanged s ubfiles

C lient only s ends c hanged files

C lient c om pres s es files

How data reduc tion is ac hieved

C lie nt-s id e d e d up lic atio n

S e rve r-s id e d e d up lic atio n

S ub f ile b ackup

Inc re m e ntal fo re ve r

C lie nt c o m p re ss io n

All o f these data reduction methods conserve s to rage poo l space

A vailab le prio r to V 5 A vailab le 6 .1 A vailab le 6 .2

Comparison of TSM Data Reduction Methods

Deduplication in Tivoli Storage Manager

… … all at no additional charge!!all at no additional charge!!

Tivoli Storage Manager and TSM FastBack include target-side data deduplication– Improves recovery times and/or reduces capacity requirements– Uses data from any source including: API, backup, HSM, archive– Operates as a post-process; automatic space reclamation– Builds on automatic data compression & progressive-incremental– Applied to data replicated to an off-site TSM server for disaster recovery

Tivoli Storage Manager includes client-side data deduplication– Reduces network traffic by determining if a chunk has already been backed up

(maybe from a different client system)

TSM FastBack includes data deduplication across the WAN

– Reduces storage and bandwidthrequirements by consolidatingbackups from multiple offices toa central TSM server

Copy Storage Pool(non-deduplicated)

File 1A B C

D

E

File 1

File 2

File 3

File 4B EF

F

File 4

1. Client creates chunks

2. Client and server identify which chunks need to be sent

3. Client sends chunks and hashes to server so that it can represent object in database

4. Entire file is reconstructed during Backup Stgpool operation to non-deduplicated stg. pool

hashIndex

File 4

TSM 6.x client

Deduplication-Enabled Disk Storage Pool

TSM client data replication for FASTER Disaster Recovery

TSM server replicates all data and metadata for specified client data sets to another server, ensuring completeness and consistency of data/metadata

– Incremental client data transfer with deduplicationdeduplication to minimize bandwidth consumption– Many-to-1 transfer to target server

Remote TSM server could be hot standbyhot standby for primary server, for improved RTO Native TSM solution with no dependency on specific storage device

– Supports dissimilar hardware and configuration at primary and remote sites

Restore on a per-client basis per-client basis without re-hydrating deduplicated data

Automatic distribution and installation of client updatesFor AIX, Solaris, HP-UX, Linux, Mac OS X or WindowsFor AIX, Solaris, HP-UX, Linux, Mac OS X or Windows

Automatically push updates for TSM b/a client v5.5, v6.1, v6.2 or v6.3Reduce admin time for updates by 80%; improves accuracy

– 50 minutes vs. 250 minutes to update 50 client systems– Huge benefit for cloud and backup-as-a-service providers

Executed based on user-defined policies and schedules

Introducing Tivoli Storage Manager for Virtual Environments• Utilizes VMware’s vStorage APIs for Data Protection, including block-level incremental backups based on VMware’s

Change Block Tracking• Offloads the backup workload from virtual machines and production ESX hosts to vStorage backup servers• Provides flexible recovery options – file, volume or image – from a single-pass backup• Near-instant restore of Windows and Linux disk volumes

Data is made available immediately while it is copied in the background• Simplifies day-to-day administration with the centralized Tivoli Storage Manager console

TSM for VE is supported on TSM Server v5.5 and above• Automated discovery of new VMs; automatically applies backup policies

Introducing Tivoli Storage Manager for Virtual EnvironmentsFull Virtual Machine Recovery (any supported Guest OS)Full Virtual Machine Recovery (any supported Guest OS)

Introducing Tivoli Storage Manager for Virtual EnvironmentsNear-Instant File and Volume Recovery (Windows and Linux Guest OS)Near-Instant File and Volume Recovery (Windows and Linux Guest OS)

TSM FastBack is advanced data protection

Block-level, incremental-forever–Captures only new and changed blocks of data without requiring applications to be shut down–continuous or scheduled backup for Windows and Linux servers

Advanced policy engine–Tune backup frequency to the importance of the data–Backup as often as needed, on a per-application basis–True Continuous Data Protection (CDP) for the most critical applications–Frequent or scheduled snapshots for less-critical data

Selective replication–Provides disaster recovery and backup consolidation capabilities–WAN-efficient; sends only new & changed data; schedule for non-peak times

Target-side data deduplication–Runs as a post-process to eliminate duplicate data from across protected servers

TSM FastBack is easy to manage

Wizard-based installation Familiar Windows-style GUI

–Simple menu-based system for configuring backups–Simple drag-and-drop recovery

Full set of configurable reports–View Server and Client status, activity and utilization–Leverages Tivoli Common Reporting

Tight integration with Tivoli Storage Manager–Launch FastBack from TSM–Manage FastBack policies–View FastBack reports–Backup FastBack server for long-term retention

TSM FastBack helps you restore your data - FAST

FastBack Mount Recovers individual files and folders, from any point-in-time

Opens an Explorer-like view into the FastBack repository

Simple ‘drag-and-drop’ operation

Virtual Recovery Mounts an entire volume to be recovered

Select any previous point-in-time (Recovery Point)

New volume becomes available within seconds

Read-write requests serviced by FastBack

Data is restored in the background to target disk

TSM FastBack for Bare Machine Recovery

Restore the Windows and Linux OS volume in less than 1 hour–Recover on a similar server, to a completely different

server, or to a Virtual Machine Full access within minutes

–With TSM FastBack’s Virtual Restore technology, data volumes are made available as soon as the data recovery process starts

Great tool for cost-effective Business Continuity–“N-to-1” standby server ratio: one standby server can

provide cover for many production servers Can be used to quickly perform server migrations

FlashCopy Manager Solution Overview

Online, near instant snapshot backups with minimal performance impact

High performance, near instant restore capability

Integrated with IBM Storage Hardware

Simplified deployment

Online, near instant snapshot backups with minimal performance impact

High performance, near instant restore capability

Integrated with IBM Storage Hardware

Simplified deployment

*VSS Integration

FlashCopy Manager Key functionality – Snapshot (FlashCopy) Backup

Volume level Full Database or Storage Group backups

Exploit Storage Copy Services features–Block level Incremental FlashCopy–Space Efficient FlashCopy–Auto provisioning of targets

Enables Frequent Snapshot backups for near CDP operation

–Reduce the amount of data at risk from 24-hours to a few minutes

Policy Managed –Maintain a number of backup versions–Adaptive to changing requirements

FCM Considerations and dependencies

VMware support in FlashCopy Manager

Supports ESX / vSphere 4 and later Off-host (proxy based) hardware snapshot backups with VMFS datastore granularity

–Scheduled or ad-hoc execution–No need to deploy OS specific agents to each VM

Optional offloaded backup to TSM with VM granularity–Supporting block level incremental backups with VMware Changed Block Tracking

Restore of individual VMs to original or alternative VMFS datastore under original name or new one–a) from a Hardware snapshot of a VMFS datastore–b) from oflloaded TSM backup

Restore of individual files or virtual volumes –Mount of a backup to a guest VM for individual drive / files access

User interface–vCenter client integration (plug-in web GUI) –Command Line Interface (on proxy node)

Reporting and Monitoring–summary view with drill down for details–backup & restore stats–Managed capacity report

Policy based management of local snapshot backups

Unified Recovery Management

Two Pricing models for TSM

Processor core type and quantity is base for pricing

Licensing by functionality working on processor count

TSM licenced by PVU count for protected servers (including TSM)

TSM 6.3 includes a PVU counter tool for the TSM Clients

Processor Value Units - PVU’s

Capacity Based Licence – TSM Suite for Unified Recovery (SUR) Licence is a “back-end” model for the TSM Server

Based on the size of the Primary Storage Pool in TSM repository

Includes all backup, HSM and archive data in the Primary Pool

Does not include Copy Pools

TSM Server dedupe (disk only) reduces licence costs *

Calculated using predefined TSM Server scripts

Products in the TSM Suite for Unified Recovery bundle

Summary

Tivoli Storage Management

Helps customers address conflicting challenges: –Data growth and long term data retention–Management of increasingly complex and virtualized IT infrastructures–Escalating business service levels requirements–Constrained budgets

Offers industry-leading levels of:–Scalability–Functionality–Data reduction–Resiliency–Performance–Reliability

Provides simplified and unified recovery management in heterogeneous environments

–Hardware platforms–Operating Systems–Applications–Data centers, DR sites, remote offices, mobile workers, Clouds

MerciGrazie

GraciasObrigado

Danke

Japanese

Hebrew

Thank YouThank YouEnglish

French

Russian

German

Italian

Spanish

Brazilian Portuguese

Hindi

Tamil

Korean

Thai

Simplified Chinese

Arabic

Traditional Chinese

aitähaitäh

paldiespaldies

ačiūačiūLithuanian

Latvian

Estonian

BACKUP

actual trends in backup protection solution ibm tivoli storage management ondřej bláha tivoli...

Documents

storage tiers

overall storage software

tivoli storage manager

total storage software

data retention

end recovery management

idc slide

year overall storage