keys to optimizing your backup environment: tivoli storage ... · pdf...

Hosted by

Keys to Optimizing Your Backup Environment: Tivoli Storage Manager

John MerrymanGlassHouse Technologies, Inc.

Hosted by

Introduction

Audience Profile

Storage Management Interdependence

Backup Pain Points

TSM Architecture

• Server

• Storage

• Network

• Clients

Hosted by

Audience Response

Audience Profile

Your TSM Backup/Archive Environment

Number of Years using TSM

Number of TSM Administrators

Hosted by

Hosted by

Storage Management Interdependence

Storage and Production Backup

• Growing at 65% CAGR (Gartner)

• Consuming 48% of IT hardware budgets (Gartner)

Disaster Recovery

• Enabling Recovery – RPO/RTO impact

Archiving

• Compliance

• Storage efficiency

• Disposal of data

• Application Performance

“It’s no longer just backup, it’s data management.”

Hosted by

TSM Pain PointsBusiness Problems

Backup reliability

Overwhelming data growth

Database and email data explosion

Limited budgets and staff

Regulatory / data retention requirements

Lack of data management policies

Poor operational practices

Technology ProblemsTSM architecture scalability

Lack of TSM / OS tuning

Network architecture

Client-side issues (OS, antivirus, network)

Increasingly complex requirements

Shrinking backup windows

Disconnect between application design and storage management

SolutionOptimize and right-size existing infrastructure

Improve processes and procedures

Formalize TSM program management

BenefitsLower TCO for TSM environment

Proactive management model

Lowered risks and exposures

Scalable and manageable environment

Hosted by

Business Problems

Backup reliability

Overwhelming data growth

Database and email data explosion

Limited budgets and staff

Regulatory / data retention requirements

Lack of data management policies

Poor operational practices

Hosted by

Technology Problems

• TSM architecture scalability

• Lack of TSM / OS tuning

• Network architecture

• Client-side issues (OS, antivirus, network)

• Increasingly complex requirements

• Shrinking backup windows

• Disconnect between application design and storage management

Hosted by

Solution

• Optimize and right-size existing infrastructure

• Improve processes and procedures

• Formalize TSM program management

Hosted by

Benefits

• Lower TCO for TSM environment

• Proactive management model

• Lowered risks and exposures

• Scalable and manageable environment

Hosted by

TSM Pain Points

TSM Client Administration7%

61%

7%

3%

3%

2%2%

3%2%

2%8%

TSM Certifications, De-Certifications, Re-CertificationsTSM Client Problem Resolution

TSM Client Upgrades / ChangeManagementTSM Client Process Improvement

Testing and Certifying New ClientTechnologiesPerforming Restores

TSM Server / Device ProblemResolutionTSM Server Administration

TSM Server Monitoring, Reporting,PlanningTesting and Certifying New ServerTechnologiesJoint Effort Problem Resolution forTSM Client Issues

Hosted by

TSM Architecture OverviewLAN

DatabaseRecovery Log

TSMServer

SAN

TSM Clients

Hosted by

TSMClients

SD

HEWLETTPACKARD

SD

4 5 6 7 8 9 10 11

10/ 100 BASE TX

1 2

3

5411 Enterprise Switch

POWERMGMT

4 5 6 7 8 9 1 0 11 11

22

33

33

3RR

10 00 BASE X

AMBER =GREEN =

FL ASHING GREEN =

AC TIVI TYLINK O KDISABLED

TSMServer

Tape/SAN/DiskTechnology

NetworkNetwork

SD

4 5 6 7 8 9 10 11

10/ 100 BASE TX

1 2

3


POWERMGMT

4 5 6 7 8 9 1 0 11 11

22

33

33

3RR

10 00 BASE X

AMBER =GREEN =

FL ASHING GREEN =


SD

HEWLETTPACKARDTape/SAN/Disk

TechnologyTSM

Clients

TSMServer

TSM Architecture

Hosted by

TSM Server PerformanceHardware

• CPU, Memory, HBAs

Server backplane/bus architecture

HBA location

Operating System Tuning

• VMTUNE for AIX has a significant impact

Must be tuned specifically for environment

• Asynchronous I/O (requires TSM settings too)

• Direct I/O (requires TSM settings too)

• Network options tuning

Hosted by

TSM Application Tuning

TSM Application Tuning

• Database Buffer Pool Sizing Server Options bufpoolsize parameter

(up to 50%)Selftunebufpoolsize parameter (up to 10%)Relates closely to page space sizing

• Mirrorwrite db parallel and DBpageshadow

• Txngroupmax, movebatchsize, movesizethresh

Hosted by

TSM Application Tuning, II

64-bit and 32-bit code levels (and OS levels)

TSM performance tuning guide

• http://publib.boulder.ibm.com/tividd/td/TSMM/SC32-9101-01/en_US/HTML/SC32-9101-01.htm

Maintain a link between operating system, application, and device performance analysis.

Hosted by

TSM Server Performance

Other Considerations

• Backup versioning policies have an effect.

• Schedule randomization versus static schedules

• Spread production workload across backup window.

• Control batch TSM processes to avoid overlap for resource intensive processes.

• Low-level policies can have a high-level impact.

shrstatic versus shrdynamic

Changing retries settings

Hosted by

TSM Server Operations

Hosted by

Ideal TSM Batch Processing

0:00

1:00

2:00

3:00

4:00

5:00

6:00

7:00

8:00

9:00

10:00

11:00

12:00

13:00

14:00

15:00

16:00

17:00

18:00

19:00

20:00

21:00

22:00

23:00

Backup STG Process 360Backup STG Process 399Backup STG Process 400Database Backup Process 472Migration Process 365Migration Process 473Migration Process 474Expire Inventory Process 479Space Reclamation Process 480Space Reclamation Process 481Space Reclamation Process 482Space Reclamation Process 483

10/12/2003

Hosted by

Poorly Optimized TSM Batch Processing

11:00

12:00

13:00

14:00

15:00

16:00

17:00

18:00

19:00

20:00

21:00

22:00

23:00

0:00

1:00

2:00

3:00

4:00

5:00

6:00

7:00

8:00

9:00

10:00

11:00

12:00

13:00

14:00

15:00

16:00

17:00

18:00

19:00

20:00

21:00

22:00

23:00

0:00

1:00

2:00

3:00

4:00

5:00

6:00

7:00

8:00

9:00

10:00

11:00

12:00

13:00

14:00

15:00

16:00

17:00

18:00

19:00

20:00

21:00

22:00

23:00

0:00

1:00

2:00

3:00

4:00

5:00

6:00

7:00

8:00

9:00

Backup STG Process 360Migration Process 365

Migration Process 366Migration Process 367Migration Process 368Migration Process 369

Migration Process 370Migration Process 371Migration Process 372


Backup STG Process 376Backup STG Process 377Backup STG Process 378

Backup STG Process 379Migration Process 380Migration Process 381








Backup STG Process 404Backup STG Process 405Migration Process 406



Migration Process 413Backup STG Process 414Backup STG Process 415

Backup STG Process 416Backup STG Process 417Migration Process 418










Database Backup Process 447Migration Process 448Migration Process 449Migration Process 450








Database Backup Process 472Migration Process 473Migration Process 474


Expire Inventory Process 479Space Reclamation Process 480Space Reclamation Process 481

Space Reclamation Process 482Space Reclamation Process 483Space Reclamation Process 484


Database Backup Process 488Space Reclamation Process 489Space Reclamation Process 490




Database Backup Process 500Migration Process 501Migration Process 502Migration Process 503


Space Reclamation Process 507Space Reclamation Process 508Database Backup Process 509

Space Reclamation Process 510Space Reclamation Process 511Database Backup Process 512



Database Backup Process 519Space Reclamation Process 520Migration Process 521


Migration Process 525Migration Process 526Database Backup Process 527

Backup STG Process 528Backup STG Process 529Backup STG Process 530Backup STG Process 531


Backup STG Process 535Migration Process 536Migration Process 537



Backup STG Process 544

10/11/2002 10/12/2003 10/13/2003 10/14/2003

Hosted by

SD

HEWLETTPACKARD

SD

4 5 6 7 8 9 10 11

10/ 100 BASE TX

1 2

3


POWERMGMT

4 5 6 7 8 9 1 0 11 11

22

33

33

3RR

10 00 BASE X

AMBER =GREEN =

FL ASHING GREEN =


TSMServer

Tape/SAN/Disk Technology

Network

TSMClients


SD

HEWLETTPACKARD

Network

TSMClients

TSMServer

SD

4 5 6 7 8 9 10 11

10/ 100 BASE TX

1 2

3


POWERMGMT

4 5 6 7 8 9 1 0 11 11

22

33

33

3RR

10 00 BASE X

AMBER =GREEN =

FL ASHING GREEN =


TSM Architecture

Hosted by

SAN Architecture

Disk Fabric Design

• Dedicated SAN/Disk resources for Database/Logs

• Dedicated SAN/Disk for storage pools

Tape Fabric Design

• Load Balancing and design is important

• Develop Ratios based on throughput and SAN fabric

1 GB Fabric w/ 3590-E1A Drives

• 1:3 Ratio HBA: Drive

2 GB Fabric w/ 3590-E1A Drives

• 1:6 Ratio HBA: Drive

Hosted by

Disk Architecture

Disk architecture

• Fast, redundant, flexible and scalable

File system design

• Create naming conventions and plan for scalability.

• Raw volumes versus file systems

• Create file system schema with disk layout in mind.

• Database/log performance (Random I/O)

• Storage volume performance (sequential)

Hosted by

Disk Architecture, II

Storage device architecture

• Design/layout is key for sequential versus random disk performance requirements

• TSM is often the most I/O intensive application in the datacenter.

• Disk performance tuning is often necessary.

Hosted by

Disk Storage Pools

Capacity Planning for disk storage pools

Plan for using Migration Delay for critical client data.

• A note on storage pool caching and database performance

Disk is traditionally used in TSM as a staging area for daily migration to tape.

This paradigm is evolving.

Hosted by

Disk as a Primary Storage Pool

Considerations

• Detailed Capacity planning methods for disk storage are required.

• TSM Backup Policies have to be carefully planned.

• Formatting and Recovering Terabytes of *.dsm files is incredibly time and resource intensive.

• Performance-oriented disk storage pool design becomes even more important.

• Copies to tape will still be required, and simultaneous R/W can be a big issue for S-ATA technologies.

Hosted by

Tape ArchitectureSize and Type of Library

• Robot speed, Compression, Scalability, etc.

Number and Type of Tape Drives

• R/W Speed, Caching, Mount/Seek Times, etc.

Media Formats

• Create a media migration strategy and plan.

Consider emerging tape technologies.

• Tape is not dead and is not dying.

• High-end tape I/O is faster than low-end disk I/O.

• The real issue is random vs. sequential access to data.

Hosted by

Tape Storage Pools

Stream large database objects data directly to tape.

• Lowers disk pool requirements

• Lowers TSM batch processing time

• Optimizes use of tape resources during backup window

• Schedule and resource planning is key.

• Resource Utilization and Maxnummp settings

Synchronous Copy Storage Pool Writes (“”)

• Can reduce batch window significantly

• Use only for large object backup clients.

Recovery optimized TSM tape storage pools

• Collocation=yes (+’s an –’s)

Hosted by

SD

HEWLETTPACKARD

SD

4 5 6 7 8 9 10 11

10/ 100 BASE TX

1 2

3


POWERMGMT

4 5 6 7 8 9 1 0 11 11

22

33

33

3RR

10 00 BASE X

AMBER =GREEN =

FL ASHING GREEN =


TSMServer


Network

TSMClients

SD

4 5 6 7 8 9 10 11

10/ 100 BASE TX

1 2

3


POWERMGMT

4 5 6 7 8 9 1 0 11 11

22

33

33

3RR

10 00 BASE X

AMBER =GREEN =

FL ASHING GREEN =


SD

HEWLETTPACKARD

TSMServer


TSMClients

TSM Architecture

Network

Hosted by

Network Overview

Network Architecture

• Private / Public network configurations

Type of Architecture

• 100 Mb and Gigabit IP architectures are the defacto standard.

Develop Network Architecture Standards.

• Map network standards to SLAs and to service delivery.

• Publish metrics on network throughput.

• Enforce Standards.

Advancing a network architecture can be cost prohibitive and time consuming…so can poor recovery times and data loss.

Hosted by

Network Design

Dedicated Private VLAN architectures

• Logical network segregation and physical network segregation

• Use jumbo frames and gigabit VLANs.

Improves streaming efficiencies to tape

9000 and 9004 MTU size differences

DNS Considerations

Multiple HBA’s for client network load balancing

• Etherchannel configurations

• Load balancing for network, switches, server HBAs

• Don’t use auto-negotiate network card settings.

Hosted by

SD

HEWLETTPACKARD

SD

4 5 6 7 8 9 10 11

10/ 100 BASE TX

1 2

3


POWERMGMT

4 5 6 7 8 9 1 0 11 11

22

33

33

3RR

10 00 BASE X

AMBER =GREEN =

FL ASHING GREEN =


TSMServer


Network

TSMClientsTSM

ClientsSD

4 5 6 7 8 9 10 11

10/ 100 BASE TX

1 2

3


POWERMGMT

4 5 6 7 8 9 1 0 11 11

22

33

33

3RR

10 00 BASE X

AMBER =GREEN =

FL ASHING GREEN =


TSMServer


Network

TSM Architecture SD

HEWLETTPACKARD

Hosted by

TSM Client PerformanceFact: Client machines are often sized for application workload, not backup workload.

Client Tuning Parameters

• Resource Utilization (2-10)

• Memoryefficientbackup

• Virtualmountpoint

Network / Transaction Tuning Parameters

• Tcpnodelay

• Tcpwindowsize

• Tcpbufsize

• Txnbytelimit

Hosted by

TSM Client Configuration

File System Design and Type

• File system size and number impacts memory consumption.

• TSM client can be memory intensive (300 MB Memory / Million Objects).

Include/Exclude list size has a direct impact on processing overhead.

• Leverage domain statements.

Hosted by

TSM Client Configuration, II

Journal-based backups

• Data drives only

• Journal size is limited to 2 GB

Image backups

LAN-free backups

Hosted by

TSM Client PerformanceBackup Object Success Rates

Chart 2

1

10

100

1,000

10,000

100,000

1,000,000

INAA

2068

INAA

2073

INDA

0001

INDA

0003

INDA

2000

INDA

2001

INDA

2010

INDA

2014

INEA

2000

INEA

2007

INEA

2008

INEA

2015

INEA

2021

INPA

2000

INPS

WB

01

INSA

2005

INSA

2006

Node Name

Ave

rage

Num

ber o

f Obj

ects

Average Objects InspectedAverage Objects Backed UpAverage Objects Failed

Hosted by

TSM Client Performance

Additional Considerations

• Data characteristics

Data type, volume, volatility

Number of files

• Client workloads and backup schedule

• Client Software Version

• Network load and utilization

• Communication with application architects and developers is increasingly important.

SD

HEWLETTPACKARD

Hosted by

TSM Client PerformanceClient Versions

Version 4 Re lease 1 Level 2.0, 45 Clients

Version 5 Release 1 Level 5.0, 27 Clients



(?), 14 Clien ts


Version 4 Release 1 Level 1 .0, 11 Clients






Version 4 Re lease 1 Level 0.0, 2 Clients




Hosted by

To receive a copy of the charts seen in this presentation and more for your environment go to:

www.glasshouse.com/backup

For a “cheat sheet” see the highlighter in your conference bag.

Hosted by

Thank you.

Questions?

Mr. Merryman will be available at the Ask-the-Experts booth in the Exhibit Hall:

Tuesday 4-5 PM

Hosted by

Information. Optimized.

GlassHouse Technologies, Inc.200 Crossing BoulevardFramingham, MA 01702www.glasshousetech.com [email protected]

keys to optimizing your backup environment: tivoli storage ... · pdf...

Documents