tivoli storage manager on vmware - ibm · pdf filetivoli storage manager on vmware ......

San Jose, California

Tom Hepner

[email protected]

Advanced Technical Support

Tivoli Storage Manager On VMware

Mar 2007

®

© IBM Corporation 2005

IBM TotalStorage ®

© 2005 IBM Corporation

®

Agenda

VMware virtualization servers

TSM installation and configuration

Backup methods

Scheduled backups

Restore issues

FAQs

References

IBM TotalStorage ®


®

VMware Virtualization Servers

VMware servers create a virtual infrastructure for x86-based servers.

These servers are used for server consolidation, disaster recovery and streamlining software development processes.

All x86-based platforms are supported by VMware ESX and GSX server software.

IBM TotalStorage ®


®

VMware Support for TSM

TSM backup-archive & data protection component clients

TSM client support is virtually the same as thatprovided for systems on native machines.

VMware unique problems should be reported to VMware.

IBM TotalStorage ®


®

VMware Support for TSM

Support is for VMware ESX and GSX versions.

The TSM server, storage agent (LAN-free clients) or client backup sets are NOT supported on VMware at this time

Virtual machines on VMware must connect via TCP/IP to a TSM server that is not running on VMware

IBM TotalStorage ®


®

Hardware - Host - Guest Virtual Machines

•Guest VM 1 -Linux Suse

•Guest VM 2 -Linux Redhat

•Guest VM 4 -Windows 2000

•Guest VM 3 -Windows 2003

•Host – Linux

•Hardware – x86

IBM TotalStorage ®


®

TSM & VMware Software Requirements

A TSM Linux x86 client at V5.5.5 or newer

A TSM server at the V5.1.X or newer

VMware 2.0 or newer

IBM TotalStorage ®


®

TSM Installation and Configuration

TSM client download site & files• ftp.software.ibm.com/storage/tivoli-storage-

management/maintenance/client/v5r2/Linux/Linux86/v522/(see README for download instructions)

• TIVsm-BA-i386.Rpm

• TIVsm-API-i386.Rpm

IBM TotalStorage ®


®

TSM Installation and ConfigurationThe TSM client acceptor daemon can be used,Optionally, to remotely access the TSM client toManage VMFS volumes.

The TSM web client is made available by startingThe TSM client acceptor daemon (dsmcad) on theVMware servers.

With a properly defined virtualmountpoint option,The /vmfs directory will be displayed within the localFolder in the file tree for backup and archive.

IBM TotalStorage ®


®

Backup Methods

File-level incremental

Full guest VM backup• Inactive virtual machine• Based on a copy of the .dsk files• Suspended virtual machine• Active virtual machine

Consolidated Backup Integration Modules

IBM TotalStorage ®


®

Backup MethodsFile-level Incremental

To achieve a complete TSM file-levelBackup/restore environment, install andConfigure a TSM client onto each guestOs.

These file-level backups are independent ofThe complete guest VM backup described inThe following pages.

IBM TotalStorage ®


®

Backup MethodsBackup of an Inactive Virtual Machine

Backup .dsk files when VM is shutdownUse a selective backup for .dsk files>dsmc sel /vmfs/vmhba2:0:0:6/win2000.dsk>dsmc sel /vmfs/vmhba2:0:0:6/win2000_2.dskor>dsmc sel /vmfs/vmhba2:0:0:6/win2000.dsk \ /vmfs/ vmhba2:0:0:6/win2000_2.dsk

IBM TotalStorage ®


®

Backup MethodsBackup of an Inactive Virtual Machine

Advantage• Ensures backup consistency

Disadvantage• Requires maximum down time of the VM

IBM TotalStorage ®


®

Backup MethodsBackup Based on a Copy of the .dsk

File

Shutdown the VM to be backed up.Create a copy of all .dsk files used by the VM using the "dd" command.Restart the virtual machine. Use the TSM client to backup copiesDelete the .dsk file copies

IBM TotalStorage ®


®

Backup MethodsBackup Based on a Copy of the .dsk

FileAdvantage

• Reduces VM shutdown window

• Ensures backup consistencyDisadvantage

• Requires additional temporary disk space

• Requires additional processing either manually or by scripting

IBM TotalStorage ®


®

Backup MethodsVM Downtime Comparison

21 minutes9 minutesTotal down time

3 minutes3 minutesVM Restart

16 minutesN/A Backup

N/A 4 minutesCopy of .dsk file

2 minutes 2 minutes VM Shutdown

Non-copy Copy basedActivity

IBM TotalStorage ®


®

Backup MethodsBackup of a Suspended Virtual

MachineSuspend the VM

• Click suspend button on console

• Use command vmware-cmd

• Use calls available in the VMware Perl APIBackup .dsk files associated with the VMResume the VM

IBM TotalStorage ®


®

Backup MethodsBackup of a Suspended Virtual

MachineAdvantages

• Reduced VM downtimeDisadvantages

• Backups of .dsk files may have inconsistencies

Note: we recommend doing test restores to validate your procedure

IBM TotalStorage ®


®

Backup MethodsBackup of an Active Virtual Machine

Freeze VM (use preschedulecmd)vmware-cmd /root/vmware/w2k3/w2k3.vmx addredo scsi0:0Backup .dsk filesUnfreeze / commit redo log


IBM TotalStorage ®


®

Backup MethodsBackup of an Active Virtual Machine

Advantages• Reduced VM downtime

Disadvantages• Backups of .dsk files may have inconsistencies • Backup/restore procedure more complicated


IBM TotalStorage ®


®

Scheduled Backups

Prior to backup, the VM’s state must beverified and match what is expected

Creating a separate schedule for each VM may simplify the procedure

Use consistent naming convention for the .dsk files to take advantage of wild carding

Multiple objects can be included in a single backup specification

Use command scripts to run multiple dsmc commands

IBM TotalStorage ®


®

Scheduled Backups

Ensure that .dsk files are not in useVmware-cmd utility or the VMware API functions can suspend, shutdown, or place into redo mode a virtual machineNative commands, i.E. cron, can be used to issue preparatory commands.Use pre/postschedulecmd features of the TSM scheduler to resume VM activity

IBM TotalStorage ®


®

Restore

The .dsk files can be restored by command line or from the WEB client

Use the virtualmountpoint option to create TSM filespace for the /vmfs directory

Shutdown the virtual machine if it is running

IBM TotalStorage ®


®

Restore

Restore the corresponding .dsk files to the original location with the replace option. dsmc restore /vmfs/vmhba2:0:0:6/”win2000*.dsk” –rep=yes

Or you can choose to restore a backup taken at an earlier time by using the -pick option: dsmc restore /vmfs/vmhba2:0:0:6/”win2000*.dsk” –rep=yes –inactive -pick

Restart the vm

IBM TotalStorage ®


®

Restore

Rebuilding a virtual machine definition and restoring data • Restore the .dsk file to desired VMFS location

• Using the VMware management interface, add a new virtual machine with the correct operating system type

• When prompted, choose the option to use an existing disk, and point to the .dsk file which was just restored.

IBM TotalStorage ®


®

Restore

Building a VM definition on another machine• Define a virtualnodename option to temporarily access remote

.dsk files

• Use procedure on previous page

IBM TotalStorage ®


®

Restore

Restoring a backup taken of a suspended or active virtual machine

the procedure for restoring a backup taken of a suspended or active VM is identical to those described in previous sections.

IBM TotalStorage ®


®

Failure on the first backupIn the event that the virtual machine is still up and running whenyou attempt to backup, the corresponding .dsk file using the TSM client, you will get an “internal system error”.

Reason: the .dsk files are in use and cannot be opened by TSM.

Message:

IBM TotalStorage ®


®

TSM Client Error

Error :

09/06/2006 12:22:39 ANS1492S Invalid virtual mountpoint /vmfs/volumes/vmw-1: File not found.




09/08/2006 18:23:03 Error opening input file/opt/tivoli/tsm/client/ba/bin/de_DE/dscjres.txt

09/08/2006 18:31:06 TransErrno: Unexpected error from open, errno = 1609/08/2006 18:31:11 Internal system error. Please check the TSM Error Log for any additional information.09/08/2006 18:32:39 TransErrno: Unexpected error from open, errno = 1609/08/2006 18:32:45 Internal system error

VMware Consolidated Backup

IBM TotalStorage ®


®

Agenda

• Overall Vision of the Future• Pre-ESX 3.0 State of the Art with VMware

Backups

• Problems with the current State

• Solution: Consolidated Backup

• Integrations

IBM TotalStorage ®


®

VMware’s Long-Term Vision

• VMware Virtual Infrastructure should be superior to physical infrastructure

• More “Available”• Better Resource Utilization• Easier to protect

VMware Consolidated Backup is one step towards that goal

IBM TotalStorage ®


®

Agenda

• Overall Vision of the Future

• Pre-ESX 3.0 State of-the-Art with VMware Backups



• Integrations

IBM TotalStorage ®


®

Pre-3.0: Standard Backup Techniques

Backup Server

VM1ESX

VM2

VM3

AGENT

Ser

vice

Con

sole

AGENT

AGENT

AGENT

Filesystem Level

Backups

Whole-VMBackups

Storage(Tape, Disk)

LAN, SAN, SCSILAN ONLY

Advantages:• Just like physical

host

• PLUS Whole-VM backup

• Easy to implement—and your capabilities have increased.

IBM TotalStorage ®


®

Agenda


• Pre-ESX 3.0 State of the Art with VMware Backups

• Problems with the current State• Solution: Consolidated Backup

• Integrations

IBM TotalStorage ®


®

Problems with the Current State of the Art

Agent-Based• Backup load is cumulative

5% CPU load is OK…Until you have 20 virtual machines backing up at once

• Backup load is very difficult to virtualize.Intense Disk I/O coupled with intense Network I/O

• Backing up Disk images over the Service Console can be slow.

IBM TotalStorage ®


®

Agenda


• State of-the-Art with VMware Backups


• Solution: Consolidated BackupWhat does it do?What is it missing?

• Integrations

IBM TotalStorage ®


®

Solution: Consolidated Backup

VCB Goals• Leverage VMware’s unique technology

to improve filesystem backup

• Offload backup cycles from ESX Server

• Work without SAN-specific software

• Easy implementation for end users

• Begin reducing the overall complexity of backup infrastructure

IBM TotalStorage ®


®

VCB: The EffectESX

VM

2V

M3

VM

1

VMFS

VMDK

Ser

vice

Con

sole

SAN

VMDK

What’s The

EffectBackupProxy

VMDK

TSMCLIENT

vmkernel

LAN SCSISAN

IBM TotalStorage ®


®

VM

2V

M3

VM

1

Ser

vice

Con

sole

vmkernel

BackupProxy

VCB

VCB: How it WorksESX

VMFS

VMDK

SAN

VMDK

What’s Happening

VMDKVMDK

REDO

SYNC

BLOCKLIST

PRE

POST

SAN

TSMCLIENTTSM IM

IBM TotalStorage ®


®

VM

2V

M3

VM

1

Ser

vice

Con

sole

vmkernel

BackupProxy

VCB

VCB: How it WorksESX

VMFS

VMDK

SAN

VMDK

Full-VM Export

VMDKVMDK

REDO

SYNC

BLOCKLIST

2GB2GB

2GB

PRE

POST

SAN

TSMC

LIENT

UserScript

IBM TotalStorage ®


®

What about Restore?

• No Proxy-Based Restore Yet.

• Options:Put an agent in each VM, restore files to that target.Have “restore target” VMs with agents. Restore to those VMs, then manually move files.To restore whole VMs, restore to a filesystem accessible by the Service Console and import files to VMFS.

IBM TotalStorage ®


®

What about Restore? (cont.)

• Why release this without restore?Backups happen every single night, Restores are infrequent. We wanted to make an improvement over the situation today.

IBM TotalStorage ®


®

Important Points to Remember

• This is not a replacement for backup software.

Backup products are the primary consumers of the new VCB APIsVCB integrates into existing infrastructure

• No Linux SupportIn version 1.0, file-based backup is only for Windows guests

IBM TotalStorage ®


®

Agenda


• Pre-ESX 3.0 State of the Art with VMware Backups



• Integrations

IBM TotalStorage ®


®

VCB: Integrations

VMware hasproduced an integrations to:Tivoli Storage Manager Veritas NetBackupSymantec BackupExecLegato Networker.

These are basic integration only—commandline, pre-and-post job scripts

Questions?

Backup Slides

IBM TotalStorage ®


®

BackupProxy

VLUN

VCB: How it Really WorksESX

VM

2V

M3

VM

1

VMFS

VMDK

Ser

vice

Con

sole

SAN

VMDK

What’s REALLY

Happening

VMDK

REDO

VMDK

JSLIB

RA

RY

VirtualCenter

vmkernelVM DNS

NAME

VMSNAP

SYNC

BACKUPINFO

BACKUPINFO

BLOCKLIST

SNAP IDPRE

POST

SAN

IBM TotalStorage ®


®

Reference Information

TSM Linux x86 V5.3 clienthttp://publib.boulder.ibm.com/infocenter/tivihelp/index.jsp?toc=/com.ibm.itstorage.doc/toc.xml

VMware ESX Server Documentationhttp://www.vmware.com/support/pubs/esx_pubs.html

VMware Perl API documentation:http://www.vmware.com/pdf/Scripting_API_21.pdf

VMware Professional Services: http://www.vmware.com/services/

IBM TotalStorage ®


®

Reference InformationUsers guide for the TSM Linux x86 and other TSM clients: http://publib.boulder.ibm.com/tividd/td/IBMTivoliStoragemanagerclient5.2.2.Html VMware servers 2.1 administration guide http://www.vmware.com/pdf/esx/esx21admin.pdfVMware Perl API documentation http://www.vmware.Com/pdf/scripting_API_21.pdf VMware professional serviceshttp://www.vmware.com/services/Using IBM Tivoli storage manager for backup and restore on the VMware ESX console http://www.vmware.com/pdf/esx3_backup_wp.pdfHttp://w3-03.ibm.Com/support/americas/storage/tsm.Html

http://www.vmware.com/download/vi/drivers_tools.html

tivoli storage manager on vmware - ibm · pdf filetivoli storage manager on vmware ......

Documents