margaret hamburger solaris product manager – storage … · margaret hamburger solaris product...

48
Margaret Hamburger Solaris Product Manager – Storage Software Sun StorageTek Storage Archive Manager Sun StorageTek QFS 4.6 Features Announced April 3rd, 2007

Upload: truongdung

Post on 04-Jun-2018

222 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Margaret HamburgerSolaris Product Manager – Storage Software

Sun StorageTek Storage Archive ManagerSun StorageTek QFS4.6 Features Announced April 3rd, 2007

Page 2: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 2

Data Management Challenges

The value of data is becoming

more criticalData management

costs are highThe amount of storage is ever-

increasing

Page 3: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 3

AutomatedData Migration with SAM

Page 4: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 4

Sun StorageTek SAMIntelligent Storage Archive Management

Data Classification &Policy Management

> Policy manage-ment based on file attributes of the local file system

> Easy manage-ment GUI

> Transparent user access to all data regardless of physical location

Automatic Data Recovery & Protection

> Create up to 4 copies of a file

> Remote archiving for disaster recovery

> User level file recovery

> Manage data across storage tiers to local and remote disk and tape storage

> Tight Integration with QFS Shared file systems or as

> Local Archiving FS

Tiered StorageManagement &

Movement

Page 5: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 5

SAM BenefitsCost-effective data lifecycle management across storage tiers•Manage more with less

> Manage data across tiers of storage based on business value of data and cost to store over time

> Reduce administration costs with automated migration services

•Reduce costs> Less disk storage is required to manage and

purchase> Large volumes of data can be managed by fewer

administrators•Business Compliance

> Manage, retain and recover data to meet business compliance governing business data overtime

Page 6: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 6

SAM Enables Storage Tiering

Server w/ File System

Supports both local and remote disk and tape archiving

Server w/ File System(s)

BlockStorage

SL500(Tape Library)

BlockStorage

BlockStorage

BlockStorage

Page 7: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 7

SolarisFile Sharing with QFS

Page 8: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 8

Sun StorageTek QFSSAN File Sharing Innovation

Data Consolidation

> SAN file sharing> Name services

and spacemanagement on the metadata server

> Direct access to the data devices

Parallel Processing

> Multi-node read/write access

> 128 nodes supported

> 256 nodes with IB support

> Tune file system to the application

> Predictable performance

> File system performance scales linearly with the hardware

Performance &Scalability

Page 9: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 9

QFS – SAN File Systems

LANNetwork SAN

Meta Data Server

BlockStorage

BlockStorage

Meta Data Server handles name services and space management

Data is accesseddirectly from devices

Client Client Client Client n ...

Meta data pathData path

BlockStorage

BlockStorage

BlockStorage

Page 10: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 10

San File Systems with Tiering – Sam QFS

LANNetwork SAN

Meta Data Server

BlockStorage

BlockStorage

BlockStorage

BlockStorage

BlockStorage

BlockStorage

Meta Data Server handles name services and space management

Data is accesseddirectly from devices

Client Client Client Client n ...

Meta data pathData path

SL500(Tape Library)

Page 11: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 11

QFS Benefits

• Share data on the same devices in a SAN

• Ideal for streaming I/O applications> Stripe groups allow speed to match

bandwidth> Data rate is channel speed for multiple

streams> Large allocations reduce or eliminate

fragmentation without the need to defrag

> Metadata separation for performance• Supports 100s of shared clients in

shared SAN configuration

Page 12: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

File System PositioningMargaret [email protected]

Page 13: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

File Systems - UseZFS Free• Local data• Large storage requirements• Keep it simple• Cheap JBOD use with s/w RAID• Solaris 10 U2 & above

Shared QFS (SQFS) $• High perf./shared data access• Large storage requirements• Typically requires tuning• Integrated tiering & protection (SAM)• RAC/cluster support

UFS Free• Tried and true• Boot/root file system• Local data• Small storage requirements• Solaris 8, 9, 10

Page 14: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

File System Use Cases

If you want... Then select...

ZFS

SQFS or NFS

SAM-QFS

SAM-QFSOracle RAC with Sun Cluster SQFS

A single server running applications that will require large, dynamic files system(s)Multiple servers to share a file systemTo tier data across multiple disparate arrays

To tier data across multiple disparate arrays and tape libraries

Page 15: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

File System Use Cases If you want... Then select... Why? Root file system UFS Support Low cost, local file system UFS (S8, 9) or ZFS (S10) Both low cost

ZFS

SQFS Oracle RAC with Sun Cluster SQFS Support Storage tiering support SAM-QFS Tiering Storage tiering with tape SAM-QFS Tape

Above with scale and availability/data integrity

Scale and data protection

Heterogeneous, shared SAN access to data

Heterogeneous, shared

Page 16: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Margaret [email protected]

4.6 Feature Slides

Page 17: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 17

4.6 Features • Solaris 9 (Sparc) & SOLARIS 10 (Sparc/x64/X86)• Linux Support – SLES10• Archive Copy Retention• Data Integrity Verification Test• Simplified FS setup with Advanced option tab (GUI)• Resource Mgt Info (GUI)• Sun Cluster Configurations - Shared QFS clients outside cluster• 5800 (Honeycomb) Integration – Disk Archiving Target• High Availability – HA SAM• Directory Lookup Performance Enhancements• WORM options - Snaplock Compatibility for ECMs; WORM Lite

Page 18: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 18

More ManageabilityWizard Installation and Initial File System Setup

● Default configuration enables a first-time or a novice user to create an archiving file system with a simple wizard.

● “Advanced Options” button - Shared configurations

Tree Navigation ● Replaces the current tab-based navigation.

Page 19: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 19

●Default configuration - combined metadata and data devices.●Default values for dau size and stripe●Users can change the values by clicking on the Show Advanced Options button ( next two slides)

New File System Wizard – Simple Mode

Page 20: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 20

New File System Wizard – Advanced Mode Options for combined metadata and data

Page 21: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 21

New File System Wizard – Advanced ModeOptions for separate Metadata and data

Page 22: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 22

This step provides for the configuration of the default archive set for the file system that is being created.

Users can elect to use vsn pools or can assign all media of aspecific type to the archive set.

All settings can later be modified under theArchive Management tab.

New File System Wizard – Archiver Configuration

Page 23: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 23

New File Browser ● Display and manipulate the placement of file data.

● The NEW file browser enables bi-directional data transfer from a single-point, i.e., archive, stage, release and restore a file.

● Browse the file system and directories;enables users to view if a file is on-line or offline; the number of copies; the storage tier that each copy resides on; and stage or archive any file with a simple point-n-click

● The samfs dump and restore capability is integrated into the NEW file brower. Enables you to schedule, browse and restore samfsdumps from the file browser

Page 24: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 24

● Click on Recovery Point and select a date

● User will see the current directory as it existed when the recovery point was generated

● stage, release, archive and restore are available in the operations dropdown.

● Users can move files and directories between tiers and restore files from samfsdumps.

● In this screen:− All files are offline except

for fsmgr_uninstall and the directory CVS.

− Each file has 4 copies. 1 & 3 are to the tape tier and 2 & 4 are to disk archive tier

− Copy number 2 of fsmgr_setup and string_replace are damaged.

File Browser

Page 25: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 25

● Launched from the file browser

● File detail includes: ● file owner, group, size

permissions, times and status● Copy media type, VSN, time

and status● releaser, stager and archiver

attributes● Users can change releaser, stager and archiver attributes

File Details Window

Page 26: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 26

Simplified File Restore Operation• Launched from the file

browser to restore the selected file or directory from the recovery point that is being browsed

Page 27: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 27

New Monitoring Tool Resource Management Info GUI● Encapsulates these file system and archiving tools: samu, robottool,

devicetool, previewtool, libmgr for easier management and monitoring.

● Monitor application daemons, file systems, tape libraries, drives, VSN, and queues, e.,g, archiving, staging and tape mount queues.

● Ppreset a refresh rate of the auto-refresh display for a hands-free operation.

Page 28: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 28

Monitoring Console: Archive Queue

Lets users monitor outstanding archive copy operations. Archive Copy Queue is flagged in the right hand panel because the operations have been pending formore than 30 minutes. The VSN Pending Load Request and Staging Queueswould also be flagged if there were long standing requests.

Page 29: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 29

Monitoring Console: File Systems

The File Systems entry in the left hand panel would be flagged if anyarchiving file systems are above their high water mark, any non-archivingfile systems have a usage higher than 80% or any file systems are notmounted.

Page 30: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 30

Monitoring Console: Unusable VSNs

Shows volumes that are not usable for archiving

Page 31: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 31

More Monitoring options• Daemons page - lists running daemons, their start time and last log

entry. The page will be flagged if daemons are not running that should be.

• Archiver Media Utilization - lists the archive media utilization by archive set. The page will be flagged if any sets have less than 20% space remaining.

• Library and Drives pages show the state and status of libraries and drives. The pages will be flagged if information is not available or if the state or status of the resource indicates it is unusable.

• If the archiver, stager or load queues have more than 100 entries or if any entry has been waiting for more than 30 minutes the pages will be flagged.

Page 32: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 32

Generating Media Metrics

Once generated- metricsare retained until they are removed by the user

Page 33: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 33

Media Metrics View

AllFiles.1

Page 34: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 34

File System Metrics: Storage Tiers

View of the initial growth of the data in 3 tiers(Disk Cache, Disk Archive and Tape Archive) for the file system.

Page 35: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 35

More AvailabilityNEW - HA SAM Cluster Agent• Interface between a SAM-QFS file system and SunCluster software

running on Solaris for SPARC and x64 hardware. • Manages archiving and staging on QFS file systems during failover. • Both voluntary and involuntary failover are supported on active-passive

configurations. • For tape archiving and staging to continue after failover

> Tapes must be visible to all nodes in a cluster on which HA-SAM is running,

> Tapes should not be configured as Sun StorageTek SAM shared drives.

• Supports disk archiving with disk archives visible to all nodes in a cluster.

• Dependant on the QFS SunCluster agent and assumes that QFS file systems are mounted and managed by the QFS agent.

• Requires the SAM catalog and stager directories be linked from the standard location to a directory in a HAStoragePlus file system.

• HA-SAM should be a resource in a resource group that contains QFS d l

Page 36: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 36

More ScalabilitySupport for 128 node Shared QFS configurations

Page 37: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 37

More Linux SupportSupport for Redhat Enterprise Linux and SuSE.● The following Linux versions are supported in the 4.6 software release: ● Red Hat Enterprise 3.0 (UD-4 and UD-6) for x86/x64 platforms ● Red Hat Enterprise 4.0 (UD-2) for x64 platforms ● SuSE Enterprise Server 8 (service pack 4) for x64 platforms ● SuSE Enterprise Server 9 (service pack 2) for x64 and SGI Altix

platforms● SuSE Enterprise Server 10 for X64 platforms

Page 38: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 38

Archiving EnhancementsNEW Recycler Tool improves Archive Copy Retention • Works in conjunction with the File System Manager's backup and

recovery features. • Uses SAM dump files for archive retention • New Recycler Removes expired archive copies and frees up archive

volumes in order to aid in the ability to . > Scans file system metadata and SAM dump files to determine which

removable media and disk archive volumes contain archive images.> Determine which volumes do not contain archive images and the

space on these volumes can be reclaimed.

Page 39: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 39

Archiving EnhancementsNEW Data Integrity – Verification Test• Checks for data corruption on any data written to the file system then

moved to secondary media, then restored to primary storage for access. • The data verification process performs a read-after-write verification

test, and records a confirmation of data validity in the metadata properties for that file.

• The current checksum method is employed to verify copies written to tape or disk archive.

• Bare bones implementation> No verification of data as it is written to file system> No automatic restoration of invalid copies> No verification that copies are written to different tapes on different drives> No ability to run data verification in batch mode

Page 40: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 40

Data Verification• Enhancements to File System and Stager

> File system sends verification request to stager as soon as an archive copy is made

> Stager reads copy back from archive medium, does not write to disk

> File not released until all copies created and verified> Resource consideration – additional tape drives needed

Page 41: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 41

Data Verification • Set on file or directory with ssum -e

> When set on directory, all files and subdirectories will inherit data verification

> Example: ssum -e /samfs1/file1> Causes -g and -u options to also be set (checksum

generated when copy made, checksum used whenever copy staged)

Page 42: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 42

Archiving EnhancementsNEW Directory Lookup Performance improved

• Improve directory lookup performance• create, link, and rename system calls are up to 100

times faster than our previous release.

Page 43: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 43

File System EnhancementsSnapLock Emulation• The NetApp SnapLock software allows an application to set a retention

date and create WORM files. A new mode of operation has been added to the Sun StorageTek

• QFS WORM software in order to emulate SnapLock behavior. The WORM software has been modified to emulate a SnapLock system.

WORM Lite option • Eases restrictions on WORM-enabled volumes and retained files.• WORM Lite behaves in the same way as WORM with the following

exceptions:> Files can be removed before the retention time has expired.> The retention time can be shortened.> WORM Lite-enabled volumes can be deleted.

Page 44: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 44

More supported StorageDisk Archiving to a Sun StorageTek 5800 System (Honeycomb) supported

Page 45: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 45

More Supported Sun Cluster Configurations

Shared QFS configurations with support for nodes outside the cluster

Page 46: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Margaret [email protected]

SAM/QFS Futures

Page 47: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Sun Proprietary/Confidential Page 47

SAM-QFS Futures• On-line grow, shrink, and fsck• Rolling upgrades• Extended Attributes• Metadata journaling• Directory lookup phase 2• Enterprise Media Management• Open source QFS and SAM• Stager write performance

Page 48: Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product Manager – Storage Software ... Archive Management tab. New File System Wizard

Margaret [email protected]

THANK YOU

PLEASE SEND FEEDBACK TO