extending automatic storage management to manage all data oracle database 11g release 2

31
Oracle Confidential Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2 Ara Shakian Principal Product Manager

Upload: roger

Post on 19-Mar-2016

54 views

Category:

Documents


0 download

DESCRIPTION

Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2. Ara Shakian Principal Product Manager. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

Extending Automatic Storage Management to Manage ALL DataOracle Database 11g Release 2Ara ShakianPrincipal Product Manager

Page 2: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Page 3: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

Table of Contents

• Storage management challenges• ASM Overview• ASM in 11gR2 takes it the next level

• What is it• How does it work• How do I manage it• Benefits

• How do I get from here to ASM• ASM reference customers

Page 4: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

Challenges of Managing Data Explosion

• Lack of a single optimal solution for all data • Lack of automation to reduce complexity• Managing multiple software layers

• Complexity of managing performance• Eliminating hot spots

• Multi-vendor support logistics and finger pointing

• Reducing storage Total Cost of Ownership

Page 5: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

ASM Is Most Popular Storage Manager

• De-facto standard for RAC and grid deployments, >65%

• De-facto standard for VLDB deployments

• Large and growing adoption for single instance deployments, >20%

• Thousands of customers using ASM• One of the most popular features in

the database

Page 6: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

ASM is Storage Management Platform of Choice

An optimal storage management solution fordatabase and general purpose files

ASM DiskASM Disk

ASM DiskASM Disk

ASM Disk

ASM Disk Group• Simplifies and automates storage management• Integrated cluster and single node framework• Storage pooling with easy provisioning• Optimal performance by default• Best availability and scalability• Lowest TCO

• Consolidates and eliminates waste• No additional cost

• Manages ALL data 11.2

Lowers the cost of storage management

Page 7: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

Dynamic Rebalancing

Benefits:

• On-line capacity management

• Eliminates manual I/O tuning

• Maintain optimal performance

• Storage migration on line

Disk Group

ASM Disk ASM Disk

• Simple provisioning • Add, drop or resize

ASM Disk ASM Disk ASM DiskASM Disk ASM Disk

Page 8: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

Enables Storage Consolidation Clustered Pool of Storage

• Shared storage across several databases• RAC and Single Instance

• Benefits:• Simplified and Centralized

management • Higher storage utilization• Higher performance

Local Area Network

ERP Database

HR Database

CRM Database

RACASM

RDBMSASM

RDBMSASM

ASM Disk Group

ERP CRMFIN HR

FIN Database

Page 9: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

Striping, Mirroring and Performance

• Striping designed to meet • RDBMS I/O characteristics• General purpose files

• Flexible file-based mirroring• External, Normal and High

• Optimal performance• No tuning

Percentagerelative to Baseline

(TPS)

Non-ASM

ASM

Time

Page 10: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

Why You Should Care

• Reduced complexity thru automation• No I/O tuning, reshuffling data files

• Simplified solution stack• No finger pointing, 3rd party LVM/FS

• Increases utilization and database and application uptime

• No down-time for storage provisioning or migration• Managing storage pool vs. islands

• Single vendor cross-platform integrated solution• Bundled and tested as one solution• Same cross platform tools to install, configure and manage

• No additional cost!

Page 11: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

Taking It To The Next LevelWith

ASM in 11gR2

Page 12: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

Oracle Grid Infrastructure(ASM + Oracle Clusterware)

• ASM and Oracle Clusterware integrated and installed in a single ‘Grid Infrastructure’ home

• Integrated installation, configuration and upgrade

• Installed using Oracle Universal Installer (OUI)

• Not a part of database install

• Option to minimally configure ASM and ACFS

• Automate creation of Oracle DB Homes on ACFS

Page 13: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

ASM Configuration Assistant (ASMCA)• Manage ASM before db install

• Upgrade previous versions of ASM to the current version (11g R2)

• One tool to initialize & manage * Disk Groups * Dynamic Volumes * ACFS file systems

Page 14: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

3rd Party FSApplication

Extending ASM to Manage ALL Data

Automatic Storage Management (ASM)

ASM Instance Managing

Oracle DB Files

ASM Cluster & Single Node File System

(ACFS)

Database RAC

ACFS Snapshot

Dynamic Volume Manager

ACFS FSOracle

Bin

3rd PartyFS

DB DatafilesDB DatafilesDatabase files

OCR & Voting files

ASMDisk

Group

General Purpose FilesDatabase FilesDynamic Volumes

Page 15: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

What is ASM Dynamic Volume Manager

• A new cluster (and single host) volume management service

• Standard disk device interface to clients• Loadable kernel driver• Dynamic Volume is a volume file created

in an ASM disk group (new file type ‘asmvol’)• An OS device file is created automatically when

a dynamic volume is created

• Managed by SQL/ASMCMD and EM

ASM DG

/dev/asm/vol1-123

+DATA/vol1

OS

Page 16: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

• General purpose scalable file system• Journaling, extent based• Single node and cluster• POSIX, X/OPEN file system solution for UNIX/Linux• Windows file system solution for Windows platforms

• Accessible through NAS protocols (NFS, CIFS)• Leverages ASM technology for volume mgt• Integrated with Oracle Clusterware for cluster support• Multi OS platform (Linux and Windows at initial release)• Integrated with Oracle system mgt tools

• Oracle installation and configuration• Enterprise Manager and ASM Storage mgt tools• Native OS File System Management tools

What is ASM Cluster File System (ACFS)

Page 17: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

What are ACFS Snapshots• Dynamic, fast, space efficient, “point in time” read-only copies of ACFS file system files

• Captures ASM FS file block/extent updates• An enabler for:

• On-line, disk-based, file backup model using snapshots • Individual file recoveries

• Up to 64 snapshot images per ASM file system • Policy based snapshots:

Schedule snapshots on an interval basis: every 5 seconds, every 30 minutes, daily, …

• Create an ACFS snapshots • acfsutil snap create snap_name mountp

Page 18: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

Leveraging the Power of ASM

• Even distribution of data

• Dynamic provisioning

Dynamic volumes and ACFS FS may be resized leveraging ASM file resize features

% asmcmd volresize dga vol1 -s 50G

• Can also use Enterprise Manager for management and threshold alerts

+DATA/dga/vol1

3

Primary ASM File Extent

Mirrored ASM file Extents

ACFS File System: /usr1

Linux: /dev/asm/vol1 Win: \\.\asm_dgname_volname

ACFS file AACFS file B

MirroredMirrored

1

1

Page 19: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

Managing the Dymanic Volumes and ACFS File System

Is Simple And Flexible

1. Native Linux, UNIX, and Windows OS file system commands and extensions

2. acfsutil platform independent commands3. ASM Configuration Assistant (ASMCA)4. Enterprise Manager

Page 20: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

An Example: Creating an ACFS File System

$ mkfs -t acfs -b 4k /dev/asm/volume1-62 ; Create fs on ASM volume

$ su - root # mount -t acfs /dev/asm/volume1-62 /tmp/images# su – oracle_usr

$ acfsutil registry -a /dev/asm/volume1-62 /tmp/images

$ mount –t acfs –o all none none ; Mount everything in the registry

$ cd /tmp/images$ cp /home/my_images .

Page 21: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

ACFS Use Cases

• Oracle Home• Shared or node-local• Not Grid Infrastructure home

• External files• Application binaries• Not an OS boot FS

Page 22: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

Managing Oracle Database Files

ASM Core Enhancements

Page 23: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

• All files on ASM• Oracle Cluster Registry,

Voting Disk and SPFILE

• Tunable Performance• Intelligent Data Placement

(IDP)

• Improved Management• Full Featured ASMCMD

• ASM File Access Control

• ASM Disk Group Rename

• Datafile to Disk Mapping

• Installation & Configuration mgt• ASM Install & Configuration

Assistant (ASMCA)

ASM 11g Release 2 New Features for

Database Files

Page 24: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

OCR and Voting Disk on ASM

• OCR is a regular ASM file • A new ASM file type

• Voting Disk• Stored in selected ASM disks• ‘crsctl’ used to specify a disk group for Voting disks• ASM auto creates1/3/5 Voting Disks based on

Ext/Normal/High redundancy on Failure Groups• Quorum failure group

• ASM determines redundancy for OCR and Voting Disk based on disk group redundancy level

• ASM SPFILE is also supported on ASM now

Page 25: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

Intelligent Data Placement (IDP)

• Placement of files on high performance regions of disk• 50% performance difference from outer to inner

tracks• Classify or mark an ASM file to be HOT/COLD

• Alter diskgroup dgname modify file ‘xxx’ attributes HOT/COLD or based on a templates at creation time

• Rebalance to migrate the ‘file’ to HOT/COLD IDP region

• IDP regions are dynamic• New V$ASMFILE recording IO stats• The IDP feature better leveraged when ASM

disks are whole disks

Disk Platter

Hot Files

Cold Files

Page 26: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

Complete ASMCMD FunctionalityA complete API for the system admin

• Extending ASMCMD to manage:• ASM instance (startup/shutdown, init.ora, .)• Disk group, disk and failure group (create, mount,

add, drop, …)• Attribute (list, set)• User/Group (add user, change password, …)• Template (list, add, alter drop)• Iostat and df• lsof: list files that are open by ASM

lsod: list disks that are open by ASM• Dynamic Volume

Page 27: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

Other Features

• ASM File Access Control (ACL)• Introducing 3 classes of permissions: • owner, group, and other

• ASM Disk Group Rename• Oracle File Mapping support (OFM)

• View mapping of datafiles to physical devices

• 4k sector size disk I/O support• Possible values are: 512b or 4096b (4k)

Page 28: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

In Summary…

Page 29: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

One Integrated Solution for ALL Data

Always On-LineOptimal UtilizationScalable

High PerformanceLow CostSimple

Cross PlatformLinux, Windows, Solaris,

HP-UX, AIX

Structured Data

Un-structured Data

One Vendor for Support

One Management Interface

One Clusterware Framework

One Install and Configure

ASM Database files

ASM Cluster FS&

Dynamic Volumes

Oracle ClusterwareOracle Database&

RAC

ACFS Snapshot

Page 30: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential

Some ASM Reference Customers In Production

Page 31: Extending Automatic Storage Management to Manage ALL Data Oracle Database 11g Release 2

Oracle Confidential