enterprise manager 12c snap clone, storage management and … · enterprise manager 12c snap clone,...
TRANSCRIPT
Enterprise Manager 12c Snap Clone,Storage Management and Provisioningwith Oracle ZFS Storage Appliance
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
April 3, 2015
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Safe Harbor StatementThe following is intended to outline our general product direction. It is intended forinformation purposes only, and may not be incorporated into any contract. It is not acommitment to deliver any material, code, or functionality, and should not be relied uponin making purchasing decisions. The development, release, and timing of any features orfunctionality described for Oracle’s products remains at the sole discretion of Oracle.
The following is intended to outline our general product direction. It is intended forinformation purposes only, and may not be incorporated into any contract. It is not acommitment to deliver any material, code, or functionality, and should not be relied uponin making purchasing decisions. The development, release, and timing of any features orfunctionality described for Oracle’s products remains at the sole discretion of Oracle.
2
Session Agenda
Snap Clone OverviewMartin Pena
ZFS Storage Appliance Advantages for Snap CloneDoug Chamberlain
Demo: Snap Clone + ZFS Storage ApplianceMartin Pena
Closing
Snap Clone OverviewMartin Pena
ZFS Storage Appliance Advantages for Snap CloneDoug Chamberlain
Demo: Snap Clone + ZFS Storage ApplianceMartin Pena
Closing
Database Cloning
• Cloning Requirements– Critical for delivering high-quality, production applications
• Development, Testing, QA– Facilitates faster time to market
• Cloning Challenges– Complicated Process
• Multiple admins – e.g. system, storage administrators– Time Consuming– Resource intensive– Expensive – especially for large multi-terabyte databases.
• As a result of these challenges, DB Copies and Clones may not be created as often as required
Business Challenges
• Cloning Requirements– Critical for delivering high-quality, production applications
• Development, Testing, QA– Facilitates faster time to market
• Cloning Challenges– Complicated Process
• Multiple admins – e.g. system, storage administrators– Time Consuming– Resource intensive– Expensive – especially for large multi-terabyte databases.
• As a result of these challenges, DB Copies and Clones may not be created as often as required
What is Snap Clone?DBaaS approach to creating clones of large (~TB) databases
Space EfficientSignificantly reduce thestorage footprint
Time EfficientClone DBs in minutes notdays/weeks
Storage AgnosticSupports ALL storage
vendors (NAS & SAN)
Self ServiceEmpower the user to makeadhoc clones
5
Oracle Enterprise Manager 12c Snap CloneLeverage capabilities of the Oracle ZFS Storage Appliance
• Allows database administrators tocreate fully functional copies ofdatabases– Performed at the storage layer using copy-
on-write capabilities of storage device– New databases provisioned within minutes
instead of hours
• Included with Cloud Management Packfor Oracle Database
• Allows database administrators tocreate fully functional copies ofdatabases– Performed at the storage layer using copy-
on-write capabilities of storage device– New databases provisioned within minutes
instead of hours
• Included with Cloud Management Packfor Oracle Database
Eliminating DB Storage Overhead Costs for Dev/TestBusiness Value: 90%+ reduction in storage overhead via ‘Snap Clone’
• Substantial DB storage overhead exists tosupport operations– For every DB in prod, 8-12 copies exist– Uses: Development, Test, Back-up, Archive
• DBaaS Snap Clone benefits:– 95% reduction in storage overhead, impact
easily quantified– Storage growing 35-40% / year– Delivery time cut from 2 weeks to > 1 hour
• Substantial DB storage overhead exists tosupport operations– For every DB in prod, 8-12 copies exist– Uses: Development, Test, Back-up, Archive
• DBaaS Snap Clone benefits:– 95% reduction in storage overhead, impact
easily quantified– Storage growing 35-40% / year– Delivery time cut from 2 weeks to > 1 hour
7
Test MasterDatabase
NAME SSN SALARY
MILLER 112-23-4567 40,000
SMITH 111-22-3333 60,000
Masking &Sub setting
SourceDatabase
010110011101001010000111010
NAME SSN SALARY
AGUILAR 203-33-3234 40,000
BENSON 323-22-2943 60,000
Cloning and Data RefreshSnap Clone and Full Cloning
Source DB Backups Mask / Subset Test Master Clones
Refresh
Data Guard Standby
Refresh
DB Clone and Refresh – Admin Flow
Mask
Update [Patch or Upgrade]
Change Configuration [SI / RAC]
Snap Clone
Use as Test Master
Production Database Clone / Test Master
Use as Test Master
Version: 11.2.0.4
Config: 3 Node RAC
Data: RMAN Backup1
Version: 11.2.0.4.2
Config: Single Instance
Data: RMAN Backup1
t0 t1 t2 …. tN
RMAN Backup / Storage Snapshot
SCN or Time
Integrated Data Masking
Production
Dev
Test
Clone
Test Master
Mask
DEPT LAST_NAME SSN SALARY
10 SMITH 111—23-1111 40,000
Data Masking Template
• Supports use of EM Data Masking template (requires Oracle Data Masking and SubsetPack), or running custom sql scripts
• Mask sensitive data as part of one-off clone or test master creation• For Snap Clone, it is recommended to only mask the test master, so as to retain
storage savings post snap clone
Oracle Confidential –Internal
10 SMITH 111—23-1111 40,000
10 JOHNSON 222-34-1345 60,000
Test MasterDatabase
010110011101001010000111010
Snap Clone with Oracle Engineered SystemsExadata• Compute nodes are used to run snap
clone databases• The storage is external to Exadata and
served over NFS• In case of ZS storage, all traffic over
Infiniband
SuperCluster• Solaris Zones or LDOMS used to run snap
clone databases• Embedded ZS-ES storage served over
Infiniband
Oracle Virtual Compute Appliance• Oracle VMs used to run snap clone
databases• Embedded ZS-ES storage served over
Infiniband
/source [nfs]
External Storage
010110011101001010000111010
Enterprise Manager12c
Exadata• Compute nodes are used to run snap
clone databases• The storage is external to Exadata and
served over NFS• In case of ZS storage, all traffic over
Infiniband
SuperCluster• Solaris Zones or LDOMS used to run snap
clone databases• Embedded ZS-ES storage served over
Infiniband
Oracle Virtual Compute Appliance• Oracle VMs used to run snap clone
databases• Embedded ZS-ES storage served over
Infiniband
/clone1 [nfs]
/clone2 [nfs]
Snap Clone Vs Competition
Scale, Scale, Scale Supports 1 to 1000s of clones
Protects your existing investments Choice between hardware and software solution Use of trusted technologies like data guard for test master refresh
Part of Enterprise Manager 12c Oracle’s flagship management product for all your database needs In sync with DB releases (support for PDBs on day 1) Secure and role based access control; used by Fortune 1000 customers Protection from unnecessary point tools; reduce TCO
Scale, Scale, Scale Supports 1 to 1000s of clones
Protects your existing investments Choice between hardware and software solution Use of trusted technologies like data guard for test master refresh
Part of Enterprise Manager 12c Oracle’s flagship management product for all your database needs In sync with DB releases (support for PDBs on day 1) Secure and role based access control; used by Fortune 1000 customers Protection from unnecessary point tools; reduce TCO
Session Agenda
Snap Clone OverviewMartin Pena
ZFS Storage Appliance Advantages for Snap CloneDoug Chamberlain
Demo: Snap Clone + ZFS Storage ApplianceMartin Pena
Closing
Snap Clone OverviewMartin Pena
ZFS Storage Appliance Advantages for Snap CloneDoug Chamberlain
Demo: Snap Clone + ZFS Storage ApplianceMartin Pena
Closing
Oracle ZS Storage ApplianceEngineered for optimizing database storage
• Storage Related Challenges– Server to storage roadblocks lower software ROI– Slow, inflexible storage increases complexity and cost– Inefficient development & test slows time-to-market
• Oracle ZS Storage Appliance– Optimized Oracle Database efficiency with HCC– Optimized RMAN backup and recovery– Optimized data reuse in development and test– DBAs manage snapshots and clones directly
• Storage Related Challenges– Server to storage roadblocks lower software ROI– Slow, inflexible storage increases complexity and cost– Inefficient development & test slows time-to-market
• Oracle ZS Storage Appliance– Optimized Oracle Database efficiency with HCC– Optimized RMAN backup and recovery– Optimized data reuse in development and test– DBAs manage snapshots and clones directly
ZS: Engineered for Extreme PerformanceUnique Architecture for Optimal Storage Tiering
• Automated Data Placement over Tiered Caches– Adapts to workload changes, using fastest media– Read performance optimization from DRAM cache– Write performance optimization with write flash SSD
• Customer Benefits– Automatic optimization, no involvement required– Best Application Performance, $/IOP, $/GB in its class
Adaptive Throttle AlgorithmDetermines Pipe Size
Hybrid Storage Pool
AdaptiveI/O Staging
2TB
DR
AM
SAS-2(15K, 10K, 7K)
WRITE FLASH
LRU MRU
SLC NANDSync I/O Only
• Automated Data Placement over Tiered Caches– Adapts to workload changes, using fastest media– Read performance optimization from DRAM cache– Write performance optimization with write flash SSD
• Customer Benefits– Automatic optimization, no involvement required– Best Application Performance, $/IOP, $/GB in its class
Adaptive Throttle AlgorithmDetermines Pipe Size
Automated, real-time data migration from DRAMto multi-class flash, to multi-class disk storage
Software specifically engineered for multi-levelflash and disk storage
2TB
DR
AM
MLC NANDL2ARC
READ FLASH
LRU MRU
LFU MFU
(Evicted)
ZS is a DRAM-basedStorage System
DRAM is 1000x Fasterthan Flash
Up to 90% of IO fromDRAM
DRAM
not to scale
ZS is a DRAM-basedStorage System
DRAM is 1000x Fasterthan Flash
Up to 90% of IO fromDRAM
16
Disk
Flash
What is the Hybrid Storage Pool?Performance meets TCO
• Hottest/most recent data cached inmemory– Up to 3TB of DRAM available
• As data cools and is less active, cachedcopy is migrated to flash/SSD– Warm data response times identical to all-flash
array
• All data stored and protected on disk– Mirrored or RAID-protected
Active Data inMemory/DRAM
• Hottest/most recent data cached inmemory– Up to 3TB of DRAM available
• As data cools and is less active, cachedcopy is migrated to flash/SSD– Warm data response times identical to all-flash
array
• All data stored and protected on disk– Mirrored or RAID-protected
Oracle Confidential –Internal/Restricted/HighlyRestricted
1717
All Data Protectedon HDDs
Recent Dataon Flash/SSD
Understanding the Hybrid Storage Pool (HSP)
Latency
First read request
Subsequent read request
Cold data on disk only
… and the cycle repeats
18
Latency
Database HostLater read request
Much later read request
Cached in DRAM
Cached in SSD
Cold data on disk only
Data starts to cool …
Data becomes cold …
• Snapshots– Provide a read-only point-in-time copy of file
system– Practically unlimited maximum number of
maximum snapshots– Only changes tracked – near-zero space
consumption and near instantaneous
• Clones– Writeable copy of a snapshot– Nearly instantaneous creation, practically
unlimited number– Ideal for storing many private copies of
mostly-shared data
ZFS Data Distribution: Snapshots and Clones• Snapshots
– Provide a read-only point-in-time copy of filesystem
– Practically unlimited maximum number ofmaximum snapshots
– Only changes tracked – near-zero spaceconsumption and near instantaneous
• Clones– Writeable copy of a snapshot– Nearly instantaneous creation, practically
unlimited number– Ideal for storing many private copies of
mostly-shared data
Base Image1TB Data Files
Traditional ClonesFull copy of the original database
3TB for original + clones
Thin ClonesOnly changed blocks in new clone space
1.015TB for original + clones
ZFS Data Reduction: Thin Clones
Base Image1TB Data Files
Clone A1TB Data Files
Clone B1TB Data Files
Clone A5GB Data Files
Clone B10GB Data Files
Pointers toexisting blocks
Pointers toexisting blocks
New data
New data
Traditional File SystemFull copy duplicates all data blocks
my_file
my_file_copy
• File is collection of data blocks• And headers• Copy duplicates header & data blocks
– Effective & simple, but expensive!
cp my_file my_file_copy
• File is collection of data blocks• And headers• Copy duplicates header & data blocks
– Effective & simple, but expensive!
Copy-on-Write Basics
• File is collection of data blocks• And headers• Copy file requires only copy of header
– Much more efficient storage– Minimal IO to create copy
• Only copy block when changed
Much more efficient storage of substantially similar filesmy_file
• File is collection of data blocks• And headers• Copy file requires only copy of header
– Much more efficient storage– Minimal IO to create copy
• Only copy block when changedmy_file_copy
cp my_file my_file_copy
Accelerate Development and Test EnvironmentsLeveraging ZS for development and testing
• Accelerate deployment of patches,upgrades, and applications– Effectively and efficiently give each developer
their own database– ID changes in code that affect storage system
performance
• Nearly no procedural changes• Add value to Data Guard DR copies of
database with included snapshot andclone features
• Tested, validated, and supported by Oracle
Database Server
Primary Array
RMAN DUPLICATE
Clone Database Server
RMAN MERGE
• Accelerate deployment of patches,upgrades, and applications– Effectively and efficiently give each developer
their own database– ID changes in code that affect storage system
performance
• Nearly no procedural changes• Add value to Data Guard DR copies of
database with included snapshot andclone features
• Tested, validated, and supported by Oracle
ZS Storage Appliance
Integrate Oracle ZFS Storage ApplianceMonitor and Manage ZFS Storage Appliances through Oracle Enterprise Manager
• Plug-in for Enterprise Manager– Enables n-way monitoring and managing
of multiple ZFS Storage Appliancesthrough Enterprise Manager interface
• You can– Monitor key ZFS Storage Appliance
metrics with deep analytics– Provision LUNs and shares; adjust
tunable parameters
• Plug-in for Enterprise Manager– Enables n-way monitoring and managing
of multiple ZFS Storage Appliancesthrough Enterprise Manager interface
• You can– Monitor key ZFS Storage Appliance
metrics with deep analytics– Provision LUNs and shares; adjust
tunable parameters
24
Device Summary View Simplifies Monitoring TasksUses powerful analytics to provide intuitive displays of key metrics
• Share reservations and utilization at aglance
• Graphs of disk I/O and networkperformance for quick review of recentactivity
• System alert notifications displayed inthe summary view
• Link to launch appliance GUI fordetailed analytics and devicemanagement
• Share reservations and utilization at aglance
• Graphs of disk I/O and networkperformance for quick review of recentactivity
• System alert notifications displayed inthe summary view
• Link to launch appliance GUI fordetailed analytics and devicemanagement
25
ASR Alerts: Critical, Major
Found the Problem. Now What?Take the reins yourself
• Manage your ZFS Storage Appliance through Enterprise Manager– No new interfaces to learn
• Access a full set of provisioning capabilities– Create or tune the storage to your database needs
• Don’t blindly accept that the storage given to you will meet your needs– You know best what the database needs from the underlying storage
• Manage your ZFS Storage Appliance through Enterprise Manager– No new interfaces to learn
• Access a full set of provisioning capabilities– Create or tune the storage to your database needs
• Don’t blindly accept that the storage given to you will meet your needs– You know best what the database needs from the underlying storage
26
Modify Storage Allocation to RespondOnly Oracle ZFS Storage Appliance can be provisioned from Enterprise Manager
• Access a full set of provisioningcapabilities– Create or tune the storage your
database needs– Adjust write bias, database record size– Make snapshots visible for RMAN
• Manage your ZFS Storage Appliancethrough Enterprise Manager– No new interfaces to learn
• Access a full set of provisioningcapabilities– Create or tune the storage your
database needs– Adjust write bias, database record size– Make snapshots visible for RMAN
• Manage your ZFS Storage Appliancethrough Enterprise Manager– No new interfaces to learn
27
What Would a DBA Need to Change?RMAN backup use case
• Backup I/O characteristics for RMAN workload– Tune SSD write flash accelerator bias to send data straight to disk spindles– Matching 1MB storage record size to 1MB backup I/O record size shows a significant
improvement in restore performance
• Backup I/O characteristics for RMAN workload– Tune SSD write flash accelerator bias to send data straight to disk spindles– Matching 1MB storage record size to 1MB backup I/O record size shows a significant
improvement in restore performance
28
• Enterprise Manager enables theDBA to set the same parameters forearlier database versions– Simple steps to take through Enterprise
Manager
• Oracle Intelligent Storage Protocol(OISP) in 12c does this automatically– Database passes information directly to
the ZFS Storage Appliance to setparameters
Write Bias Provisioned from Enterprise Manager
• Option selected from dropdown list– Latency– Throughput
• Option selected from dropdown list– Latency– Throughput
Oracle Confidential –Internal/Restricted/HighlyRestricted
29
Record Size Provisioned from Enterprise Manager
• Option selected from dropdown list– Values from 8k to 1MB– Match to workflow
• Option selected from dropdown list– Values from 8k to 1MB– Match to workflow
Oracle Confidential –Internal/Restricted/HighlyRestricted
30
Session Agenda
Snap Clone OverviewMartin Pena
ZFS Storage Appliance Advantages for Snap CloneDoug Chamberlain
Demo: Snap Clone + ZFS Storage ApplianceMartin Pena
Closing
Snap Clone OverviewMartin Pena
ZFS Storage Appliance Advantages for Snap CloneDoug Chamberlain
Demo: Snap Clone + ZFS Storage ApplianceMartin Pena
Closing
DemonstrationDemonstrationSnap Clone on ZFS Storage Appliance – via Enterprise Manager 12c Self Service PortalSnap Clone on ZFS Storage Appliance– Administration and Storage Setup
Customer Success: SnapClone + ZFS Storage Appliance• Company Background
– Large mobile phone company in MEA in terms of active subscribers
• Business Challenges– Average 5 days to provision UAT Database(s) for Dev Team.– Provisioning of new dev/test env uses in-house scripts and no automation is involved.– Sprawl Computing Resources.– No metering/chargeback capabilities.– Limited floor space in Data center.
CaseStudy
• Company Background– Large mobile phone company in MEA in terms of active subscribers
• Business Challenges– Average 5 days to provision UAT Database(s) for Dev Team.– Provisioning of new dev/test env uses in-house scripts and no automation is involved.– Sprawl Computing Resources.– No metering/chargeback capabilities.– Limited floor space in Data center.
Oracle Confidential – 33
Solution ComparisonTask Business as usual
Oracle CloudSolution
Difference
Total Provisioning Time assuming no resources aremade available (250GB/1TB DB size - 32GB logs)+ DataMasking
5 Days 2hrs:06 mins Almost 118 hrs57X Fatser
On demand Self Service No Yes
Resource Pooling No Yes
Rapid Elasticity (Service De-commissioning) No YesRapid Elasticity (Service De-commissioning) No Yes
Metering and Chargeback No Yes
• The provisioning time doesn’t really depend on the DB size, yet theamount of redo/standby logs to be cleared to activate the Cloned standbydatabase. So, with larger DBs the provisioning time would only increaseseveral mins as opposed to the traditional way, where the same timewould increase by factor of days.
Session Agenda
Snap Clone OverviewMartin Pena
ZFS Storage Appliance Advantages for Snap CloneDoug Chamberlain
Case Study: Snap Clone + ZFS Storage ApplianceMartin Pena
Closing
Snap Clone OverviewMartin Pena
ZFS Storage Appliance Advantages for Snap CloneDoug Chamberlain
Case Study: Snap Clone + ZFS Storage ApplianceMartin Pena
Closing
Total Cloud ControlIdeal N-way Management Framework
Complete Cloud LifecycleManagement
Integrated Cloud StackManagement
Business-Driven ApplicationManagement
Self-Service IT Simple and Automated Business Driven| |
40
Oracle Enterprise Manager 12c Snap CloneLeverage capabilities of the Oracle ZFS Storage Appliance
• Allows database administrators tocreate fully functional copies ofdatabases– Performed at the storage layer using copy-
on-write capabilities of storage device– New databases provisioned within minutes
instead of hours
• Included with Cloud Management Packfor Oracle Database
• Allows database administrators tocreate fully functional copies ofdatabases– Performed at the storage layer using copy-
on-write capabilities of storage device– New databases provisioned within minutes
instead of hours
• Included with Cloud Management Packfor Oracle Database
Oracle ZS Storage addresses key pain points
• Automated caching keep the right things in thefastest media (DRAM) to support performanceSLAs
• True Symmetric Multiprocessing (SMP) managesVM boot storms, bottlenecks, hot spots, and I/Osaturation to eliminate filer sprawl
• Advanced storage analytics allow you to find andeliminate issues 73% faster for maximumuptime*
Your storage admin should look to add it to the mix…
• Automated caching keep the right things in thefastest media (DRAM) to support performanceSLAs
• True Symmetric Multiprocessing (SMP) managesVM boot storms, bottlenecks, hot spots, and I/Osaturation to eliminate filer sprawl
• Advanced storage analytics allow you to find andeliminate issues 73% faster for maximumuptime*
*Source: Strategic Focus. https://go.oracle.com/LP=4206/?elqCampaignId=6667