partner webcast – oracle exadata x3 database in-memory machine - next-generation technologies...
Post on 05-Dec-2014
2.829 Views
Preview:
DESCRIPTION
TRANSCRIPT
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1
CUSTOMER LOGO
“This slide format serves to call attention to a quote from a prominent customer, executive, or thought leader in regards to a particular topic.” Name
Title, Company Name
blogs.oracle.com/IMC
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 2
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 3
Exadata X3 Database In-Memory Machine Next-Generation Technologies Update
Sezgi GEÇER,
IMC Consultant
Oracle Partner Hub - Turkey
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 4
Program Agenda
Exadata Evolution
Exadata Unique Next Generation Technologies
Exadata X3 Database In-Memory Machine Updates
– Hardware Updates
– Software Updates
Exadata Migration
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 5
DATA WAREHOUSING
OLTP
MIXED WORKLOADS
DATABASE CONSOLIDATION
DATABASE CLOUD
Exadata - One Machine | Many Workloads
Oracle’s strategic platform for ALL
Database workloads
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 6
A Complete, Integrated, Optimized Platform 100% Supported by Oracle
Scale-Out Database Servers
High Volume 2 or 8 socket servers
Oracle Database 11g, RAC, ASM, EM12c
Compatible with all 11g databases, app’s, tools
Scale-Out Intelligent Storage Servers
High Volume 2-socket storage servers
Exadata Storage Server Software
InfiniBand Network
Unified internal connectivity ( 40 Gb/sec )
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 7
Highly Engineered and Standardized Less Risk, Better Results
Hundreds of engineer years spent optimizing and
hardening the system end-to-end
– Frees I/T talent to focus on business needs
Standard platform improves support experience
Runs all existing Oracle Database workloads
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 8
Exadata Evolution X3 “Database In-Memory Machine”
2008
Warehouse Smart Storage
InfiniBand Scale-Out
2010
Scale-Up 80-core SMPs
OLTP & VLDB Flash
Columnar
2009
2012
Massive Flash
All I/Os to Flash
Database On Disk
X3
Database In-Memory
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 9
Program Agenda
Exadata Evolution
Exadata Unique Next Generation Technologies
Exadata X3 Database In-Memory Machine Updates
– Hardware Updates
– Software Updates
Exadata Migration
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 10
Exadata Innovations
• Intelligent storage
– Scale-out InfiniBand storage
– Smart Scan query offload
+ + +
• Hybrid Columnar Compression – 10x compression for warehouses
– 15x compression for archives
• Smart PCI Flash Cache – Accelerates random I/O up to 30x
– Triples data scan rate
Data remains
compressed
for scans
and in Flash
Benefits Cascade
to Copies
compress
primary DB
standby test
dev backup
uncompressed
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 11
Exadata Intelligent Storage Grid
• Data Intensive processing runs in Exadata Storage Grid
• Filter rows and columns as data streams from disks (168 Intel Cores)
• Example: How much product X sold last quarter
• Exadata Storage Reads 10TB from disk
• Exadata Storage Filters rows by Product & Date
• Sends 100GB of matching data to DB Servers
• Scale-out storage parallelizes execution and removes bottlenecks
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 12
Simple Query Example
Select sum (sales) where Date=‘24-Sept’
Optimizer Chooses Partitions & Indexes to Access
• Scan compressed blocks in partitions / indexes
• Retrieve sales amounts for Sept 24
• 10 TB scanned • 1 GB returned
to servers
What were
my sales
yesterday?
Oracle DB Grid
Exadata
Storage
Grid
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 13
Exadata Storage Index Transparent I/O Elimination with No Overhead
• Exadata Storage Indexes maintain summary
information about table data in memory • Store MIN and MAX values of columns
• Typically one index entry for every MB of disk
• Eliminates disk I/Os if MIN and MAX can never
match “where” clause of a query
• Completely automatic and transparent
A B C D
1
3
5
5
8
3
Min B = 1
Max B =5
Table Index
Min B = 3
Max B =8
Select * from Table where B<2 - Only first set of rows can match
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 14
Exadata Hybrid Columnar Compression Highest Capacity, Lowest Cost
• Data is organized and compressed by column
• Dramatically better compression
• Speed Optimized Query Mode for Data Warehousing
• 10X compression typical
• Runs faster because of Exadata offload!
• Space Optimized Archival Mode for infrequently accessed data
• 15X to 50X compression typical
Qu
ery
Faster and Simpler
Backup, DR, Caching,
Reorg, Clone Benefits Multiply
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 15
Exadata I/O Resource Management Mixed Workloads and Multi-Database Environment
Exadata Cell
InfiniBand Switch/Network
Database A Database B
Exadata Cell Exadata Cell
• Ensure different databases are allocated the
correct relative amount of I/O bandwidth • Database A: 33% I/O resources
• Database B: 67% I/O resources
• Ensure different users and tasks within a
database are allocated the correct relative
amount of I/O bandwidth • Database A:
• Reporting: 60% of I/O resources
• ETL: 40% of I/O resources
• Database B:
• Interactive: 30% of I/O resources
• Batch: 70% of I/O resources
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 16
1000’s of Deployments at Leading Companies
Petabyte Warehouses
E-business Suite, PeopleSoft,
Siebel, JDE, SAP
Regulatory Reporting
Online Financial Trading
E-Commerce Sites
Consolidation of 100’s of
Databases
50% Data Warehouses, 50% OLTP / Mixed Workloads
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 17
Garmin: OLTP Consolidation
Exadata V2
DB Consolidation
Pre-Exadata
12 Prod Servers
2012
• Oracle E-Business Suite
• Advanced Supply-Chain
Planning
• Hyperion Reporting
• Garmin Connect custom app
Objectives
• Support 400% growth in
customer facing applications
• Eliminate bottlenecks in
Manufacturing and Planning
• Consolidate to reduce costs
Solution
• 2012: Consolidate 12 servers
onto two Half-rack Exadata
V2 systems
Data Guard
Exadata V2
Dev/Test/Local Standby
• 5 Prod
Databases
High-Capacity
Exadata Storage
Servers
• Archived
Data
• Tape backup
Benefits 4x Growth Faster
Month End Reports
Up to 11X
99.95%
Uptime
Data Center
Cost Savings
“Consolidation on Exadata reduced costs and
eliminated critical performance bottlenecks in our
Manufacturing and Planning systems”
- Ed Link, Vice-President IT, Garmin
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 18
Turkcell: DW and DB Consolidation
Objectives
• Speed up BI
• Lean, green data center
• Prepare for big data growth
Solution
• 2010: Replace 11 racks with
1 full-rack Exadata V2 for DW
• 2011: Add 2 full-rack Exadata
X2-2s for DB consolidation
2 Exadata X2-2
Prod
Original V2
Prod/DR/Dev
Exadata V2
Data Warehouse
Pre-Exadata
Data Warehouse
Hitachi
USP-V
5 Racks EMC DMX-4
5 Racks 2011
• 250 TB
Raw Data • 2 Prod Databases
• 600 TB Raw / 60 TB
Compressed
• 16-node RAC Cluster
• 25 TB
Compressed
Benefits Reduced
Admin
20%
Storage
Savings
900 TB
1,000 TB to 100 TB
Faster
Reports
10X
27 min to 3 min
(avg for 50k rpts)
“In a word, Oracle Exadata is fantastic. Almost no
report takes more than 10 minutes to run, versus
hours before. It sounds unreal, but it’s real.”
- Power User, Finance Department, Turkcell
80% Less Power
30 m2 Less Space
Data Center
Cost Savings
• 4 Prod, 2 Test
Databases
• 400 TB Raw/
40 TB Compressed
• 2 RAC Clusters
2010 Backup Restore
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 19
Program Agenda
Exadata Evolution
Exadata Unique Next Generation Technologies
Exadata X3 Database In-Memory Machine Updates
– Hardware Updates
– Software Updates
Exadata Migration
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 20
Exadata X3 “Database In-Memory Machine”
X3 mass memory hierarchy delivers extreme
performance – Automatically moves all active data from disk to memory
DRAM memory expanded to 2 or 4 TB for hottest data
– 4 to 40 TB of compressed user data????
Flash memory expanded 4X to 22 TB per rack
– 40 to 200 TB of compressed user data – ALL active data
– 1.5 Million SQL random read I/Os per second for OLTP
Comparable to 15,000 disk drives in 150 array frames
– 100 GB/sec SQL data scan rate for reporting and warehouses
Comparable to 1,000 disk drives in 10 array frames
500 TB
DISK
22 TB PCI
FLASH
2 or 4 TB
DRAM
Cold Data
Hottest Data
Active Data
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 21
Exadata X3-2 Database Server Update New Intel 8-core E5 “SandyBridge” CPUs, more memory, 10GbE
Notes:
Xeon E5 (Sandy Bridge) internal architecture gives higher performance with lower clock speed
Disk Controller, Disks, and InfiniBand are Unchanged
Unlike X2, no performance penalty for memory expansion
Database
Server
X4170 M2 (current) Sun Server X3-2 (new) Improvement
CPU 6-core X5675
(3.06 GHz mid-bin)
8-core E5-2690
(2.9 GHz top-bin)
1.3X to 1.5X CPU
performance
Memory 96GB (up to 144GB)
8 GB DIMMs
128GB (up to 256GB)
16 GB DIMMs
1.3X normal
1.7X w/expansion
Networking 4 x 1GbE copper
2 x10GbE optical card
4 x 1 or 10 GbE copper
2 x 10GbE optical card
3X more 10GbE
PCIe Bus Gen 2.0 Gen 3.0 Future. Requires Gen 3 cards
Effective Dec 11, 2012, we start shipping new X3-2 orders with the increased memory in the database
servers. We will ship X3-2 database servers with 256GB of memory installed by default instead of the
previous default of 128GB. This is the maximum amount of memory that is currently supported in the Exadata
X3-2. There is no hardware price increase for the extra memory.
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 22
Exadata Storage Server Update 4X Flash Capacity
Storage
Server
X4270 M2 (current) Sun Server X3-2L (new) Improvement
Flash 384 GB (4 x 96GB) 1600 GB (4 x 400GB) 4X
Disks 12 x 600GB or
12 x 3TB
No Change No change
CPU 6-core L5640
(2.26 GHz)
6-core E5-2630L
(2.0 GHz)
Similar Performance
Notes
Kept Storage CPU at 6-core low power processor. Embedded storage CPU requires much less
throughput than DB CPU.
Disk Controller and InfiniBand card are unchanged.
Internal memory increased from 24GB to 64GB for managing large flash.
PCI 3.0 included in new servers but will not see benefit until cards redesigned for 3.0.
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 23
X3 Upgrades
X2 or V2 systems can be expanded with X3 hardware
– A single Database Machine can have servers from
different generations
– Databases and Clusters can span across multiple
generations of hardware
As always we don’t replace servers or components inside
the servers
– We expand by adding new servers
– Obsolete servers are removed
X3 hardware requires recent Exadata software release (>=
11.2.3.2.0) since servers require new drivers, firmware, etc.
– X3 hardware does not require a Database, ASM, or
Clusterware upgrade
V2
Initial Quarter
Rack
X2-2
Qtr to Half
Upgrade
X3-2
Half to Full
Upgrade
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 24
Exadata X3-2 Storage Expansion Rack
Exadata Storage Expansion Rack has also been updated with X3
storage servers
Main benefit is much larger flash
– 28.8 TB of flash per full rack
– Disk capacity per rack remains 648 TB Raw
Can be connect to Exadata or SPARC SuperCluster as always
Can be connected to new or older generation database machines
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 25
NEW Exadata X3-2 Eighth Rack Faster Than 2010 Quarter-Rack, 2008 Half-Rack
Lowest Cost Exadata Configuration
– Hardware List price $200K: 60% of Quarter Rack
– 16 Database Cores, 54 TB Disk, 2.4 TB PCI Flash
– Highly Available configuration with all Exadata features
Brings Exadata Extreme Performance to smaller workloads,
development, test, disaster recovery
Hardware Identical to Quarter-Rack
– Half CPU Cores, Disks, and Flash Cards Disabled
– Half the Database and Exadata Software Licenses
Upgrade to Quarter-Rack with software command
Lowest
Cost
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 26
Complete Family of Database Machines
Oracle Exadata X3-2 2, 4, and 8 database nodes
Half Full Multi-Rack
Eighth Quarter
Oracle Exadata X3-8 2 (80 core) database nodes
4 TB DRAM
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 27
New Exadata Software
11.2.3.2.0
Features work on all hardware generations
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 28
Exadata Smart Flash Cache Write-Back Cache Accelerates Write Performance 20X
New software caches write I/Os in flash memory
– Now all reads and writes of active data go to flash
– 1 Million 8K flash write I/Os per second on an X3 rack
Comparable to 10,000 disks on 100 array frames
20X more writes than previous Exadata version
– New software also provides 10x write improvement on
existing V2 and X2 systems
Cache is persistent and fully redundant
– Also improves database availability by accelerating write
intensive recovery
1 Million 8K
flash write
IOPs from
SQL
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 29
PeopleSoft Batch Example Quarter Rack X3-2 Write IOPS
Peoplesoft Batch Workload
X3-2 Quarter Rack
Writes often in the 60K to
80K IOPs range
Peak at 170K IOPS
Would need more than 3
full racks without Write-
Back Flash Cache
IO bound job became CPU
and application bound
170,000
Peak Write
IOPS
50,000 IOPS
(limit on X2
full rack)
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 30
Flash Cache Advantages over Flash Tiering
Teradata, EMC, Hitachi, IBM, etc. use flash tiering
Exadata Flash Cache adapts much faster to changing workload
– Each I/O changes content of cache
– If new data is created it can be instantly cached
– With tiering, data is slowly migrated from disk based on historical statistics
– Flash tiering caches yesterday’s hot data, not necessarily today’s
Exadata Cache has much finer granularity of flash contents
– Caching at 64K chunks for flash cache, around 1MB for flash tiering
– Caching is much more efficient at capturing hot data in flash while leaving cold data on disk. Multiplies the
effective capacity of flash.
Exadata Cache doesn’t need to mirror data in flash
– Can keep one mirror copy in flash to speed up reads while having the other mirror copy on disk
Flash cache can keep hot blocks cached forever
– There is no need to ever de-stage them to disk. This is not a tiering advantage
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 31
Exadata Innovations with Exadata X3
10:1
HOT
COLD
WARM
Smart Flash Cache
Smart Flash Logging
Write-Back Flash Cache
Hybrid Columnar
Compression
Smart
Flash
Smart
Scan
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 32
All X3 Database Machines
X3-2 Database Servers
Same Architecture as Exadata X2
Same Price as Exadata X2
Exadata X3 Details
10% to 20% Lower Power
20X More Write Performance
33% Faster Database CPUs
Full 10Gb Ethernet to Data Center
4X Larger Flash Memory
10% to 30% Lower Power
33% More Data Throughput
Exadata Smart Flash Write Caching
40X 10Gb ports per Rack
22 TB of Flash Memory per Rack
Up to 3 Kilowatt Reduction per Rack
100 GB/sec running SQL
75% More Memory
8-Core Xeon® SandyBridge E5-2690
Faster Bigger
1 TB to 2 TB per Rack
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 33
Program Agenda
Exadata Evolution
Exadata Unique Next Generation Technologies
Exadata X3 Database In-Memory Machine Updates
– Hardware Updates
– Software Updates
Exadata Migration
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 34
Migration Strategy
– Database Machine and Exadata
– Oracle 11g Release 2
Upgrade Guide
Upgrade Companion (MOS 785351.1)
– Linux 64bit
– Automatic Storage Management (ASM)
– Real Application Clusters (RAC)
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 35
Migration Methods - Physical Migration
METHOD REQUIREMENT
Physical Standby
• MOS 1055938.1
• MOS 413484.1*
Oracle 11.1 or later on Linux*
ARCHIVELOG and LOGGING
Transportable Database
• MAA on OTN Oracle 11.2 on any little endian
Transportable Tablespaces
• MAA on OTN Oracle 10.1 or later on any platform
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 36
Migration Methods - Logical Migration
METHOD REQUIREMENT
Logical Standby
• MOS 737460.1
• MOS 1055938.1
• MOS 413484.1
Oracle 11.1 or later on Linux
ARCHIVELOG and LOGGING
Golden Gate
• MAA on OTN
Oracle 10.1 or later
ARCHIVELOG and LOGGING
Data Pump
• OTN Oracle 10.1 or later
CTAS / IAS Oracle
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 37
Oracle Exastack Program
Logo Example Products Benefits Messaging
• Oracle Database Ready
• Oracle WebLogic Ready
• Oracle Solaris Ready
• Oracle Linux Ready
• Oracle VM Ready
• Press Release template with Oracle quote • 50 Support SRs (app/tech) • Logo • Solution Brief • OPN Solutions Catalog search • Applied toward Platinum upgrade
Runs Better on the Latest Oracle Products
Supports latest major release
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 38
Oracle Exastack Program
Logo Example Products Benefits Messaging
• Oracle Exadata Ready
• Oracle Exalogic Ready
• Oracle SPARC SuperCluster Ready
• High visibility with customers & Oracle sales • Exec quote for Press Release • Featured on OPN Solutions Catalog entry page • Logo • Datasheet • Applied toward Platinum upgrade
Tested and Ready to Run on Latest Oracle Platform
Reference or Verify support & runs with Exadata/Exalogic
Logo Example Products Benefits Messaging
• Oracle Database Ready
• Oracle WebLogic Ready
• Oracle Solaris Ready
• Oracle Linux Ready
• Oracle VM Ready
• Press Release template with Oracle quote • 50 Support SRs (app/tech) • Logo • Solution Brief • OPN Solutions Catalog search • Applied toward Platinum upgrade
Runs Better on the Latest Oracle Products
Supports latest major release
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 39
Oracle Exastack Program
Logo Example Products Benefits Messaging
• Oracle Exadata Optimized
• Oracle Exalogic Optimized
• Oracle SuperCluster Optimized
• Access to Oracle Performance Experts • Optimization Labs • Maximum visibility with customers & Oracle sales • Success Story with Performance Metrics • Exec quote for Press Release stating Performance
Metrics • Featured on OPN Solutions Catalog entry page • Applied toward Platinum or Diamond upgrade
Runs Best on Oracle
Optimized to run faster and more reliably
Logo Example Products Benefits Messaging
• Oracle Exadata Ready
• Oracle Exalogic Ready
• Oracle SPARC SuperCluster Ready
• High visibility with customers & Oracle sales • Exec quote for Press Release • Featured on OPN Solutions Catalog entry page • Logo • Datasheet • Applied toward Platinum upgrade
Tested and Ready to Run on Latest Oracle Platform
Reference or Verify support & runs with Exadata/Exalogic
Logo Example Products Benefits Messaging
• Oracle Database Ready
• Oracle WebLogic Ready
• Oracle Solaris Ready
• Oracle Linux Ready
• Oracle VM Ready
• Press Release template with Oracle quote • 50 Support SRs (app/tech) • Logo • Solution Brief • OPN Solutions Catalog search • Applied toward Platinum upgrade
Runs Better on the Latest Oracle Products
Supports latest major release
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 40
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 41
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 42
top related