barry hodges senior solution architect, sales consulting, oracle nz the best of oracle open world...
TRANSCRIPT
Barry HodgesBarry HodgesSenior Solution Architect, Senior Solution Architect, Sales Consulting, Oracle NZSales Consulting, Oracle NZ
The Best of Oracle Open World 2008
A Different Perspective
• Just being there …
• Opportunity to liaise with subject matter experts and product managers
• Input into the road map
• Pre-arranged agenda adapted as new opportunities presented themselves
Setting the scene …
Data Warehouses Growing RapidlyTripling In Size Every Two Years
Source: Winter TopTen Survey, Winter Corporation, Waltham MA, 2008.
200
400
600
800
1000
1998 2000 2002 2004 2006 2008 2010 2012
Actual
Projected
Ter
abyt
es o
f D
ata
Size of the Largest Data Warehouses
Data Warehouses Start Slowdown at 1TB
Table Scan Time
Table Size1TB 10 TB 100TB
1 Hour
10 Hours
5 Hours Typical NAS
Typical Mid-Range
Array
Typical High-End
Array
The Performance ChallengeStorage Data Bandwidth Bottleneck
• Current warehouse deployments often have bottlenecks limiting the movement of data from disks to servers
• Pipes between disks and servers are 10x to 100x too slow for data size
• Ship less data through the pipes • Add more pipes• Make the pipes wider
Solutions To Data Bandwidth Bottleneck
• “Brainy Software” approach - use smart database software to minimize the need for hardware– Smart Scan, OLAP, Bitmap Indexing, Join indexing,
Materialized Views, Result Caches, Range Partitioning, etc.
• “Brawny Hardware” approach - use powerful hardware to perform brute-force scans and joins– Brawny hardware approach only works if the rate of
scanning data scales with size of data
Solution Approaches
What We Announced …
HP Exadata Storage Server HardwareThe Core Building Block
• Exadata Ships Less Data Through Pipes– Query processing is moved into storage
to dramatically reduce data sent to servers while offloading server CPUs
• Exadata has More Pipes– Modular storage “cell” building blocks
organized into Massively Parallel Grid
– Bandwidth scales with capacity
• Exadata has Bigger Pipes– InfiniBand interconnect transfers data 5x
faster than Fibre ChannelExadata Moves a Lot
Less Data a Lot Faster
HP Exadata Cell Building Block Details
• Storage Server (Cell) is building block of Exadata Storage Grid
• Cells ship with all hardware and software components pre-installed
• Runs Exadata Storage Software, Oracle Infiniband protocol, Oracle Enterprise Linux 5.1, and HP hardware management software
• Hewlett Packard is exclusive hardware provider• Absolutely no custom hardware - all parts off the shelf high-
volume
8 GB DRAM
Redundant 110/220V Power
Supplies
2 Intel 2.66 Ghz Xeon Quad-core Processors
Infiniband DDR dual port card
Lights Out 100c – Management Card
12 x 3.5” Disk Drives - 7200 RPM 1000GB SATA - 15000 RPM 450GB SAS
Cell Hardware Details – HP DL180G5
P400 Smart Array Disk Controller card - 512M battery backed cache
SAS or SATA Disks in Exadata Servers• Choice of either
– 300 GB 15,000 RPM Serial Attached SCSI (SAS) disks
– 1 TB 7,200 RPM Serial Advanced Technology Attachment (SATA) disks
SAS Advantages SAS SATA Advantage
Throughput (MB/s) 1,000 750 1.33X
Average Seek Time (ms) 3.5 7.4 2.11X
Disk level read errors (per year) 6.3 63 10.00X
Years to disk failure 15.2 11.4 1.33X
• Choose SATA Based Servers for High Capacity
SATA Advantages SAS SATA Advantage
Capacity (TB RAW) 3.6 12 3.33X
Capacity (TB Uncompressed User Data)* 1.0 3.3 3.33X
• Choose SAS Based Servers for High Performance
* Computed after mirroring, log files, indexes, undo and temp tablespaces
SUPERCEDED
SAS or SATA Disks in Exadata Servers• Choice of either
– 450 GB 15,000 RPM Serial Attached SCSI (SAS) disks
– 1 TB 7,200 RPM Serial Advanced Technology Attachment (SATA) disks
SAS Advantages SAS SATA Advantage
Throughput (MB/s) 1,000 750 1.33X
Average Seek Time (ms) 3.5 7.4 2.11X
Disk level read errors (per year) 6.3 63 10.00X
Years to disk failure 15.2 11.4 1.33X
• Choose SATA Based Servers for High Capacity
SATA Advantages SAS SATA Advantage
Capacity (TB RAW) 5.4 12 2.22X
Capacity (TB Uncompressed User Data)* 1.5 3.3 2.22X
• Choose SAS Based Servers for High Performance
* Computed after mirroring, log files, indexes, undo and temp tablespaces
Traditional Scan Processing
What Were Yesterday’s
Sales?
SUM
Oracle Database Grid
Storage Array
Retrieve Entire Sales
Table
Select sum(sales)
where Date= ’20-Oct’ …
Exadata Smart Scan ProcessingOracle
Database GridWhat Were Yesterday’s
Sales?
Exadata Storage Grid
SUM
Select sum(sales)
where Date= ’20-Oct’ …
Retrieve Sales Amounts from
Oct 20
Smart Scan Functionality• Join filtering
– Star join filtering is performed within Exadata storage cells– Dimension table predicates are transformed into filters that are
applied to scan of fact table
• Backups– I/O for incremental backups is much more efficient since only
changed blocks are returned
• Create Tablespace (file creation)– Formatting of tablespace extents eliminates the I/O associated with
the creation and writing of tablespace blocks
• Smart scans are transparent to the application– No application or SQL changes required– Returned data is fully consistent and transactional
• Graph shows throughput achieved in real-world deployments– Infiniband is held back by PCIe 1.0 x8 bus on typical host systems
0
200
400
600
800
1000
1200
1400
Gigabit Ethernet 4Gb Fibre 20Gb Infiniband
MB/sec
12x slower
3x slower
Single Connection Throughput
InfiniBand Throughput
Massively Parallel Storage Grid
• Scalable– Scales to hundreds of storage servers
– Data automatically distributed across storage servers by ASM
– Transparently redistributed when storage servers are added or removed
– Data bandwidth scales linearly with capacity
• Available– Data is mirrored across storage servers
– Failure of disk or storage server transparently tolerated
• Simple– Works transparently - no application changes
Exadata bandwidth scales linearly with capacity
4 GB/sec
8 GB/sec
16 GB/sec
…
• 8 HP ProLiant DL360 Oracle Database servers
– 2 quad-core Intel Xeon, 32GB RAM– Oracle Enterprise Linux
• 14 Exadata Storage Cells (SAS or SATA) – Up to 21 TB uncompressed user data (SAS) *– Up to 46 TB uncompressed user data (SATA) *
• 4 InfiniBand switches, 1 Gigabit Ethernet switch
• Pre-installed, pre-configured
Add more racks for unlimited scalability
HP Oracle Database MachinePre-Configured High Performance Data Warehouse
* Computed after mirroring, log files, indexes, undo and temp tablespaces
Software Components • Required Software
– Oracle Database 11g Enterprise Edition– Oracle Exadata Storage Server Software– RAC– Partitioning Option
• Recommended Software– Advanced Compression Option– Enterprise Manager Packs: Diagnostics, Provisioning, Tuning– OLAP Option– Data Mining Option– Advanced Security Option– Real Application Testing– Oracle Business Intelligence Enterprise Edition Plus
Build your own DB Machine
InfiniBand Switch/Network
RACSingle Instance
* Currently certifying x86 OEL running Oracle 11.1.0.7
Exadata Performance Scales
Table Scan Time
Table Size1TB 10 TB 100TB
1 Hour
10 Hour
5 Hour
Typical Warehouse
Exadata
M-Tel Exadata Speedup 10X to 72X Performance Improvement
0 10 20 30 40 50 60 70 80
CDR Full Table Scan
Warehouse Inventory Report
CRM Service Order Report
CRM Customer Discount Report
Handset to Customer Mapping Report
Index Creation
Tablespace Creation
28xAverageSpeedup
Giant Eagle Exadata Speedup 3X to 20X Performance Improvement
- 5.0 10.0 15.0 20.0 25.0 30.0 35.0 40.0 45.0 50.0
Recall Query
Gift Card Activations
Sales and Customer Counts
Prompt04 Clone for ACL audit
Date to Date MovementComparison - 53 weeks
Materialized Views Rebuild
Merchandising Level 1 Detail byWeek
Supply Chain Vendor - Year - ItemMovement
Merchandising Level 1 Detail:Current - 52 weeks
Merchandising Level 1 Detail:Period Ago
16xAverageSpeedup
Database Machine Comparison
HP Oracle
Database
Machine
Netezza
10100
Teradata
2550
Footprint 1 rack 1 rack 1 rack
User data 21 TB 12.5 TB 12.6 TB
Disks 168 x 450GB disks 108 x 400GB disks 144 x 300GB disks
Database cores 64 DB Cores 4 DB Cores (?) 32 DB Cores
Storage cores 112 Storage Cores 108 Storage Cores* 0 Storage Cores
Total cores 176 Cores 112 Cores* 32 Cores
Interconnect 20Gb/sec Infiniband 1Gb/sec Ethernet 1 Gb/sec BYNET
Memory 368 GB 108 GB 128 GB
HW Architecture Open Proprietary Proprietary**
* Netezza 10100 uses PowerPC CPU’s (less powerful than Intel Xeon cores)** Teradata BYNET Interconnect is proprietary
Data Protection Solutions• All single points of failure eliminated by the architecture
• Hardware Assisted Resilient Data (HARD) built into storage– Prevent data corruption before it happens
• Data Guard provides disaster protection & data corruption protection – Automatically maintained second copy of database
• Flashback provides human error protection– Snapshot-like capabilities to rewind database to before error
• Recovery Manager (RMAN) provides backup to disk– Archiving and corruption protection– Can be used with Oracle Secure Backup (OSB) or third party tape backup
software
• These work just as they do for traditional non-Exadata storage– Users and database administrator use familiar tools
Exadata Co-Existence and Migration
• Databases can be concurrently deployed on Exadata and traditional storage– Smart Scan capability only works if the
whole tablespace is located on Exadata storage
• Online migration if currently using ASM and ASM redundancy
• Migration can be done using RMAN or Data Guard
Exadata Non-Exadata
DatabaseServer
Online Migration
US$24,000 / HP Oracle Exadata Storage Server
US$120,000 / Oracle Exadata Storage Server Software (US$10,000 / disk)
US$24,000 / HP Oracle Exadata Storage Server
US$120,000 / Oracle Exadata Storage Server Software (US$10,000 / disk)
* North America Prices. NOT inclusive of shipping, local taxes, etc
US$650,000 / HP Oracle Database Machine
US$1,680,000 for Oracle Exadata Storage Server Software (US$120,000 / Storage Server)
* Database 11g Enterprise Edition, RAC and Partitioning Option are required and must be licensed in addition to that above.
US$650,000 / HP Oracle Database Machine
US$1,680,000 for Oracle Exadata Storage Server Software (US$120,000 / Storage Server)
* Database 11g Enterprise Edition, RAC and Partitioning Option are required and must be licensed in addition to that above.
The HP Oracle Database MachineHow Much?
The HP Oracle Database MachineSales / Support Model
– System Delivery– Hardware Service
– System Sales– System Support
Oracle Technology Sales Manager is the single point for sales
Oracle is single point for Support
• NZ TBC
– Singapore already– Sydney, Australia scheduled– NZ to be confirmed
A queue has already formed!
The HP Oracle Database MachineWhere Can You Try It?
• Oracle Technology Sales Manager coordinates with Oracle data warehouse specialist Sales Consultants
• We are looking for:– Well-known companies or organisations who will be
references– Oracle knowledgeable staff– Performance challenges likely due to unbalanced hardware– Budget and clear business need– Query profile will benefit from Oracle Exadata Storage
Server Software – Interest in full HP Oracle Database Machine configuration
The HP Oracle Database MachineHow Is Oracle Prioritising Interest?
Exadata Benefits
• Extreme Performance
–10X 10X and more speedup for data warehousing
• Database Aware Storage– Smart Scans
• Massively Parallel Architecture– Dynamically Scalable to hundreds of cells– Linear Scaling of Data Bandwidth– Transaction/Job level Quality of Service
• Mission Critical Availability and Protection– Disaster recovery, backup, point-in-time recovery, data validation,
encryption
CustomCustom
• Complete Flexibility
• Any OS, any platform
• Easy fit into a company’s IT standards
• Documented best-practice configurations for data warehousing
Optimized WarehouseOptimized Warehouse
• Scalable systems pre-installed and pre-configured: ready to run out-of-the-box
• Highest performance
• Pre-installed and pre-configured
• Sold by Oracle
Reference ConfigurationsReference
ConfigurationsHP OracleDatabaseMachine
HP OracleDatabaseMachine
The HP Oracle Database MachineThe next step in DW Hardware Solutions
• Oracle.com:http://www.oracle.com/exadata
• Oracle Exadata Technology Portal on OTN: http://www.oracle.com/technology/products/bi/db/exadata
• Oracle Exadata white papers: http://www.oracle.com/technology/products/bi/db/exadata/pdf/exadata-technical-whitepaper.pdf
http://www.oracle.com/technology/products/bi/db/exadata/pdf/migration-to-exadata-whitepaper.pdf
Resources