oracle goldengate, streams, and data integrator
Post on 14-Apr-2017
6.355 Views
Preview:
TRANSCRIPT
<Insert Picture Here>
Oracle GoldenGate, Streams, & Oracle Data IntegratorFumiko Yamashita
Safe Harbor Statement: The views expressed on this presentation are my own and do not necessarily reflect the views of Oracle. The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making a purchasing decision. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
Comparing GoldenGate & Streams
2
GoldenGate is Oracle’s strategic replication solution
• Requires API based stored DB packages• Works with Oracle Database• Few large references• Problem scaling in high-throughput
environments
Oracle Streams
• Out-of-the-box flexible solutions• Broad heterogeneous support• Excellent reference base• High performance in high
transactional environment• Reliable architecture
Oracle GoldenGate
GoldenGate’s Advantage:• Better ROI overall: GoldenGate is lower cost to implement and maintain• Enterprise-wide solution: GoldenGate easily expands to new use cases• Reliability, flexibility, high performance: GoldenGate surpasses other technologies
Streams continues to be a supported Oracle Database feature
Internal Only
Comparing GoldenGate, Data Guard & Streams GoldenGate: Upgrading or Migrating from Oracle Database 8i/9i to 10g/11g
3GoldenGate_WhitePaper_Oracle8i9ito10g11g.pdf
3.1 GoldenGate’s Technology for Transactional Data Management….Aside from the differentiating ability of GoldenGate to handle heterogeneous database environments, readers familiar with Oracle data movement technologies may ruminate on the perceived resemblance between Oracle Streams and GoldenGate. This collation, however, is purely conceptual. The underlying architectures are significantly different. For example, Streams in Oracle 9i has problems scaling in high-throughput environments. In addition, it is limited in its support for data types (e.g. LONG) and for certain kernel functionality (e.g. log_parallelism). These issues are not present in GoldenGate’s platform.….6.6 Oracle Data Guard, Oracle StreamsThe above two solutions do not support a rolling upgrade from 8i or 9i to 10g or 11g. For 10g to 11g upgrades you can use a physical standby configuration but you have to use transient logical standby during the upgrade process. In addition, during the upgrade process the standby system will not be available for failover. Please note that there are some limitations with using logical standby particularly with data types.
Oracle GoldenGate/ODI Use Cases & Demo CoverageEnterprise-wide Solution for Real Time Data Needs
Log Based, Real-Time Change Data Capture
Heterogeneous Source Systems
EDWODS
EDW
Disaster Recovery, Data Protection
Zero Downtime Migration and Upgrades
Operational Reporting
Real-time BI
Standby(Open & Active)
ReportingDatabase
OGG
ODI/ETL
ODI/ETL
Query Offloading
Data Distribution
OGG: Oracle GoldenGate ODS: Operational Data Store TCO: Total cost of ownership BI: Business IntelligenceODI: Oracle Data Integrator EDW: Enterprise Data Warehouse ROI: Return of investment ETL: Extract-Transform-Load Tool
1Continuous Availability(OGG)
2Real-time OR/BI (ODI/OGG)
3Lower IT Cost(OGG)
SOA Integration /Web Services (ODI/OGG)
5
EMP
Oracle Real Time Data IntegrationOracle’s Unique Offering for Real Time Business Intelligence
OracleGoldenGate
ODI
EMP DEPT
DIM
FACT
DIM
DIMDIM
ODS Schema DW Schema
On-Disk Logs
Source 1
On-Disk Logs
Source 2
OracleGoldenGate
1 2Oracle GoldenGate• Real time CDC extracts from
transactional systems• Non-invasive on sources
• Continuous streaming load into ODS Schema of target
• Latency in seconds• Maintains transactional integrity
• Ensures data integrity and reliability
ODI - ETL Tool• Periodic mini-batches• Transform in the Database• Never go back to sources
EMP DEPT
DEPT
Benefit• Improves business insight• Combines intelligence on current business status with historical context• Eliminates load on source systems • Reduces latencies and batch windows
Operational Financial Billing
System on Oracle DB
Data Warehouse on Sybase
6
Oracle Data Movement & Transformation Products per Solution
GoldenGate
Active Data Guard
Data Inte-grator
ODI Data Quality/ Profiling
Continuous Availability
Disaster Recovery / Data Protection
Data Distribution / Synchronization
Zero Downtime Migrations / Upgrades
Query Offloading
Grid & Scalability (Oracle RAC)
Data Integration
Operational Reporting
Real Time BI
Typical Data Warehouse
Data Integration for SOA
Migrating Between Different Apps
Oracle Any DB
Any DB
Oracleto Oracle
Hetero-geneous
Oracle Data IntegratorBased on Technology Foundation from
Data Movement and Transformation from Multiple Sources to Heterogeneous Targets
B E N E F I T D I F F E R E N T I A T O R
1 Best Performance Heterogeneous “E-LT”
2 Productivity Declarative Design
3 Real-time Integration Declarative CDC
4 Hot-Pluggable Knowledge Modules
5 Future ProofThe Chosen Integration Technology of Fusion
Use Cases for Oracle Data Integrator
SOA Initiatives• Establish Messaging Architecture for Integration• Incorporate Efficient Bulk Data Processing with ODI
E-LT for Data Warehouse• Create Data Warehouse for Business Intelligence• Populate Warehouse with High Performance ODI
Modernization• Mainframe / iSeries sources to Oracle RAC• Re-architect legacy batch processing to SOA and
ODI
Migrations• Upgrade Applications or Migrate to New Schema• Move Bulk Data Once and Keep in Sync with ODI
Application Integration• Bulk-load historical data to new application• Synchronize new and old applications during overlap
time• Complex transformations, CDC
Master Data Management• Create Single View of the Truth• Synchronize Data with ODI
St. James BBQ & Pool SvcJohn St. James III42 Ridge St, #5St. Louis5551234
Saint James Barbeque and Pool ServiceJonathan St. James III42 Ridge Street. NW, #5St. Louis, MO 63119314-555-1234
CLEANSE
WG IK 113 OHM .15W1%RESWG ik 113OHM1/8W1/8WATT IK @113O 1%ik widg 113Ohm @.15-1Widget ik – 113OMax 113o 1/8w-1%RES
6 Matching Products, each record is identical: Product: Widget IK Power: .15 Watt Resistance: 113 Ohm Tolerance: 1%
CLEANSE
Product Data Quality
Customer Data Quality
DATA QUALITY PROVIDES•Profiling - Discover and assess data quality •Cleansing – Common Data Typos•Matching – Eliminate Duplicates•Parsing – Unstructured Tokens•Standardization – Common Formats
• Supply Chain - Accurate inventory data & improved collaboration with third-parties• Customers Service - Improved CS with complete and accurate CRM information• Marketing / Sales - Better understanding of customer behavior, Accurate insight into
sales efficiency, New cross-selling opportunities enablement• Decision Makers - Take decisions on trustworthy data and accurate KPI, Discover
new business opportunities
BENEFITS FOR THE BUSINESS USERS
Oracle Data Quality and ProfilingJoint Development with Trillium
Energy/Industrial Insurance / Health Retail Other
Communications Finance / Banking Media Services
Oracle Data Integrator Customers
top related