oracle goldengate ogg

WWW.TRANSFER-SOLUTIONS.COM

SPREKER :

E-MAIL :

DATUM :

Oracle GoldenGateOracle's strategic solution for real time data integration

Jos van den Oord

[email protected]

29 november 2011

mailto:[email protected]

© COPYRIGHT TRANSFER SOLUTIONS B.V. 2

Who am I

Jos van den OordWorking with Oracle products since 1998

Working at Transfer-Solutions since 2010

InterestsDatabases

Right Availability

Security, Performance

Blog : joordsblog.vandenoord.eu

Email : [email protected]

© COPYRIGHT TRANSFER SOLUTIONS B.V.

Agenda

Introduction Oracle GoldenGate (OGG)GoldenGate Topologies

GoldenGate Intergration solutions

GoldenGate Products

Technology Overview GoldenGateSimple, Flexible Instantiation

GoldenGate Modular Building Blocks

GoldenGate Capture/Delivery

GoldenGate Checkpointing

Architecture Process Components

Demo GoldenGate

3


Introduction Oracle GoldenGate (OGG)

Oracle GoldenGate provides low-impact capture, routing, transformation, and delivery of transactional data across heterogeneous environments in real time

Oracle’s real-time data movement solution Data replication for heterogeneous databases

Real-time information feeds to Oracle BI/EPM

Zero-downtime migrations and upgrades to Oracle Database and Applications

4



GoldenGate Topologies

5

Unidirectional Bi-directional Peer to Peer

Broadcast Intergration / Consolidation

Cascading



6

Databases O/S and PlatformsCapture:

Oracle DB2 Microsoft SQL Server Sybase ASE Ingres Teradata Enscribe SQL/MP SQL/MX

Delivery: All listed above MySQL, HP Neoview, Netezza, and

any ODBC compatible databases ETL products JMS message queues

Windows 2000, 2003, XP

Linux

Sun Solaris

HP NonStop

HP-UX

HP TRU64

HP OpenVMS

IBM AIX

IBM z/OS



Heterogeneity Supports Afb Overview

7

Product / License Description

Oracle GoldenGate Includes GoldenGate Capture, Deliver, Active Data Guard and XStream

Oracle GoldenGate for Mainframe Includes GoldenGate Capture and Deliver for HP NonStop and IBM DB2 on z/OS

Oracle GoldenGate Veridata Add-on capability to validate data in replicated systems

Management Pack for GoldenGate Add-on management pack, includes Oracle GoldenGate Director

Oracle GoldenGate Adapters Pre-packaged application content, such as for Flat File and Java adapters


Technology Overview GoldenGate

OGG Modular Building Blocks

Database

LogsLog

sLog

s

Deliver

Delivery: Applies transactional data with guaranteed integrity

Trail FilesDeliver Capture

Trail Files

Bi-directional

Trail Files Trail Files

Trail files: Universal data format enables heterogeneity

Route: No Distance constraints via TCP/IP. Compression & encryption.

Capture

Database

LogsLog

sLog

s

Capture: Committed changes are captures ( and can be filtered) As they occur by reading the transaction logs

LAN/WANTCP/IP


LAN/WANTCP/IP


Simple, Flexible Instantiation Start Change Data Capture (CDC) Initial Snapshot Synchronization

9

Ongoing Data Synchronization

Initial Load

Database

Redolog

Capture DataPumpTrail Files

CollectorTrail Files

DatabaseDelivery



Oracle GoldenGate Capture

10



Oracle GoldenGate Delivery

11



GoldenGate Checkpointing

12

Current Read

Position

Data Pump Trail Files

-----------------

Begin TX2 Insert TX2 Commit TX2

Current

WritePosition

PUMPCheckpoint

Database

Delivery Database

-----------------

Current Read

Position

DeliveryCheckpoint

CaptureDatabase

Trail Files

-----------------

Begin TX1 Insert TX1 Begin TX2 Update TX1

Insert TX2 Commit TX2 Begin TX3

Insert TX3 Begin TX4 Commit TX3

Delete TX4



Current ReadPosition

Current WritePosition

CaptureCheckpoint

Start of Oldest Open (Uncommitted)Transaction


Architecture Process Components

13

Log-basedVAM-basedLocal/Remote QueuingFilteringParallel CoordinationLocal/Remote

CAPTURENative database APIODBCBatch OperationsFilteringTransaction/Operations GroupingParrallel CoodinationLocal/Remote

DELIVERY

FilteringLocal/RemoteTCP/IPCompressionEncryption

PUMPQueue (Trail) ManagementProcess Management (Dynamic)Monitoring and Administration (Lag report)Reporting (Events, Error, Tresholds)Receive/Route request from UI

Trail FilesCheckpoint files (Capture, Pump, Delivery)Configuration FilesDiscard filesReport/Log filesBinaries

On – disk Components

MANAGER


Demo

GoldenGate

Manager process

Extract process

DataPump Process

Replicat Process

Bi-Directional Replication

DDL Bi-Directional Replication

Extract /Replicat Filtering

Logdump

SQL statements van replicat

14


SPREKER :

E-MAIL :

DATUM :

Point of Interest for Oracle GoldenGateOracle's strategic solution for real time data integration

Jos van den Oord

[email protected]

29 november 2011

mailto:[email protected]


Point of Interest for Oracle GoldenGate•Understanding of

the business objectives

•Approved by your stakeholders?

•Understanding of the requirements?

•Appropriate replication topology

Requirements and Planning

16


Point of Interest for Oracle GoldenGate•Creating Dedicated

Users•Encrypting

Passwords•Creating a Dedicated

Installation Directory•Using a Checkpoint

Table•Verifying the

Character Sets•Developing Naming

Standards•Using a Data Pump

Installation and Setup

17


Point of Interest for Oracle GoldenGate•Using GGSCI Command

Shortcuts•Using OBEY Files•Generating Interim

Statistics•Using a Discard File•Reporting Regularly on

Process Health•Purging Old Trail Files

Regularly•Automatically Starting

Processes

Management and Monitoring

18


Point of Interest for Oracle GoldenGate•Running Performance

Tests•Limiting the Number of

Extracts•Using Passthru Mode

for Data Pumps•Using Parallel

Replicats•Using the Fastest

Available Storage•Tuning the Database

Performance

19

oracle goldengate ogg

Design

xstream oracle goldengate

oracle products

oracle database

oracle biepm

delivery of transactional

universal data format

active data guard

tx2insert tx2