leaders have vision™ visionsolutions.com 1 double-take ® share 5.0 technical overview...

Leaders Have Vision™ visionsolutions.com 1

Double-Take® SHARE 5.0Technical OverviewMulti-platform real-time change-data-capture

Last updated: February 8th 2012

GA October 2011


Change data capture (CDC) – data captured real-time

Column level selection – granular data selection

Data manipulation – flexible data transformation

Heterogeneous – multiple source/target DBMS/OS support

Semi-synchronous delivery – Fast and reliable delivery

Point-to-point architecture – proven to be most flexible architecture

Replication Schema Language (RSL) – flexible data management

Director - graphical modeling console

Enterprise Data Movement Model (EDMM) – replication schema

MonCon – graphical monitoring console

Request Scheduler - Automated data synchronization

Non intrusive – does not impact existing business applications

Source only licensing – affordable and flexible licensing model

No programming – eliminates the need for expensive custom code

Multiple Use – data integration, workload balancing,

audit databases, offload query, data warehouse loads

more..

Over 500 licenses sold to over 300 customers

Real-time DBMS level replication with transformation

Helps any DBA become a multi-DBMS expert

Double-Take® SHARE 5.0

Move data from where it is to where it needs to be…

DBMS = Database Management System


What Is Double-Take SHARE*(1) ?

eCommerce (web site)HP-UX Oracle

Back Office ERPIBM i, DB2/400

Customer OrdersPayment Details

Product CataloguePrice List

Data WarehouseWindows, SQL Server

Reporting databaseWindows, SQL Server

Sales data(all regions)

Regional sales data

DTS

DTSDTS

DTSDTS

Double-Take Share is an easy to use real-time, multi-platform change data replication tool.

Double-Take Share replicates columns in changed rows in real time between MS SQL Server, DB2/400, DB2/UDB, DB2/zOS, Oracle, Informix and Teradata.

Data columns can be easily mapped and transformed while replicated (no programming required).

This tool is typically used by development to greatly simplify internal projects that require real-time movement of data.

Examples of Double-Take Share Projects

APPLICATION INTEGRATION PROJECTAPPLICATION INTEGRATION PROJECT

DATA WAREHOUSE LOAD PROJECTDATA WAREHOUSE LOAD PROJECT

OFFLOAD QUERY & REPORTING PROJECTOFFLOAD QUERY & REPORTING PROJECT

*(1) Formerly known as Vision Replicate1


How Does Change Data Capture Work?

SourceData

XMLMetadata

TargetData

Kernel(Engine)

Kernel(Engine)

SourceMetabase

Replicationdata path

ChangeQueue

Copydata path

(periodic & initial synch)

Kernel(Engine)

Kernel(Engine)

Source Target

Listener(Agent)

Listener(Agent)

Administration & Monitoring(Director, MonCon & Console)

Listener(Agent)

Listener(Agent)

XMLMetadata

TargetMetabase

LAN / WAN

Data path

(Triggers/journals/logs)

(Triggers/journals/logs)

ChangeSelector

(Log Based)

ChangeSelector

(Log Based)

Change DataCapture (CDC)


Transforming Rows With Column Mappings

Field / column mappings

Customer numberCustomer name

Numeric (10)

Customer address line 1Customer address line 2

Alpha-numeric (10)Alpha-numeric (25)Alpha-numeric (25)

Customer address line 3Customer address line 4

Alpha-numeric (25)

Customer telephoneCustomer credit limit

Alpha-numeric (25)

Numeric (10)Numeric (10,2)

Customer address line 5 Alpha-numeric (25)

Column Name Data Type

Target Host - server connected to the TCP/IP network E.g. Windows server

Database ServerE.g. SQL Server

customer_master (SQL table)

CUNUM

CUNAM

Numeric (10)

CUAD1CUAD2

Alpha-numeric (20)Alpha-numeric (25)Alpha-numeric (25)

CUAD3CUAD4

Alpha-numeric (25)

CUTEL

CUCLM

Alpha-numeric (25)Numeric (10)

Numeric (10,2)

Field Name Data Type

Source Host - server connected to the TCP/IP network Eg. IBM i server

Database ServerE.g. DB2/400

CUSTPF (Physical file)

File / table mapping


Manipulating Data

Target Column ExpressionsFast way to specify simple and medium complexity data manipulations

Join TablesIt’s possible to join tables together and build a new table on the target.Eg. Join the invoice header table with the customer master table to get address columns

Replication Scripting Language (RSL)All data manipulations are stored in a easy to readscripting language, which can be exported, edited and imported for advanced manipulations by power users. Also a big time saver in sophisticated enterprise environments with lots of tables.


Double-Take Share Components & Monitoring

MonConThe monitoring and control interface is one of several ways to monitor the status of replication in real time. MonCon lets you do this locally through a graphical monitor. There is also WebMonCon that allows monitoring through a web browser.

EDMMAll data replication rules including data mappings and data manipulations are stored internally using a scripting language in an Enterprise Data Movement Model.


Flexible Replication Topologies

One Way

Two Way

Cascade

Bi-Directional

Distribute

Consolidate

Rep1Rep1

Rep1

Rep1

Rep1

Rep1


Supports Most Databases and Operating Systems

Double-Take SHARE

5.0

IBM i/OSV5R4 – V7R1

AIX 5.2 – 6.1Solaris 2.8 – 2.10

HPUX 11i – v3 64bit

Red Hat Rel 3 - 5

SuSe (x86) 9.2 - 10

z/OS 1.8 – 1.11

2000 - 2008 8i – 11g

Flat File target

12.5 – 15.x

2000 – 2008 (32 and 64 bit)

V2R6.2bf – V13bf

DS 9.x – DS 11.x

DB2/IBM I V5R3 – V7R1

DB2/ zOS 8.1 - 9

DB2 UDB 9.1 – 9.5


Name change from ‘Vision Replicate1’ to ‘Double-Take Share’

New Platform Support

Sybase 15.x

UDB 9.1 and 9.5

UDB 9.7 as target only

DB2 9 for z/OS

Informix 10.x and 11.x

Oracle Change Selector Performance

Now uses memory to reduce I/O

Change Selector rotating logs parameters

GA August 16th 2010

New parameters to control log rotation

Double-Take SHARE 4.0.8 New Features


Double-Take SHARE 5.0 New Features

Four Areas Of FocusSix* New Features

* Some of these can be broken down into more sub features

1. Performance

1.1 Log Based Capture For MS SQL Server 2008

2. Packaging and Documentation

2.1 Rebranding to Double-Take SHARE

3. Data Transformation

3.1 Expressions Now Support Unicode Data Type3.2 DB2/400 32K Character Length3.3 Ten Character Flat File Delimiters

4. RDBMs & Java

4.1 Java 6 Support

GA October 2011


BI-DIRECTIONAL APPLICATION INTEGRATIONBI-DIRECTIONAL APPLICATION INTEGRATION

Double-Take Share Customer StoryAGC Automotive

System iEnterprise

Unit

Shop Floor Unit

Windows SQL Server

Double-Take Share replicates data bi-directionally between the enterprise LPAR which runs Mapics and Future3 and the shop floor LPAR which runs in-house applications. This interface helps both business units know what the other is doing in real time

Machinery Unit 2

LPAR1

LPAR2

Double-Take Share replicates data bi-directionally between the in-house applications on System i and two MS SQL Server databases in two Machinery Units (in different buildings). Any product defects detected result in updates to the MS SQL Server databases and this data is replicated back to the shop floor database

AGC Automotive is a global company which mainly produces and sells automotive glass for new vehicles and aftermarket replacement glass

Machinery Unit 1


Customer Story – Millennium BCP - Luxembourg

1. Customers enter new banking transactions on line. They get captured in SQL Server

Microsoft SQL Server IBM System i DB2

Online Banking

APPLICATION INTEGRATION PROJECTAPPLICATION INTEGRATION PROJECT

2. Double-Take Share replicates the transactions in real time to DB2/400

3. A back-officebatch application processes incoming transactions and updates data.

4. Double-Take Share replicates the processed transactions back to SQL Server in real time.

1

2

3

4

5. Customers view processed transactions on-line

5

Bi-directional replication


Customer Story – Duke Realty - USA


Real Estate

Tip: Customer migrated from Integrator 2.1 and was impressed with the extra performance and functionality of Replicate1

Sample screen

IBM System i DB2 MS SQL Server 2005

Double-Take ShareReal time CDC replication

with transformation

Production System Data Warehouse System

Business intelligence


Customer Story – Pinnacle Entertainment Group - USA


Gaming

Casino 1

IBM System iDB2

Casino 2

IBM System iDB2

Casino 3

IBM System iDB2

Casino 4

IBM System iDB2

Casino 5

IBM System iDB2

Casino 6

IBM System iDB2

Single Data Warehouse DatabaseWindows 2003 ClusterMS SQL Server 2005

Customer loyaltyAmounts paidAmounts won

Time at the tableTime at the machine

Business intelligence


with transformation

Sample screen


Customer Story – Red Wing Shoe Company - USA

IBM System i DB2Lawson M3 (Movex)

OFFLOAD QUERY & REPORTING PROJECTOFFLOAD QUERY & REPORTING PROJECT

Manufacturing

MS SQL Server 2005

Query reports

Data Warehouse load


with transformation

Reduce CPU and I/O overheadon production system

improve user response times

Many cost effective tools available on MS SQL server

platform for query reports

Data is already partially‘scrubbed’ and available

for loading data warehousesand data marts withoutperformance impact on

production system

Production System Offload Query System


More Business Uses

• LOAD DATA WAREHOUSES - Extract data from different OLTP databases, scrub it and deliver it to the data warehouse platform, ready for loading.

• MIGRATE ERP DATABASES – Map current ERP schema to new ERP version or new ERP on same or different platform and migrate data without downtime.

• INTEGRATE APPLICATION COMPONENTS – Develop applications on different platforms and share data between them in real time.

• OFFLOAD QUERY – Create a Query database on a different partition or server or platform. Avoid running Query over production data, improves performance

• CREATE TEST DATA – Extract realistic test data from production to test environments.

• CREATE LIVE AUDIT DATABASES – Extract log of changes to critical database tables and create a live audit database.


Partial Customer List

• Dorel (Netherlands)• Disney Corporation (USA)• Milenium BCP (Luxembourg)• Alabama DOT (USA)• Anadigics (USA)• Ethan Allen (USA)• RCN Corporation (USA)• JD Irving (USA)• Reliant Insurance (USA)• Koopman International (Netherlands)• Compass Group (USA )• AIC Group of Funds (USA)• Cooley Godward (USA)• Georgia Pacific (USA)• Old Mutual (South Africa)• Johnson Matthey (UK) • Allianz (UK) • Leo Pharma (Denmark and Ireland) • Enstar Insurance (UK) • Red Fuel Cards (UK) • Rexel Electrical Supplies (UK) • Irish Dairy Board (Ireland)

• IBM Ecuador (Ecuador)• Insight Communications (USA)• JR Cigars (USA)• Kingston Technology (USA)• Mohawk Fine Paper (USA)• Massimo Zanetti Berverage (USA)• Northwest Natural Gas (USA)• Ryerson Coil (USA)• Parsons (USA)• Vanda Group (USA)• Vertex Business Systems (USA)• Duke Realty (USA)• EOG Resources (USA)• Belgium Ministry of Defense (Belgium)• Groupama Insurance (Spain) • Ecclesiastical Insurance (UK) • IFDS (UK)• iForce (UK)• La Repubblica (Italy) • Wyeth Nutritionals-Pfizer (Ireland)• MIO (Sweden)• ESAB (DK, UK, SE)• Tamro (Finland)


Thank you

leaders have vision™ visionsolutions.com 1 double-take ® share 5.0 technical overview...

Documents