edr concepts & facilities january 2012
TRANSCRIPT
-
8/12/2019 EDR Concepts & Facilities January 2012
1/26
EDR Concepts & Facilities
(c) E-Net 2012
January 2012
Information all day, every day.
Enterprise Data Replicator
Concepts and Facilities
2
Total Application Resilience
E-Nets Enterprise Data Replicator sets the newstandard in database application availability. EDRprovides replication and propagation solutionsdesigned specifically for real-world applications.
Your applications: High-value. High-volume. Criticalsystems which have the ultimate availabilityrequirements. Not 99%. Not 99.99999%......Systemsthat require 100% uptime.
EDR provides industrial-strength real-time peer-to-peer replication you can deploy with confidence.
If you have an application which absolutely mustbe available at all times, you should considerEDR.
-
8/12/2019 EDR Concepts & Facilities January 2012
2/26
EDR Concepts & Facilities
(c) E-Net 2012
3
EDR: Solutions
VENDOR EXPERIENCE
EDR builds on E-Nets twenty-five years of experience withmainframe database replication and offsite recovery solutions, forboth continuous availability and disaster recovery applications.
LEAN & CLEAN ARCHITECTURE
EDR uses a completely new and redesigned software architectureexploiting todays best practices in development and qualityassurance. It provides the leanest and cleanesthigh-end datareplication capability.
EXTENDED DISTANCE
EDR addresses todays and tomorrows demands for completely
available and responsive mainframe database applications acrosspotentially many nodes, distributed across the globe, separated bythousands of miles.
4
EDR: Solutions
GOES BEYOND MIRRORING
EDR goes well beyond the capabilities of any hardware mirroringapproach, which are by design uni-directional. EDR does notrequire any proprietary hardware
NETWORK COMPATABILITY
EDR fully exploits todays and tomorrows network configurationsand topologies, with full TCP/IP and Websphere MQ support(future)
BULLET-PROOF
EDR automatically recovers from unforeseen system outages,abends and operational errors with no impact on users
EASE OF OPERATION
EDR is easily maintained and operated, enabling true 100%continuous operation 24 by 7 by 365. Your applications arealways up. Your information is available all day every day
-
8/12/2019 EDR Concepts & Facilities January 2012
3/26
EDR Concepts & Facilities
(c) E-Net 2012
5
Business RequirementsScenario A Replication
One site normally handles update workload, butswitch-over to backup site is instantaneous
All sites have Referential Integrity, Triggers, StoredProcedures, etc.
Backup site is ready to go at all times.
Switch-back to original primary site is fast and simple
Load balancing
Inquiry transactions and other read-only work can usebackup copy
Handles both scheduled and unscheduled outageswith identical operational procedures
6
Replication Scenario ASwitch-over & Switch-back
Normal Operations
Site 1 Site 2 Changes from Site 1 arecontinually applied to replicadatabase at Site 2
Database at Site 2 availablefor read-only queries/reports
Switch-over
Fail-over
Database at Site 1 unavailable replica database at Site 2becomes the productiondatabase instantaneously!
PROD
PROD
Catch-up PhaseUpdates which occurred atSite 2 are applied to originalproduction database at Site 1PROD
Switch-back
Fail-backReturn to normal operationscompletePROD
PROD?
-
8/12/2019 EDR Concepts & Facilities January 2012
4/26
EDR Concepts & Facilities
(c) E-Net 2012
7
Business RequirementsScenario B Peer-to-Peer Replication
Multiple sites simultaneously handling updateworkload
Virtual Data Center concept
Enables unrestricted load balancing across multiplesites
A given user may be normally assigned to his/herpreferred site but can be immediately redirected to analternate site when preferred site is not available
Need to resolve logical collisions which are possibledue to involvement by multiple commit managers
All sites have Referential Integrity, Triggers, StoredProcedures
8
Peer-to-Peer Scenario BMultiple Update Locations
East Coast
West Coast Central
-
8/12/2019 EDR Concepts & Facilities January 2012
5/26
EDR Concepts & Facilities
(c) E-Net 2012
9
EDR: Peer-to-Peer Scenario B:ber-application layer
Data Center A
Application
DB2 for z/OS
EDR
Data Center C
Application
DB2 for z/OS
EDR
Data Center B
Application
DB2 for z/OS
EDR
ber-application layer
10
Enterprise Data Replicator - Goals
Reliability The cornerstone to E-Net's ongoing success is reliability -
guaranteed data movement from DB2 to DB2 without compromisingdata integrity or the operating system environment. In the world ofcontinuous availability the ability to recover from abends orunforeseen system outages must have no impact on the users ofthe system.
Performance Reliability is of utmost importance; however, of equal concern is
performance. As the performance leanness of the E-Net Log Apply
engine has always been acknowledged by our customers, it is a keygoal for EDR. E-Net designed and implemented EDR based onyears of experience handling real-world applications having bothhigh transaction rates and large databases.
-
8/12/2019 EDR Concepts & Facilities January 2012
6/26
EDR Concepts & Facilities
(c) E-Net 2012
11
Enterprise Data Replicator - Goals
Flexibility EDRs engine is structured and flexible enough to take advantages
of any new or improved features for any DB2 version. An examplewould be the ability to adapt to a new DB2 data type.
Maintainability EDR is easily maintained and by design anticipates true continuous
operations (24 by 7). EDRs engine is able to switch betweensoftware levels without impacting current users of the system. Inaddition EDR is software back level tolerant. This means that itpermits different versions of the engine to execute concurrently withno impact to users. The engine itself contains easily distributableand maintainable modules implemented and architected by design.
Compatibility Compatibility with the existing versions, and future versions of DB2and other DBMS products are a must. Downward compatibilitybetween and among versions of EDR is also supported.
12
EDR OCEAN and OAR Architecture
EDR: OCEAN
Open CommunicationsEnvironment Across Networks
EDR: OAR
Open Architecture Replication
User interface
3270
Web client
-
8/12/2019 EDR Concepts & Facilities January 2012
7/26
EDR Concepts & Facilities
(c) E-Net 2012
13
EDR: OCEAN - Features
TCP/IP or MQ communications layer Native TCP/IP support
Supports dynamic VIPA
Websphere MQ Series support Use non-persistent queues for performance Support for Websphere MQ Series not yet available, no customer
demand
Client/server user interface architecture XML-like packages
Standard web app (browser) interface
Also providing 3270 (green screen) support via TSO
Extensible and customizable user interface Batch APIs for UI functions
14
EDR: OCEAN Topology
-
8/12/2019 EDR Concepts & Facilities January 2012
8/26
EDR Concepts & Facilities
(c) E-Net 2012
15
EDR: OCEAN Configurations
16
EDR: OARs
o OAR/DB2
o Basic capture and apply propagation engine
o OAR/Web
o Supports web clients
o Administration, operations, performance management
o OAR/Synco Populates target tables from source
o OAR/Security
o Comprehensive control of all resources, via external interface
-
8/12/2019 EDR Concepts & Facilities January 2012
9/26
EDR Concepts & Facilities
(c) E-Net 2012
17
EDR: OAR/DB2 - Features
Real-time DB2 replication Exploits DB2 Change Data Capture
Uses efficient push log capture technology
Peer-to-peer support Effective for both Scenario A and Scenario B deployments
Highly automated operation Fully dynamic and automatic activation for new objects
Ability to tolerate DDL changes at source site with no outage attarget
Data sharing support at both source and target
Enables true parallelism exploitation
Supports LOBs
External Security Interface for RACF, CA-Top Secret, CA-ACF2
18
EDR: OAR/DB2 - Features
Full DB2 Version 8 and Version 9 exploitation Supports variety of migration strategies
Different levels of DB2 supported within a sphere
New DB2 V9 data types and Reorder Row Format (RRF)
Highly efficient parallel apply mechanism Lean and Clean
Partition-level apply for partitioned table spaces
Specially-designed exploitation of static and dynamic SQL toapply changes at a target location
Support for referential integrity (RI), triggers andstored procedures
No requirement for a unique index on target object
Ability to handle long running URs
Customizable conflict resolution
-
8/12/2019 EDR Concepts & Facilities January 2012
10/26
EDR Concepts & Facilities
(c) E-Net 2012
19
OAR/DB2 Capture, Apply & User Interface
OAR/DB2Apply
OAR/DB2Capture
DB2for z/OS
OAR/DB2
Apply
OAR/DB2
Capture
DB2for z/OS
OAR/DB2Apply
OAR/DB2Capture
DB2for z/OS
Ocean AOcean C
Ocean BUser interface
20
EDR: OAR for DB2
OAR/DB2Capture
OAR/DB2Apply
-
8/12/2019 EDR Concepts & Facilities January 2012
11/26
EDR Concepts & Facilities
(c) E-Net 2012
21
EDR: OAR/DB2 Restart/Reconnect
22
EDR: OAR/DB2 DB2 Restart
-
8/12/2019 EDR Concepts & Facilities January 2012
12/26
EDR Concepts & Facilities
(c) E-Net 2012
23
EDR: OAR/DB2 Data Sharing - 1
24
EDR: OAR/DB2 Data Sharing - 2
-
8/12/2019 EDR Concepts & Facilities January 2012
13/26
EDR Concepts & Facilities
(c) E-Net 2012
25
EDR: OAR/DB2 RRP Sample 1
26
EDR: OAR/DB2 RRP Sample 2
-
8/12/2019 EDR Concepts & Facilities January 2012
14/26
EDR Concepts & Facilities
(c) E-Net 2012
27
EDR: OAR/DB2 RRP Sample 3
28
EDR: OAR/DB2 RRP Sample 4
-
8/12/2019 EDR Concepts & Facilities January 2012
15/26
EDR Concepts & Facilities
(c) E-Net 2012
EDR: OAR/Web Sample 1
29
30
EDR: OAR/Web Sample 2
-
8/12/2019 EDR Concepts & Facilities January 2012
16/26
EDR Concepts & Facilities
(c) E-Net 2012
EDR: OAR/Web Sample 3
31
EDR: OAR/Web Sample 4
32
-
8/12/2019 EDR Concepts & Facilities January 2012
17/26
EDR Concepts & Facilities
(c) E-Net 2012
33
EDR: OAR/DB2 RO Sets
> Synchronizationand apply are doneat the RO Set level
> Insures integrityamong relatedobjects
34
EDR: Logical Sync Feature
Source
Database
Target
Database
OAR/DB2
OCEAN A
OAR/DB2
OCEAN B
Logical Sync Logical Sync
Facilitates cross-site copying (synchronization)
Typically used to populate target from source Fully automated
Fully integrated with OAR for DB2 Capture/Apply
Requires no outage of any kind
Uses highly ef ficient TCP/IP communications
Optional use of DSNUTILS at target DB2 for loading data
Supports Synchronization of Related Objects (RO Sets)
-
8/12/2019 EDR Concepts & Facilities January 2012
18/26
EDR Concepts & Facilities
(c) E-Net 2012
35
EDR: Physical Sync Feature
Source
Database
Image Copy
Target
Database
OAR/DB2
OCEAN A
OAR/DB2
OCEAN B
EDR transmits image copy or
customer can manage FTP
Standard DB2
Image Copy Utility
DSN1COPY
Import Process
Physical Sync Physical Sync
Image Copy
36
EDR: Logical Audit Feature
Database
Copy 1Database
Copy 2
OAR/DB2
OCEAN A
OAR/DB2
OCEAN B
Logical Audit Logical Audit
Permits non-disruptive comparison of copies
Fully automated
Requires no outage of any kind at either site
Examines tables row-by-row at consistent points in time
Checksums used to validate that data is in sync
-
8/12/2019 EDR Concepts & Facilities January 2012
19/26
EDR Concepts & Facilities
(c) E-Net 2012
37
Conflict Detection & Resolution
Detection Level One - SQL Error
Types of resolution: Stop on Any SQL error
Able to automatically resolve Row not found (+100) and Duplicate(-803) SQL errors
Ignore but report error
Advantages Minimal overhead
Can assure data consistency in peer to peer unidirectional updateenvironment
Disadvantages
Cannot detect all types of conflicts Updates may be lost due to undetected conflicts
Conflict Detection & Resolution
Detection Level Two - Content Based
Read/select done before update of a given row
Types of resolution: Stop on any conflict or SQL error
May pass conflict or SQL error to an object related user definedexit for resolution
Advantages Detects all conflicts
User control of conflict or SQL error
Disadvantages Increased CPU and bandwidth overhead
Unable to resolve conflicts at the column level
Risk of user exit ABEND if not coded properly
38
-
8/12/2019 EDR Concepts & Facilities January 2012
20/26
EDR Concepts & Facilities
(c) E-Net 2012
39
EDR: DB2 Log Capture
Multiple log capture techniques increasing flexibility
Generally preferred technique: DB2 IFI
Instrumentation Facility Interface
DB2 presents change information on objects identified by EDR
Exploits log merge capability in parallel sysplex data sharingconfigurations
Alternative Technique: log capture exit
Used successfully by E-Nets RRDF product
Minimal overhead
Alternative Technique: direct reads against DB2 active logdata sets
Access to log archives via BSDS
40
EDR: DB2 Log Capture via Exit
Uses standardDB2 log captureinterface DSNJL004
Runs in SRBmode
Highly efficientpush interface
No I/O performed
-
8/12/2019 EDR Concepts & Facilities January 2012
21/26
EDR Concepts & Facilities
(c) E-Net 2012
41
EDR: DB2 Log Deconstruction
42
EDR: Transmit toTarget Nodes
-
8/12/2019 EDR Concepts & Facilities January 2012
22/26
EDR Concepts & Facilities
(c) E-Net 2012
43
EDR: OAR/DB2 Merge Process
44
EDR: OAR/DB2 Statistics & Monitoring
Feature
-
8/12/2019 EDR Concepts & Facilities January 2012
23/26
EDR Concepts & Facilities
(c) E-Net 2012
EDR: OAR/Web Statistics &Monitoring Feature for OAR/DB2
45
EDR: OAR/Security
The OAR/Security allows for other EDR OARs tocheck for resource authorization via external securitypackages like RACF, CA-Top Secret, or CAACF2
For TSO user id is collected from the TSO address space
For Batch user id is collected from the batch address space
For WEB a sign on screen is presented to the client
OAR for DB2 resources
OAR/DB2 access
OAR/DB2 menu access
OAR/DB2 database access/update
46
-
8/12/2019 EDR Concepts & Facilities January 2012
24/26
EDR Concepts & Facilities
(c) E-Net 2012
47
EDR: Debugging Feature
EDR: Performance and Tuning
EDR will dynamically tune itself based on theenvironment
TCP/IP bandwidth and target data acceptance rates aredetermined, and source deconstruction is throttledaccordingly.
TCP/IP buffering for EDR may be changed bySETSOCKOPT TCP/IP API to maximize communicationperformance.
EDR allows for manual intervention.
Operator commands are available to throttle log deconstructrates.
User Interface allows for the dynamic setting of internal timerintervals and some parameter settings.
48
-
8/12/2019 EDR Concepts & Facilities January 2012
25/26
EDR Concepts & Facilities
(c) E-Net 2012
EDR: Messaging and Alerts
All messages from EDR are formed in a standard z/OS formatand are written to a SYSOUT DD statement called SYSTERM.
Example:EDR1804I 3910 00480 DSTARGET Originalsource code generated for GBC10D86
EDR1804I is the message number
Last character ( I ) represents the message severity:
I Informational
W Warning
S Severe
Messages may be found in QuickRef
Severe level messages are also written to the system console foruse by automation products
Customer may state in input file to exclude or include messagesto be written to console and/or SYSTERM.
49
50
EDR: Data Sharing Configuration
Scenario B - True Peer-to-Peer ReplicationBoth Sites Support Updates Simultaneously
Site 1 Data Sharing GroupParallel Sysplex
Site 2 Data Sharing GroupParallel Sysplex
DB2 SubsystemMember #1
DB2 SubsystemMember #2
DB2 SubsystemMember #3
EDR OCEANCapture Only
EDR OCEANCapture
Merge/Apply
EDR OCEANCapture Only
EDR OCEANCapture
Merge/Apply
DB2 SubsystemMember #1
DB2 SubsystemMember #2
DB2 SubsystemMember #3
EDR OCEANCapture Only
EDR OCEANCapture Only
Production Update SiteProduction Update Site
-
8/12/2019 EDR Concepts & Facilities January 2012
26/26
EDR Concepts & Facilities
Specialty Engine Exploitation
Exploitation of IBM's System z Integrated InformationProcessor (zIIP)
Approximately 70% of EDR CPU overhead eligiblefor dispatch on zIIP
Using approved API via partnership with IBM
51
EDR: Real time. Peer-to-peer.100% Availability.
High performance, rock solid middleware for DB2replication and change propagation
Flexible and resilient architecture capable of furtheradaptation and evolution
Backed by experienced vendor and responsivetechnical support
Advanced technology from E-Net Corporation, the
leader in replication and recovery solutions. For further information, see contact information on
our website at http://www.enet.com
Questions?
52