hol pwx architecture
DESCRIPTION
HOL PWX ArchitectureTRANSCRIPT
![Page 1: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/1.jpg)
1
Dan SmithPrincipal Subject Matter Expert
May 2012
Informatica PowerExchange Architecture Overview
![Page 2: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/2.jpg)
2
Informatica PowerExchange
Batch Architecture Overview
![Page 3: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/3.jpg)
3
Operating Environment
PowerExchange
User Applications
Data Maps for Non-Relational Access
Informatica PowerExchangeBatch Architecture
DataRecordsSQL
Listener
Remote DataPackagedApplications
Mainframe andMid-Range
Relational andFlat Files
Standards andMessaging
Data Integration Platform PowerCenter
![Page 4: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/4.jpg)
4
Informatica PowerExchangeHow to Create Metadata…whatever your source
• A Datamap defines metadata• For non-relational databases, need to define metadata• Contains all information regarding the underlying dataset
• Created from existing information• VSAM – copybooks• IMS – DBDs, then overlay segment copybooks• ADABAS – FDT• IDMS - schemas
• Stored on the same platform as the data
• Not needed for relational sources
• Provides the information to convert an SQL statement to actual data base requests
![Page 5: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/5.jpg)
5
Operating Environment
PowerExchange
User Applications
Data Maps for Non-Relational Access
Informatica PowerExchangeDesign Time – Metadata Driven Approach
Listener
Remote DataPackagedApplications
Mainframe andMid-Range
Relational andFlat Files
Standards andMessaging
Data Integration Platform (Create Datamap) PowerExchange
PowerExchangeNavigator
MetadataRecords
MetadataRequest
Hand KeyDatabaseDefinitions
SchemasAdabasDefinitions
Copybooks
![Page 6: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/6.jpg)
6
Informatica PowerExchange“Row Test” the Data Map – Preview the data
`
![Page 7: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/7.jpg)
7
Informatica PowerExchange
Change Data Capture Architecture Overview
![Page 8: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/8.jpg)
8
Operating Environment
PowerExchangeData Maps for
Non-Relational Access
Informatica PowerExchange CDCDefining the Changes to be Extracted
Listener
Data Integration Platform (Create Datamap) PowerExchange
PowerExchangeNavigator
DataRecordsSQL
ExtractionDefinitions
CaptureRegistrations
Extract on definitions are based on capture registrations
![Page 9: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/9.jpg)
9
PowerExchange
Informatica PowerExchange CDCCapture-Once Deliver-Many
DataRecordsSQL
Listener
Data Integration Platform PowerCenter
Mainframe Mid-RangeADABASDATACOMDB2IDMSIMSVSAM
DB2/400OracleSQL ServerDB2 LUW
PowerExchange Listener
DataRecordsSQL
Physical VSAM Linear Datasets Database vendor - journal, archive, redo logs
Collector Collector
Published Interfaces
Change Stream/Logger
Change Stream/Logger
![Page 10: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/10.jpg)
10
Informatica PowerExchange CDCArchitecture for DB2 z/OS CDC
z/OS Environment
PowerExchange
DB2 SubSystem
Data Maps for special use cases
DataRecordsSQL
Listener
Data Integration Platform PowerCenter
Collector
Change Stream/Logger
AgentDB2 z/OS DB2
Logs
IFI 306(z/OS)
1. PowerExchangecollects changes
2. Changed data persisted in change stream
3. PowerCenter issues standard SQL request
4. PowerExchange sends changed data records to PowerCenter
![Page 11: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/11.jpg)
11
Informatica PowerExchange CDCArchitecture for DB2 i5/OS CDC
I5/OS Environment
PowerExchange
DB2 SubSystem
Data Maps for special use cases
DataRecordsSQL
Listener
Data Integration Platform PowerCenter
Journal Reader
DB2 i5/OS Journals
Journaling(i5/OS)
![Page 12: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/12.jpg)
12
Informatica PowerExchange CDCArchitecture for DB2 LUW CDC
Linux, UNIX, or Windows Environment
PowerExchange
DB2 Instance
Data Maps for special use cases
DataRecordsSQL
Listener
Data Integration Platform PowerCenter
Collector
VirtualChange StreamDB2 LUW Archive
LogsLogReadAPI
![Page 13: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/13.jpg)
13
Informatica PowerExchange CDCArchitecture for SQL Server CDC
Windows Environment
PowerExchange
SQL Server
Data Maps for special use cases
DataRecordsSQL
Listener
Data Integration Platform PowerCenter
Collector
VirtualChange StreamSQL Server
DatabaseSQL ServerDistribution DB
SQL query
![Page 14: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/14.jpg)
14
Informatica PowerExchange CDCArchitecture for PWX Oracle LogMiner CDC
Linux, UNIX, Windows, or z/Linux Environment
PowerExchange
Oracle Instance
Data Maps for special use cases
DataRecordsSQL
Listener
Data Integration Platform PowerCenter
Collector/PWXCCL
Change Stream
Oracle OracleLogs
LogMiner1. Oracle collects and persists changes in Redo Logs
2. PowerExchange issues LogMinerrequest
4. PowerCenter issues standard SQL request
5. PowerExchange sends changed data records to PowerCenter
3. Changed data persisted in change stream
![Page 15: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/15.jpg)
15
Informatica PowerExchange CDCArchitecture for PWX Express Oracle CDC
Linux, UNIX, Windows, or z/Linux Environment
PowerExchange
Oracle Instance
Data Maps for special use cases
DataRecordsSQL
Listener
Data Integration Platform PowerCenter
Collector/PWXCCL
Change Stream
Oracle OracleLogs
Express Log Reader
1. Oracle collects and persists changes in Redo Logs
2. PWX Express Log Reader captures changes
4. PowerCenter issues standard SQL request
5. PowerExchange sends changed data records to PowerCenter
3. Changed data persisted in change stream
![Page 16: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/16.jpg)
16
Informatica PowerExchange CDCArchitecture for Mainframe VSAM CDC (Batch or CICS)
Mainframe Environment
PowerExchange
Batch or CICS
Data Maps for Non-Relational Access
DataRecordsSQL
Listener
Data Integration Platform PowerCenter
Collector
Change StreamVSAM
1.PowerExchange collects changes
2. Changed data persisted in change stream
3. PowerCenter issues standard SQL request
4. PowerExchange sends changed data records to PowerCenter
JRNAD Exit (Batch)File/User Exits (CICS)
Agent
![Page 17: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/17.jpg)
17
Informatica PowerExchange CDCArchitecture for Mainframe IMS Synchronous CDC
Mainframe Environment
PowerExchange
Batch or Online IMS
Data Maps for Non-Relational Access
DataRecordsSQL
Listener
Data Integration Platform PowerCenter
PWXLibraries
Change Stream
AgentDLI Job orDBCTL
COLLECTOR OPERATES IN Address Space of Batch DLI JobOr IMS Control Region
![Page 18: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/18.jpg)
18
Informatica PowerExchange CDCArchitecture for Mainframe IMS Log-Based CDC
Mainframe Environment
PowerExchange
Batch or Online IMS
Data Maps for Non-Relational Access
DataRecordsSQL
Listener
Data Integration Platform PowerCenter
Collector
Change Stream Agent
DLI Job orDBCTL
ArchivedLogs
Recons
![Page 19: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/19.jpg)
19
Informatica PowerExchange CDCArchitecture for Mainframe ADABAS CDC
Mainframe Environment
PowerExchange
ADABAS
Data Maps for Non-Relational Access
DataRecordsSQL
Listener
Data Integration Platform PowerCenter
Collector
Change Stream Agent
ADABASNucleus
ActivePLOGs
ADABASUser Exit 2
ADABASPLOGs
ActivePLOGs
![Page 20: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/20.jpg)
20
Informatica PowerExchange CDCArchitecture for Mainframe Datacom Synchronous CDC
Mainframe Environment
PowerExchange
Datacom
DataRecordsSQL
Listener
Data Integration Platform PowerCenter
ChangeController
Change Stream
AgentDatacomMUF
ECSA
ChangeCollectorSubtask Data Maps for
Non-Relational Access
![Page 21: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/21.jpg)
21
Informatica PowerExchange CDCArchitecture for Mainframe Datacom Table-Based CDC
Mainframe Environment
PowerExchange
Datacom
Data Maps for Non-Relational Access
DataRecordsSQL
Listener
Data Integration Platform PowerCenter
Collector
Change Stream Agent
TSN Table
DatacomMUF
MNT Table
![Page 22: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/22.jpg)
22
Informatica PowerExchange CDCArchitecture for Mainframe IDMS Log-Based CDC
Mainframe Environment
PowerExchange
Batch or Online IDMS
Data Maps for Non-Relational Access
DataRecordsSQL
Listener
Data Integration Platform PowerCenter
Collector
Change Stream Agent
IDMSCV
IDMSJournalSwitch
Journal Write Process
IDMS Journal
![Page 23: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/23.jpg)
23
Informatica PowerExchangeSupported Sources & Targets
Informatica Batch CDC
IMS R/W Y
VSAM R/W Y
DB2 z/OS R/W Y
ADABAS R/W Y
IDMS R Y
Datacom/DB R Y
DB2 i5/OS R/W Y
Oracle R/W Y
SQL Server R/W Y
DB2 LUW R/W Y
![Page 24: HOL PWX Architecture](https://reader034.vdocuments.us/reader034/viewer/2022042502/552d097c4a795955648b45cb/html5/thumbnails/24.jpg)
24