Download - Informatica PowerExchange
1
Informatica PowerExchange Update
Q2 2010
Tim Wong
Alliances Sales Consultant Director
2
Agenda
• Informatica V9 Architecture Review
• PowerExchange Mainframe Update
• Why PowerExchange?
• Architecture Overview
• Interfacing With PowerCenter
• Relational Database Management Systems: Real Time and Application Connectors
• PWX Roadmap
• Customer Examples
• Q & A Session
3
The Informatica v9 Platform ArchitectureComprehensive, Unified, Open, Economical
Supporting the complete data
integration lifecycle
Enabling any data integration project
Delivering at any latency
Accessing data from any source
Mitigating risk by working with what you have now and
in the future
Open Economical
Maximizing productivity with
Role based collaboration,
Shared services
Consistent interfaces
Low Total Cost of Ownership (TCO)
Fast Return on Investment (ROI)
UnifiedComprehensive
4
PowerExchange Mainframe Update
Q2 2010
Scott Hagan
Senior Product Manager
Diane Ditrick
Technical Manager
5
Myths/Lies and Realities
• The Mainframe is dead (1980’s and 1990’s)
• The Mainframe will be gone by Y2K
• We are migrating to Oracle
• We are migrating to DB2
• We are migrating to SQL Server
• We have SAP, PeopleSoft, and 12 other packages
• Today, we have a real mess on our hands….
6
Analyst Comments
• Over 80% of the world’s corporate and government data resides on mainframes.
• According to IBM, $5 trillion worth of business assets are housed on IBM mainframes.
• Nearly 95% of Fortune 1000 companies use IBM’s Information Management System (IMS) for their critical data management needs.
• More than 50 billion transactions are running through IMS databases on a daily basis.
7
Analyst Comments
• Unix and Windows are losing ground, albeit for different reasons. (Forrester)
• Linux is the big winner.
• IBM's System z platform is growing, not declining. (Gartner)
• IBM has generated mainframe revenue growth in five out of the past seven quarters and million instructions per second (MIPs) growth in eight out of the past 10 quarters.
• Specialty engines that attract new application workloads
• A strong and growing community of independent software vendors (ISVs).
• Strategy to attract new skills to the mainframe platform, including University programs.
• Significantly increased systems capacity
• A major increase in performance thanks to new architectural features. (Forrester)
• IBM has launched an enormous campaign to incent SUN & HP Server customers to migrate back to the Mainframe (z/Linux) (IBM)
8
Why the Mainframe Today?
9
The Informatica PlatformComprehensive To Automate The Entire Data Integration Lifecycle
Informatica On Demand
Improve Decisions &RegulatoryCompliance
ModernizeBusiness & Reduce IT
Costs
FacilitateMergers &
Acquisitions
Improve Customer Service &
Operational Efficiency
OutsourceNon-coreFunctions
IncreasePartner network
Efficiency
Cloud Data Integration B2B Data Exchange
Data Quality Across the Whole Enterprise
Enterprise Data Integration
Application ILM
10
The Informatica PlatformComprehensive To Automate The Entire Data Integration Lifecycle
Informatica On Demand
Improve Decisions &RegulatoryCompliance
ModernizeBusiness & Reduce IT
Costs
FacilitateMergers &
Acquisitions
Improve Customer Service &
Operational Efficiency
OutsourceNon-coreFunctions
IncreasePartner network
Efficiency
Cloud Data Integration B2B Data Exchange
Data Quality Across the Whole Enterprise
Enterprise Data Integration
Application ILM
Without Access what is going to work?
11
Why PowerExchange?
12
Change Capture Approaches to Date
• Add timestamps through reverse engineering
• User exits that interrupt transaction streams
• Add triggers that impact application performance
• Full file compares to determine deltas
• Home grown solutions technically challenging
All disruptive, all programming centric!
13
Traditional Methods
• Innovation restricted by cost, complexity and time
• Not a repeatable, scalable solution
• Requires specialist skills to complete the task
• Potential failure points at every step along the way
Extract Translate Move Load
Program Extractfrom one or more sources
Filter, ASCIIEBCDIC
conversion
Transportdata acrossplatforms
Load datato target
Database
SourceData
TargetDatabase
14
PowerExchange Approach
Data is extracted using SQL, converted (EBCDIC/ASCII), filtered and available to the target database in memory, without any
program code or FTP.
NO PROGAMMING,NO INTERMEDIATE FILES
SourceData
TargetDatabase
15
Informatica PowerExchange
• Patented change data capture
• Complex Source Access
• Codeless, Visual SQL Driven
• Enterprise Scalability
• Data and System Security
• Delivers data in “right-time”
• Extends value of existing investments
• Accelerates development and reduces maintenance
Unlock Complex Data. On Demand.
Key Technology Business Value
16
Architecture Overview
17
Remote Data
Standards andMessaging
Relational andFlat Files
PackagedApplications
Mainframe andMid-Range
Introducing PowerExchangeUnlock Complex Data. On Demand.
Real-time
Batch
18
Create Datamap
Data Maps for Non-Relational Access
Listener
PowerExchange – Design TimeMetadata driven approach
Remote Data
Standards andMessaging
Relational andFlat Files
PackagedApplications
Mainframe andMid-Range
Informatica PowerExchangeUser Applications
Operating Environment
Metadata Sources
Copybooks
Adabas Definitions
Schemas
DatabaseDefinitions
Hand Key
<<<< MM >>>>
PowerExchange Navigator
1. Import “metadata” from
source
Source Metadata
3. Export datamap to source systems for data extraction
process
Datamaps
2. Create the datamap, based
on metadata
19
Tools
(ETL, EAI, BI)
Data Maps for Non-Relational Access
InformaticaPowerCenter
DataRecordsListener
PowerExchange Run-TimeBatch Data Movement or CDC Base Materialization
SQL
Informatica PowerExchangeUser Applications
Operating Environment
Target
Remote Data
Standards andMessaging
Relational andFlat Files
PackagedApplications
Mainframe andMid-Range
<<<< MM >>>>
Native DB Request
Native DB Response
1. PowerCenter issues standard
SQL request2. PowerExchange
converts SQL request to native
DB call
3. Source DB responds in
native format
4. PowerExchange sends translated data records to PowerCenter
20
Capture RegistrationProcess
Data Maps for Non-Relational Access
PowerExchangeNavigator
Listener
Defining the Changes to be Extracted
Informatica PowerExchange
Operating Environment
Extract definitions are based on capture registrations
Extraction Definitions
Capture Registrations
<<<< MM >>>>
Metadata for Relational Access
Metadata
First, we import Metadata from which to define registrations
Next, we define registrations based on metadata presented in
NavigatorRegistrations
Lastly, registrations are exported to the source platforms for
capture process
21
Tools
(ETL, EAI, BI)
Informatica PowerExchange
Capture and Then Consume(Capture-Once Deliver-Many)
Change Stream
InformaticaPowerCenter
DataRecordsC
ollector
Listener SQLPublishedInterfaces
MainframeADABAS
DATACOMDB2IDMSIMS
VSAM
Mid-RangeDB2/400Oracle
SQL Server
Informatica PowerExchange
DataRecordsListener SQL
PublishedInterfaces
Database vendor - journal, archive, redo logs
Physical VSAM Linear Datasets
Collector
Virtual Change Stream
<<<< MM >>>>
1.PowerExchange collects changes
2. Changed data persists in
PowerExchange change stream
4. PowerCenter issues standard
SQL request
5. PowerExchange sends changed data records to PowerCenter
3.DB Log Mechanism
collects & persists changes
22
Tools
(ETL, EAI, BI)
PowerExchangeChange Capture Architecture
Registration & ExtractionData Maps
Change Stream - or -
Virtual Change Stream
InformaticaPowerCenter
Collector
Listener
MainframeADABAS
DATACOMDB2IDMSIMS
VSAM
Mid-RangeDB2/400Oracle
SQL Server
Operating Environment
<<<< MM >>>>
Informatica PowerExchange
PublishedInterfaces
1.PowerExchange collects changes
via published interfaces
2. Changed data persisted in change stream
SQLRequest
3. PowerCenter issues standard
SQL request
Data Records
4. PowerExchange sends changed data records to PowerCenter
31
Informatica PowerExchange
Operating Environment
User Application
Tools
(ETL, EAI, BI)
RegistrationData Maps
Oracle
InformaticaPowerCenter
DataRecordsListener
SQL
Midrange PowerExchange CDC:Oracle Example
OracleLogs
Collector
Virtual Change Stream
<<<< MM >>>>
1. Oracle collects and
persists changes in Redo Logs
3. PowerExchange issues LogMiner request
2. PowerCenter issues standard SQL request
4. PowerExchange sends changed data records to
PowerCenter
LogMiner
32
Operating Environment
Informatica PowerExchangeUser Application
Tools
(ETL, EAI, BI)
RegistrationData Maps
SQL Server
InformaticaPowerCenter
DataRecordsListener SQL
PowerExchange Change Capture Architecture for MS SQL
SQLPublication
SQL ServerDistribution
DB
Collector
Virtual Change Stream
33
Interfacing With PowerCenter
34
How does PowerExchange interface with PowerCenter?
• PowerExchange Client
• Designer menus
• Sources
• Targets
35
PowerExchange client dialog
• Location• NODE= values from client
dbmover.cfg
• User name / Password• SECURITY=(1,N) or (2,N) in
listener dbmover.cfg(zOS and AS/400 only)
• Multi-Record Datamaps
• Allows group source
• CDC Datamaps
• Extract maps
36
PowerExchange client dialog – Source Type
• Source Type ADABAS
• DATACOM DB2390 – Subsystem Id DB2400 – Database Name
• DB2MAP DB2UDB – Database Name
• DB2UNLD
• IDMS
• IMS
• MSSQL – Server & Database Names
• ORACLE – TNS Name SEQ VSAM
also target
37
PowerExchange client dialog – Retrieve Datamaps
• Specify identifier
• Specify metadata filter
• ‘*’ used to match zero or more characters
• Connect
• Select data map
38
Relational Database Management Systems: Real Time and Application Connectors
39
The Informatica PlatformEnables Key Business Imperatives from fragmented data
Improve Decisions
ModernizeBusiness
Improve Efficiency & Reduce
Costs
Acquire & Retain
Customers
OutsourceNon-coreFunctions
GovernanceRisk
Compliance
MergersAcquisitions
& Divestitures
IncreasePartnerNetwork
Efficiency
Increase Business
Agility
Application Partner Data
SWIFT NACHA HIPAA …
Cloud Computing UnstructuredDatabase
40
PWX Roadmap
41
Safe Harbor Statement
Product roadmap is subject to change. The development, release and timing of any Informatica product features described herein are subject to certain assumptions made around available resources, changes in product direction and information available to date.
42
Informatica PowerExchange Release TimelineContinued Innovation with Progression to INFA Platform Integration
PWX 8.6.x2008
PWX 9.0.2 Q1 2011
PWX 9.22011
Deeper Integration into Mercury Platform, Broader HA/Failover support, Multi-rectype write back to System z VSAM & FF
Major Performance Enhancements (Offloading, Threading & Stability)
PWX 9.0Q4 2009
Continued Performance Enhancements, Array support for iSeries, Basic HA support, Partitioning for VSAM & FF on System z
Integration of Navigator (Client) into Mercury Platform, Completed migration of all sources and
CDC supportPWX 9.01 Q2 2010
Configuration & Control integration into PowerCenter Admin Console,Mercury Platform Support for DB2, IMS & VSAM
PWX 9.5+Beyond
TBD – New Sources, Tighter integration, performance, etc.
43
• RRN Support for iSeries
• Enhanced high availability support for PowerExchange form mainframe
• TCP/IP heartbeat for listener
• Stored Procedure Support DB2 (z/OS)
• Performance enhancements• Array support for iSeries
• Partitioning support for PWX VSAM/flat file
• Integration of PowerExchange configuration parameters w/ Informatica Administration Console
• New Control Functions Added for Logger/Compress
Informatica PowerExchange for Mainframe 9.0Release Summary (Q4 2009)
44
• Threading for VSAM/flat file
• Utility Updates
• PowerExchange for iSeries High Availability support
• IPv6 Support
• Support for Oracle data encryption
• Manage PowerExchange as a service from Informatica Administration Console
• New eField Support for Navigator (file list & GDG)
• Certify z/OS 1.11, DB2 9.7, IMS 11, ADABAS 8.2.2 (?)
Informatica PowerExchange 9.0.1 and BeyondSummary
45
• LogBased Oracle CDC Product
• Deeper levels of Mainframe Security Controls
• IMS Enhancements• DLI/ODBA Group Sourcing
• DBRC API
• Enhanced PWX Installation
• Metadata Support for VSAM & IMS
• Extend DxT connectivity to • ADABAS
• VSAM
• IMS
• SSL Performance Enhancements
Informatica PowerExchange 9.0.1 and BeyondSummary
46
Customer Examples
47
• Native access to Adabas DB on mainframe
• High data throughput and scalability
• Powerful data cleansing• Advanced metadata
management capabilities
Improve Decisions & Regulatory Compliance
KEY BUSINESS IMPERATIVE
INFORMATICA ADVANTAGE RESULTS/BENEFITS
• Increase effectiveness and ROI of sales and CRM marketing campaigns
• Create a single, 360-degree view of customer data• Improve quality of customer data
THE CHALLENGE
IT INITIATIVE
Business Intelligence
Brazil’s Oi quadruples sales campaign ROI with single view of customer
• Massive data volumes in many disparate systems, including mainframes
• Inconsistent data across systems
• Increased sales campaign effectiveness from 1% to 4% ROI
• Reduced mainframe extraction time from 50 hours to 2 hours
• Processed 10 TB of data each day
DATA INTEGRATION PROJECT
Data Warehousing
ref123
48
• Mapping Architect for Visio tool ensured consistent methodology and structure to data integration projects
• Offered access to any data―relational databases, applications, and flat files to standards-based data
• IPS ‘ranked above almost every previous vendor services team’
Multiline Healthcare Insurance Business Required State-by-State Picture for Fast, Accurate Decision-making
KEY BUSINESS IMPERATIVE
INFORMATICA ADVANTAGE RESULTS/BENEFITS
• Reduce support/ maintenance costs; increase efficiency• Bridge the gap to real-time business decision making• Comply with Federal healthcare mandates
THE CHALLENGE
IT INITIATIVE
Business Intelligence
• Fragmented, state-by-state data made rolled-up reporting slow & unreliable
• Reporting data derived from scores of mutually exclusive source systems
• Data needed for reports extracted manually
• Reported data sometimes months out of date
• Consistent, state-by-state view of insurance situation
• Enabled firm to respond quickly to auditing requirements
• Reduced maintenance and support costs by 50%
• Saved more than 40 hours of development per mapping implementation
Data Integration Project
Data Warehouse
ref123
Centene Puts Informatica at Heart of Healthcare Insurance Decision-making and Cuts Operational Costs by 50%
49
Modernize Railroad Business & Reduce IT Costs
KEY BUSINESS IMPERATIVE
INFORMATICA ADVANTAGE RESULTS/BENEFITS
• Reduce integration expenditure and deliver data driven services enhancing customer satisfaction
• Provide a platform for integrating real-time data• Replace custom-coded interfaces to access source
databases
THE CHALLENGE
IT INITIATIVE
Operational Integration
BNSF Railway Gets on the Right Track with Informatica Data Integration Platform
DATA INTEGRATION PROJECT
Data Synchronization
ref123
• Inability to synchronize customer information to web in real time
• Reliance on expensive-to-maintain custom-coded interfaces to mainframe
• Lack of scalable framework for leveraging data
• Non-invasive mainframe access, including changed data capture, without coding
• Scalability to handle both current and future data volumes
• Decreased latency between update and data store, capturing 50 million data changes daily
• Reduced mainframe CPU costs and improved performance
50
• Enabled real-time data integration based on an agile, flexible infrastructure
• Ensured on-demand access to heterogeneous systems, without manually coding
• Simplified complex data integration
Improve Speed of Decision Making and Help Brazilian Central Bank Meet Regulatory Compliance Needs
KEY BUSINESS IMPERATIVE
INFORMATICA ADVANTAGE RESULTS/BENEFITS
• Modernize, streamline, and refine management processes
• Obtain more detailed financial information from banking system clients
THE CHALLENGE
IT INITIATIVE
BI/Compliance
• Slow response times owing to complex, labor intensive data transfers
• Pressure to manage growing data volumes
• Lack of modern management processes and detailed client information
• Increased speed of integration by 30%
• Reduced time to document integration processes by 50%
• Streamlined creation/launch of new financial solutions
• Increased operational security
Data Integration Project
Data Warehousing
ref123
Central Bank of Brazil Brings Decision-making Forward by 30% with Informatica
51
• Native access to VSAM and Adabas data
• Long-term ROI through standardization and extensibility
Improve Decisions & Regulatory Compliance
KEY BUSINESS IMPERATIVE
INFORMATICA ADVANTAGE RESULTS/BENEFITS
• Integrate complex VSAM and Adabas data into warehouses to enable better reporting and analysis for highway safety improvements
THE CHALLENGE
IT INITIATIVE
Business Intelligence
Washington improves access to fragmented legacy data for operational analysis of hwy infrastructure
• Complex hierarchical legacy data based on VSAM mainframes and Adabas DB
• Need to non-invasive data access to core VSAM systems
• Reduced development time by 50%
• Gave 300 analysts data access to improve highway safety
• Redeployed six mainframe resources to more strategic roles
DATA INTEGRATION PROJECT
Data Warehousing
ref123
52
Why is Informatica’s PowerExchange Solution Unique?
• Single Vendor, Single Methodology across databases
• No Coding, No Triggers
• Ease of Installation and Maintenance
• Don’t need to be a database expert to get to the data quickly, securely, efficiently
• User can consume changed data either• immediately (Real-Time)
• periodically in bulk (Change)
• Changes can be captured once and used multiple times
• Faster Implementation – Time to Market
53
Thanks for your time!
For More Information Contact:
Scott Hagan --- [email protected] 573-964-6225Or
Diane Ditrick --- [email protected] 702-765-0025