complete information integration a shared architecture for operational and analytic integration andy...
Post on 19-Dec-2015
219 views
TRANSCRIPT
Complete Information Integration
A Shared Architecture for Operational and Analytic Integration
Andy Flower
Vice President
Session # 101
Speaker Qualifications
Andrew Flower, Founder and Lead Consultant
14 years in Data Integration and Data Architecture
Contributing Author to Oracle 8i Data Warehousing
Instructor on Data Integration for TDWI
Member of the IOUG Board of Directors
Enterprise Information Integration
Is this a solution looking for a problem?
It is time to move to the middle
Hey! I can do this with Oracle Database and Fusion Middleware
Review of Enterprise Information Integration
Agenda
Enterprise Information Integration
What is it?
Thank you John Zachman
How does this fit into an Enterprise Architecture
It is all about managing the Nouns and Verbs of your organization
Zachman Framework
Enterprise Information Integration
Provides an on demand integration layer supporting Operations and Business Intelligence
Dependent on effective organizational managementMaster Data ManagementData GovernanceStandardized processes for cleansing dataService Oriented Architecture inclusive of Business Process, Service, and Technical
Integration
Enterprise Information Integration
StrengthsProvides one place for an enterprise to access master dataSupports changes to processes Improves overall data quality through consistent reuse of rulesSource for conformed dimensionsSupports batch and low latency reads and writes
WeaknessesNew concept, infrastructure project hard for business to buy inConfusion on what tool sets to use to support such an architectureHeavy use of on-demand reads/writes could create bottleneck to operational applications
Enterprise Integration Architecture
From Enterprise Integration by Beth Gold-Bernstein
Technical Integration Architecture
Service In
tegratio
nA
rchitectu
re
Info
rmatio
n In
tegratio
nA
rchitectu
re
Bu
siness P
rocess
Integ
ration
Arch
itecture
Questions?
Is this a solution looking for a problem?
StrengthsProvides one place for an enterprise to access master dataSupports changes to processes Improves overall data quality through consistent reuse of rulesSource for conformed dimensionsSupports batch and low latency reads and writes
WeaknessesNew concept, infrastructure project hard for business to buy inConfusion on what tool sets to use to support such an architectureHeavy use of on-demand reads/writes could create bottleneck to operational applications
What is driving this?
A data warehouse is inherently a bad idea.A proxy for ill fitting application data representing the true enterprise data model In the big picture it actually introduces another heterogeneous applicationSatisfies same need by providing core data with rules in services on demand
Operational data integration
On demand analytics
BAM and BPM
Need to integrate structured, semi and un-structured data
Need to be more nimble and flexible.
It is time to move to the middle
Focus on the Nouns and the Verbs
Master Data Management for operational and analytic applications
Standardized Data Quality Services
Data Services that can be Orchestrated and delivered with Functional Services
Data Governance
Function Governance
Information Integration Architecture
In other words, SODW
Service Oriented Data Warehousing (SODW) is comprised of:Variable Entity LatencyMDM to support both Operational and Analytic integrationData Standardization and Quality Services are keyData Integration ServicesTraditional ETL
Entity Driven Latency
Low latency (Real Time)
Batch
Not an all or nothing approachFor each entity discover availability of source dataFor each entity determine the consumer requirement for availability
Master Data Management +
One set of master reference data supporting operational integration and BI
Plus -> all data that is shared (including transactions) Create once share everywhere
Wrapped with services to integrate and access
Data Integration Services
ETL
ELT
Data standardization
Access
Portal
LegacyApplication
LegacyDatabase
OperationsApplication
ApplicationDatabase
OperationsApplication
ApplicationDatabase
OperationsApplication
ApplicationDatabase
OperationsApplication
ApplicationDatabase
DataIntegration
BusinessIntelligenceApplication
BusinessIntelligenceApplication
ApplicationDatabase
ApplicationDatabase
DataIntegration
Data Integration
Master Data Management+
Enabling SODW
BI Data Server
FunctionalApplication
Servers
AppData
ServerMDM Data
Server
Data Integration
Server
Meta Data
Server
LegacyMainframe
BI Application
Server
Enabling SODW
Questions?
Data Hubs (Customer, Product, Financial) or build my own MDM+ repository
OWB Services exposed in the database for ETL and Data Quality processing
Oracle Data Integrator
SOA Suite, BPEL, Oracle Business Intelligence
Hey! I can do this with Oracle Database and Fusion Middleware!
The SODW Market
Both IBM and Oracle are pushing data integration and data hubs to the middleware stack
Informatica is pushing hard into the SODI space
Business Intelligence tools are moving to SOA based platforms too (How will SAP integrate Business Objects?)
Questions?
Examples from a Life Insurance Customer
New Policy Application
Total Premiums by Product, Agent, Period
Alerts for New Policies by Agent vs. Historical trend for Cancellations/Non-Payment
New Policy Application
Nouns Verbs
Insured Name Standardize
Validate
Agent Name Standardize
Validate
Coverage Requested Current Total Coverage
Current Applications
Medical History Retrieve Medical History
Verify and Update
Policy Application Deliver to Underwriting
New Policy Application
XMLPolicy Standardize
ValidateParty
Master Data Management+
Party Policy
RetrieveCoverage
RetrieveMedical
XMLInsured Medical
Information
HTTP
HTTP
MIBService Bureau
XMLPolicy
UnderwritingEngine
Total Premiums by Product
Portal
Policy AdminApplication
ApplicationDatabase
ProfitabilityAnalysis
ApplicationData Mart
Data Integration
Master Data Management+
Operational Analytics
Portal
Policy AdminDatabase
ApplicationData Mart
Data Integration
Master Data Management+
SurrenderService
Questions?
Your Take Aways
Enterprise Information IntegrationWhat is itWhat problems it solvesThe keys to the strategyHow Fusion Middleware fits in
Sessions to Check Out
Become a Complete Oracle Technology and Database Professional
Join the IOUG online at www.ioug.org and get immediate access to:Member Discounts and Special OffersSELECT JournalLibrary of Oracle Knowledge (LoOK)Member DirectorySpecial Interest GroupsDiscussion Forums: Access to Local and Regional Users Groups: 5 Minute Briefing: OracleVolunteer Opportunities
Please visit www.ioug.org to learn more about joining the IOUG BIWA SIG.
Join the BIWA SIG Today!
Thank You!
Please fill out your evaluation formsAndy FlowerComplete Information Integration, Session # 101
For further information you can contact me [email protected]
For more information about LoganBritton, visit LoganBritton.com