complete information integration a shared architecture for operational and analytic integration andy...

34
Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Post on 19-Dec-2015

219 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Complete Information Integration

A Shared Architecture for Operational and Analytic Integration

Andy Flower

Vice President

Session # 101

Page 2: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Speaker Qualifications

Andrew Flower, Founder and Lead Consultant

14 years in Data Integration and Data Architecture

Contributing Author to Oracle 8i Data Warehousing

Instructor on Data Integration for TDWI

Member of the IOUG Board of Directors

Page 3: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Enterprise Information Integration

Is this a solution looking for a problem?

It is time to move to the middle

Hey! I can do this with Oracle Database and Fusion Middleware

Review of Enterprise Information Integration

Agenda

Page 4: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Enterprise Information Integration

What is it?

Thank you John Zachman

How does this fit into an Enterprise Architecture

It is all about managing the Nouns and Verbs of your organization

Page 5: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Zachman Framework

Page 6: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Enterprise Information Integration

Provides an on demand integration layer supporting Operations and Business Intelligence

Dependent on effective organizational managementMaster Data ManagementData GovernanceStandardized processes for cleansing dataService Oriented Architecture inclusive of Business Process, Service, and Technical

Integration

Page 7: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Enterprise Information Integration

StrengthsProvides one place for an enterprise to access master dataSupports changes to processes Improves overall data quality through consistent reuse of rulesSource for conformed dimensionsSupports batch and low latency reads and writes

WeaknessesNew concept, infrastructure project hard for business to buy inConfusion on what tool sets to use to support such an architectureHeavy use of on-demand reads/writes could create bottleneck to operational applications

Page 8: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Enterprise Integration Architecture

From Enterprise Integration by Beth Gold-Bernstein

Technical Integration Architecture

Service In

tegratio

nA

rchitectu

re

Info

rmatio

n In

tegratio

nA

rchitectu

re

Bu

siness P

rocess

Integ

ration

Arch

itecture

Page 9: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Questions?

Page 10: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Is this a solution looking for a problem?

StrengthsProvides one place for an enterprise to access master dataSupports changes to processes Improves overall data quality through consistent reuse of rulesSource for conformed dimensionsSupports batch and low latency reads and writes

WeaknessesNew concept, infrastructure project hard for business to buy inConfusion on what tool sets to use to support such an architectureHeavy use of on-demand reads/writes could create bottleneck to operational applications

Page 11: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

What is driving this?

A data warehouse is inherently a bad idea.A proxy for ill fitting application data representing the true enterprise data model In the big picture it actually introduces another heterogeneous applicationSatisfies same need by providing core data with rules in services on demand

Operational data integration

On demand analytics

BAM and BPM

Need to integrate structured, semi and un-structured data

Need to be more nimble and flexible.

Page 12: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

It is time to move to the middle

Focus on the Nouns and the Verbs

Master Data Management for operational and analytic applications

Standardized Data Quality Services

Data Services that can be Orchestrated and delivered with Functional Services

Data Governance

Function Governance

Page 13: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Information Integration Architecture

Page 14: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

In other words, SODW

Service Oriented Data Warehousing (SODW) is comprised of:Variable Entity LatencyMDM to support both Operational and Analytic integrationData Standardization and Quality Services are keyData Integration ServicesTraditional ETL

Page 15: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Entity Driven Latency

Low latency (Real Time)

Batch

Not an all or nothing approachFor each entity discover availability of source dataFor each entity determine the consumer requirement for availability

Page 16: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Master Data Management +

One set of master reference data supporting operational integration and BI

Plus -> all data that is shared (including transactions) Create once share everywhere

Wrapped with services to integrate and access

Page 17: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Data Integration Services

ETL

ELT

Data standardization

Access

Page 18: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Portal

LegacyApplication

LegacyDatabase

OperationsApplication

ApplicationDatabase

OperationsApplication

ApplicationDatabase

OperationsApplication

ApplicationDatabase

OperationsApplication

ApplicationDatabase

DataIntegration

BusinessIntelligenceApplication

BusinessIntelligenceApplication

ApplicationDatabase

ApplicationDatabase

DataIntegration

Data Integration

Master Data Management+

Enabling SODW

Page 19: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

BI Data Server

FunctionalApplication

Servers

AppData

ServerMDM Data

Server

Data Integration

Server

Meta Data

Server

LegacyMainframe

BI Application

Server

Enabling SODW

Page 20: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Questions?

Page 21: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Data Hubs (Customer, Product, Financial) or build my own MDM+ repository

OWB Services exposed in the database for ETL and Data Quality processing

Oracle Data Integrator

SOA Suite, BPEL, Oracle Business Intelligence

Hey! I can do this with Oracle Database and Fusion Middleware!

Page 22: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

The SODW Market

Both IBM and Oracle are pushing data integration and data hubs to the middleware stack

Informatica is pushing hard into the SODI space

Business Intelligence tools are moving to SOA based platforms too (How will SAP integrate Business Objects?)

Page 23: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Questions?

Page 24: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Examples from a Life Insurance Customer

New Policy Application

Total Premiums by Product, Agent, Period

Alerts for New Policies by Agent vs. Historical trend for Cancellations/Non-Payment

Page 25: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

New Policy Application

Nouns Verbs

Insured Name Standardize

Validate

Agent Name Standardize

Validate

Coverage Requested Current Total Coverage

Current Applications

Medical History Retrieve Medical History

Verify and Update

Policy Application Deliver to Underwriting

Page 26: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

New Policy Application

XMLPolicy Standardize

ValidateParty

Master Data Management+

Party Policy

RetrieveCoverage

RetrieveMedical

XMLInsured Medical

Information

HTTP

HTTP

MIBService Bureau

XMLPolicy

UnderwritingEngine

Page 27: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Total Premiums by Product

Portal

Policy AdminApplication

ApplicationDatabase

ProfitabilityAnalysis

ApplicationData Mart

Data Integration

Master Data Management+

Page 28: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Operational Analytics

Portal

Policy AdminDatabase

ApplicationData Mart

Data Integration

Master Data Management+

SurrenderService

Page 29: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Questions?

Page 30: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Your Take Aways

Enterprise Information IntegrationWhat is itWhat problems it solvesThe keys to the strategyHow Fusion Middleware fits in

Page 31: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Sessions to Check Out

Page 32: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Become a Complete Oracle Technology and Database Professional

Join the IOUG online at www.ioug.org and get immediate access to:Member Discounts and Special OffersSELECT JournalLibrary of Oracle Knowledge (LoOK)Member DirectorySpecial Interest GroupsDiscussion Forums: Access to Local and Regional Users Groups: 5 Minute Briefing: OracleVolunteer Opportunities

Page 33: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Please visit www.ioug.org to learn more about joining the IOUG BIWA SIG.

Join the BIWA SIG Today!

Page 34: Complete Information Integration A Shared Architecture for Operational and Analytic Integration Andy Flower Vice President Session # 101

Thank You!

Please fill out your evaluation formsAndy FlowerComplete Information Integration, Session # 101

For further information you can contact me [email protected]

For more information about LoganBritton, visit LoganBritton.com