SOA ConnectivityMaximizing asset value through reuse and delivering the ESB without limits

Gerry ReillyWebSphere MQ & ESB DevelopmentIBM Software Group – Hursley Development Lab

2

Source: London School of Economics – McKinsey survey and analysis of 100 companies in France, Germany, UK and

US

Aligned IT and Business result in DOUBLE the productivity gains of isolated business and IT efforts

Success Requires Focus On Alignment of Business and IT

3

Align Business and IT with Service Orientation & SOA

6550Clients

A way of integrating your business as linked servicesand the outcomes that they bring

Service Orientation

A repeatable business task – e.g., check customer credit; open new account

A Service

An IT architectural style that supports service orientation

Service Oriented Architecture (SOA)

Service Managers:

Business Managers: Architect:

4

Foundational ExtendEnd-to-End Transform

AdaptDynamically

IT

Business

The Smart SOATM Approach Accelerates Alignment

5

SOA Entry Points Get You to Value Faster

…with every initiative

SOA Configurations

6

Reduced maintenance costs and greater reliability and consistency through flexible, any-to-any linkages

Connect systems, users, and business channels based on standards

Greater innovation and flexibility through faster deployment and modification of business processes

Achieve business process innovation through treating tasks as modular services

Improved productivity and flexibility by enabling targeted user interactions for improved business operations and collaboration

Deliver role-based interaction and collaboration through services

Lower risk and faster time to market by leveraging proven, time-tested functionality

Service-enable existing assets and fill portfolio gaps with new reusable services

Provide trusted information in business context by treating it as a service

Better business operations, more informed decisions and reduced risk with information delivered in-line and in-context

Process

People

Reuse

Connectivity

Information

ValueWhat is it?

SOA Entry Points Help Customers Get Started

Reduced maintenance costs and greater reliability and consistency through flexible, any-to-any linkages

Connect systems, users, and business channels based on standards

7

Assets Layer of disjointed, poorly understood enterprise assets, preventing reuse

Architectures Tightly-coupled architectures hindering IT flexibility

Skills IT skills shortage and silos limiting staff productivity and mobility

Processes and toolsDuplicate processes, tools and infrastructures limiting collaboration

Investments Increasing maintenance costs limiting flexibility for new investments

E01-EDI

Data Warehouse(Interfaces to and from the

Data Warehouse are notdisplayed on this diagram)

G02 - GeneralLedger

A05 - AP

S01 - SalesCorrections

I01 POReceiving

I03 Return toVendor

I06 WarehouseManagement

M a inframe apps - B luePC/NT apps - G reenUnix apps - Y ellow3rd party interface - OrangeLines: Colors have no special meaning.They are to help make the diagram easier toread.For More Information: See the databasecontaining information about eachapplication: Application V4.mdb

S06 - Credit App

P15 EES EmployeeChange Notice

OTHER APPS - PCAP - Collections/Credit

TM - Credit Card DB

ACCTS REC APPS - PC990COR

Bad DebtBenefical Fees

Beneficial ReconcilJEAXFJEBFAJEBKAJEDVAJESOAJEVSAJEVSF

NSFTeleCredit Fees

INVENTORY CONTROL APPS - PCCode Alarm

Debit ReceivingsDevo Sales

Display InventoryIn Home

JunkoutsMerchandise Withdrawl

Promo CreditsRTV Accrual

ShrinkAP Research - Inv CntrlAP Research-Addl Rpts

Book to Perpetual InventoryClose Out Reporting

Computer Intelligence DataCount Corrections

Cross Ref for VCB DnldsDamage Write OffDebit Receivings

DFI Vendor DatabaseDisplay Inventory Reconcil

Display Inventory Reporting

INVENTORY CONTROL APPS - PCDPI/CPI

IC BatchingInventory Adj/Count Correct

Inventory Control ReportsInventory Levels

Inventory RollMerchandise Withdrawl

Open ReceivingsPI Count Results

PI Time Results from InvPrice Protection

Sales Flash ReportingShrink Reporting

SKU Gross MarginSKU Shrink Level Detail

USMVCB Downloads

Journal Entry Tool Kit

Scorecard - HR

L02-ResourceScheduling(Campbell)

P09 - P17Cyborg

M02 - Millennium

M03 - Millennuim 3.0

Banks - ACH and Pos toPay

Cobra

B01 - StockStatus

S03-Polling

P14 On-line NewHire Entry

CTS

Plan Administrators(401K, PCS, Life,

Unicare, SolomonSmith Barney)

D01 Post LoadBilling

I04 HomeDeliveries

I02 -Transfers

Arthur Planning

I07 PurchaseOrder

I12 EntertainmentSoftware

I05Inventory Info

E13E3 Interface

S04 - Sales Posting

V01-Price ManagementSystem

I10 Cycle PhysicalInventory

I55 SKUInformation

K02Customer Repair

Tracking I35 Early WarningSystem

B02 MerchandiseAnalysis

I13- AutoReplenishment

U18 - CTO

InterceptI09 Cycle Counts

E02-EmployeePurchase

Texlon 3.5

ACH

Stock Options

I17 Customer PerceivedIn-Stock

U16-Texlon

SiteSeer

C02 - CapitalProjects

F06 - FixedAssets

US Bank ReconFile

Star Repair

EDICoordinator

Mesa Data

NEW SoundscanNPD Group

AIG Warranty Guard

Resumix

Optika

Store BudgetReporting

P16 - Tally Sheet

Cash Receipts/Credit

S05 - HouseCharges

Ad Expense

L01-PromoAnalysis

V02-PriceMarketingSupport

BMP - Busperformance Mngt

StoreScorecard

I11 PriceTesting

Valley Media

P09Bonus/HR

I15 Hand ScanApps

Roadshow

POS

S08 - VertexSalesTax

A04 - CustRefund Chks

Equifax

ICMS Credit

CellularRollover

S09 - DigitalSatelliteSystem

NPD,SoundScan

Sterling VANMailbox (Value)

I18SKU Rep

X92-X96Host to AS400

Communication

S02 -Layaways

Washington,RGIS,

Ntl Bus Systems

V04-SignSystem

I14 Count CorrectionsNARM

P01-EmployeeMasterfile

I06 - CustomerOrder

FrickCo

UAR - Universal AccountReconcilliation

DepositoryBanks

S07 - CellPhones

S11 - ISPTracking

AAS

Fringe PO

Cash Over/Short

L60 MDFCoop SKU Selection

Tool

SKUPerformance

SupplierCompliance

1

I35 - CEIASIS

Misc Accounting/Finance Apps - PC/NTCOBA (Corp office Budget Assistant)PCBS(Profit Center Budget System)

Merchandising Budget

AIMSMerch Mngr Approval

Batch ForcastingAd Measurement

AIMS Admin

AIMSReportingAd

Launcher

V03- MktReactions

SpecSource

CTO2.Bestbuy.com

RebateTransfer

SignSystem

CopyWriter'sWorkspace

ELTPowerSuite

StoreMonitor

AIS Calendar

Stores & Mrkts

Due Dates

Smart Plus

InsertionsOrders

BudgetAnalysis Tool

Print CostingInvoice App

AIS Reports

BroadcastFilter

Smart PlusLauncher

GeneralMaintenance

Printer PO

PrinterMaintenance

VendorMaintenance

Vendor Setup

Connect 3

Connect 3Reports

Connect 3PDF Transfe

Spec SourceSKU Tracking

S20-SalesPolling

Prodigy

PSP

In-HomeRepair

WarrantyBillingSystem

Process Servers(Imaging)

Prepared by Michelle Mills

Page 1 of 2

Actual application architecture of an IBM customer

Java / J2EE

Linux

Palm / PDABlackberry

VB / C++

SAP / Oracle

MS.net

PackagedApps

Improving Business Agility …and the challenge of integrating existing applications

System i

System z

CICS / IMS

Web 2.0

Softwarearcheology

“Legacy modernization is morphing into a strategic function. IT can't afford to toss away reliable application transactions indiscriminately.“-- Phil Murphy, Forrester Research, April 2007

Outsourced vendor

Packaged app providerAcquired dev team

Testing teamCore dev team

Regional SI

LOB Leaders

Web team

Architecture team

“Today’s IT architectures, arcane as they may be, are the biggest roadblocks most companies face when making strategic moves.”

8

Move integration logic into the infrastructure, decouple interfaces

Line

s of

mai

ntai

nabl

e co

de

Direct Connectivity(No middleware)

All connectivity, mediation and custom logic

buried within the application.

Application

Connectivity,mediation &

custom adaptation

logic

Reduced development and maintenance; increased flexibility and agility

Messaging Backbone

Removes the connectivity

logic from the application

Application

Mediation &custom

adaptation logic

Connectivity logic

Service interface

Service interface

EnterpriseService Bus

Reduces application to its

core business functions

(i.e. a service)

Connectivity,mediation & custom

adaptation logic

Application

Extend

9

Leverage the benefitsReliable and secure data movement – anywhere in the enterpriseApplication Programmers focused on logic – simplified programming tasksDedicated environment – Common tooling, management and operational support

Reduce the number, size, and complexity of interfaces

Reduces cost and risk involved as business changes and new opportunities arise

Promotes reuse – Data and business logic more usable, and applications easier to service-enable

Dynamic real-time, event-driven SOA – replacing unresponsive, batch-updating IT systems

Why an ESB to Meet Your Connectivity Needs?Flexible Connectivity Infrastructure for Integrating Applications and Services

10

The Enterprise Service BusAn Enterprise Service Bus (ESB) is a flexible connectivity

infrastructure for integrating applications and services.

Shape = Transport protocolColor = Data format

An ESB performs the following between requestor and service

CONVERTSbetween different transport protocols

MATCHES & ROUTEScommunications between services

TRANSFORMSbetween different data formats

IDENTIFIES & DISTRIBUTESbusiness events

11

The ESB decouples connectivity logic from application and process logic thus making SOA possible

Flexible“Uncluttered”Business Process Logic

“Uncluttered”Well DefinedSelf-ContainedApplication / Service Logic

IntelligentConnectivityLogic

Connectivity LogicThe Enterprise Service Bus

Separation of concern = greater business flexibility

Application/Service Logic

Process Logic

12

The ESB is not one thing; it is a distributed architecture

The Enterprise Service BusThe ESB is typically not a single product – it is a specific “pattern of connectivity” -- multiple ESB configurations/topologies are possible.The topology you implement should be optimized to meet your unique business requirements.Your topology can change as your business requirements evolve.

……. …….

…….

ESB ESB

ESBESB

ESB

13

SOA Connectivity for Virtually Anything

various platforms, devices, & protocols

Laptops

Sensors

Desktops

HTTPMQTT

MQ

Real-time

Pub/Sub Multicast

PDAs Linux

Mainframe Unix

RFID

WebServices

various programming models

Events

Files / FTPAsynchronousMessaging

SynchronousRPC

RPG

variousprogramming languages

XML COBOLCopybookEDI-X.12

ACORD EDI-FACTebXML AL3

HIPAA HL7SWIFT

FIX

Custom Formats

variousdata formats

Word/Excel

PDF

various delivery modesFire-and-Forget Transactional

PersistentNon-PersistentAt-Least-Once

A “federated” connectivity architecture enabling virtually any SOA assets to talk to any others with no disruption to existing applications or interfaces

14

The Business Value of an Enterprise Service Bus

TravelReservation

Process

FlightAvailability

Service

Enterprise Service Bus

NEW CheckTravelerService

Book Hotel

Service

HotelAvailability

Service

Book Car

Service

NEW FlightAvailability

Service

OLD FlightAvailability

Service

Book Flight

Service

Check Credit

Service

Change services with no impact to existing services

Add new services faster

Change your IT without disrupting everything else

15

Federated ESBs = SOA on your termsCommon SOA messaging backbone– All 3 ESBs integrate with WebSphere MQ

Messaging BackboneCommon universal transformation– Develop transformation technologies once and

deploy across any of the ESBs

– Additional to native ESB transform capabilitiesStandards– Leverage the ‘now’ and the ‘new’ with support

for Existing, standards and future trendsStart where it suits you :– Address your immediate needs with 1 ESB…..

– ……Integrate other ESBs when required in a federated environment.

WebSphere ESBBuilt on WebSphere Application Server for an integrated

SOA platform

WebSphereMessage Broker

Built for universal connectivity and transformation in

heterogeneous IT environments

WebSphere DataPowerIntegration Appliance

Purpose-built hardware ESB for simplified deployment and hardened security

Extend

16

• Provides business visibility with embedded event engine for Business Activity Monitoring solutions

• Optimized for standard XML and web services formats, with basic support for other common formats

• Integrates everything with WebSphere Adapters for enterprise applications, the breadth of the WebSphere ecosystem, and support for standard protocols

• Delivers leadership in SOA standards for service composition, and leverages the embedded messaging and web services WebSphere Application Server engine

WebSphere ESBBuilt on WebSphere Application Server for an integrated SOA platform

Integrates seamlessly with the WebSphere platform

Delivers business-critical qualities of service

Easily extends to WebSphere Process Server

Integrated solution for both service mediation and service hosting

17

WebSphere Message BrokerBuilt for universal connectivity and transformation in heterogeneous IT environments

• Offers unique quality of service and connectivity on z/OS

• Optimized for high-volume processing and rapid time to value for complex mediation requirements with a robust set of pre-built mediation function

• Enables transformation between a wide range of data formats, including XML, legacy, and industry standards, and custom formats

• Integrates everything through standard protocols, WebSphere Adapters for enterprise applications, and specialized connectivity options

• Exploits the unparalleled reach and reliability of the WebSphere MQ enterprise messaging backbone

• Delivers universal connectivity and transformation

• Provides a flexible solution that implements not only the ESB pattern but also a range of EAI patterns

• Optimized to accommodate any IT environment

18

WebSphere DataPower Integration Appliance XI50Purpose-built hardware ESB for simplified deployment and hardened security

• Redefines the boundaries of middleware with specialized hardware

• Many functions integrated into a single device

• Simplified deployment and ongoing management

• Captures and emits events to facilitate web services management and enable business visibility in Business Activity Monitoring solutions

• Enables transformation between a wide range of data formats, including XML, legacy, and industry standards, and custom formats

• Optimized to bridge between leading standard protocols at wirespeed, including web services, messaging, files, and database access

• Secures services on the network with sophisticated web services access control, policy enforcement, message filtering, and field-level encryption

19

Defining the capabilities for your SOA environment SOA Reference Architecture

Interaction Services Information Services

Partner Services Business App Services Access Services

DevelopmentServices

Management Services

Infrastructure Services

Enables collaboration between people, processes &

information

Manages diverse data and content in a unified

manner

Connect with trading partners

Build on a robust, scaleable, and secure services environment

Facilitate interactions with existing information and

application assets

Integrated environment

for design and creation of

solution assets

Manage and secure

services, applications &

resources

Optimizes throughput, availability and utilization

App

s &

In

fo A

sset

s

Process Services

Business ServicesSupports enterprise business process and

goals through businesses functional service

Enterprise Service Bus

Orchestrate and automate business processes

20

Messaging Transport for SOA Connectivity

bSphere MQMQ

WebSphere MQ provides the ESB with asynchronous, decoupled connectivity

With WebSphere MQ you have taken the first step to a connected SOA

21

Role of WebSphere Adapters within SOA

PeopleSoft

Adapter

SAP

Adapter

Enterprise ReadyMission-critical quality of service

Full portfolio of integration products available through a single vendor

Service enablement – provide a standard interface to proprietary implementations

Service discovery – browse, select, and generate service descriptions from the application repository

Event capture – detect and publish application events and control in-bound / out-bound information flows

Pre-built or build your own – vast range of ‘ready-to- go’ adapters and toolkit to generate your own

Best PracticesFirst-class support for top ISVs

Proven solutions based on first-hand experience gained from integration services

Established relationships with top-tier ISVs

Adapters service-enable your applications so they can participate in an SOA

Any Application

Adapter

22

For the WebSphere PlatformWebSphere

Transaction eXtender

WebSphere Transaction

eXtender

MAP

TRANSFORM

Unifying Enterprise Data Transformation

Unifying Enterprise Data Transformation

WebSphere Transformation eXtender (WTX): A Common Transformation Engine for ALL Environments

Unmatched richness of transformation. An ability to be deployed anywhere.Speed of transformation. Code free design and deployment. In process data validation.

For the Standalone and Programming Environments

For Other Integration Products(as an embeddable engine)

23

What Does IBM WebSphere TX Do?

It takes any kinds of data from their native forms

ANY Data

Processes them together, natively, with NO CODE

And outputs them into their native target formatsANY Data

Many-to-many Integration

Ex. - Hierarchical Data , Binary Data, Packed Data, Tabular Data, Relational Data, Nested Structures, Mixed-Type Data, and on and on…

24

IBM WebSphere Service Registry and Repository

Publish Find Enrich Govern

WebSphere Service Registry and Repository

Manage

WebSphere Service Registry and Repository is an industrial-strength tool that helps you achieve more business value from your SOA by enabling better management and governance of your services. Through its robust registry and repository capabilities and its tight integration with IBM SOA Foundation, WebSphere Service Registry and Repository can be an essential foundational component of your SOA implementation.

25

WebSphere Service Registry and Repository Relevance to ESBEnrich Connectivity

– Enable dynamic and efficient interactions between services at runtime

– ESB Mediation capabilities allows dynamic endpoint lookup and selection

Help optimizeservice performance

– Enable enforcement of policies, Impact analysis

Federated service lifecycle support across the enterprise

– Integration and federation with other standard registries and repositories providing one reliable authoritative service reference

WebService

App

App

WebService

Encourage Reuse, Enhance Connectivity and Enable Governance with WebSphere

ESB and WebSphere Message Broker, extended with WebSphere Service Registry

and Repository

Enterprise Service Bus

Publish

Find

Enrich

26

Business Event ProcessingSense when to act, know what to do

Real-Time Pattern DetectionReal-Time Decision Triggers

Process Execution

• SOA and BPM enhanced by new Business Events solution

• Business users direct reaction to events

• Plug and play to extend your existing SOA and BPM infrastructures

• Processes drive the business, events drive the process

• SOA flexibility is powered by informed business processes

• Dispersed events feed into loosely coupled applications and systems

• Business users given real-time insight by events

• Processes acting on real-time insight defined by Business not IT

• Detecting business events feeds information to your processes Modelling &

Simulation

Collaboration

Business Activity Monitoring

Expertise & Accelerators

27

!

WebSphere Business Events Distilling disparate events into actionable patterns to predict and respond to new opportunities and threats

Password Change

New Loan Application

Large Withdrawal

Turbulent, Disparate,Non-Deterministic,

Un-sequenced Events

Empowered Business User

Capture

Correlations Patterns

Frequent Option Trading

NewAccount

Opening

Account Mgr Visit

Change Mailing Address

"Potential Fraud!"

Automated Action "Initiate Investigation"

Business Services

Web Services

Business Processes

Applications

External Event

SourcesAlerts/KPIs

BPM

Event Sources

28

Allows business users detect, evaluate and react to business events in real time

Designed for process analysts─ Understands business language and vernacular─ Enables straightforward expression of business logic─ Codeless, Graphical Authoring tools

Accepts events from many sources─ “Derived" events─ Plug & Play to extend your existing SOA and BPM

infrastructures

Sense meaningful patterns─ Simple and complex rules patterns─ Define filters and conditions─ Event flows and long running correlations

Initiate the appropriate response─ Take action when those patterns form─ Drive existing services (WPS business process, ESB, etc.)─ Automated Tasks (Update DB, write to file, etc.)─ Notifications (Email, pager, etc.)

WebSphere Business EventsSense when to act … AND ACT!!

Process Analyst

Event Definitions

Event Flow

Event Processing

29

Enterprise Service Bus

An ESB without limits

Customers Who Rely on WebSphere For Their SOA Connectivity Needs

30

Summary

SOA is about making I.T. more flexible and enabling re-use.

“Separation of concern” through an ESB is essential for making SOA work.

The ESB is a distributed architecture – not a single product – that should be optimized for your business.

IBM provides you with a flexible ESB without limits that won’t paint you into a corner as you grow.

Questions & Answers

greilly@uk.ibm.com