Best Practices for Scaling your SOA Infrastructure and Projects

Saul Cunningham

SOA Business Development Manager

ORACLE FUSION MIDDLEWARE FORUM

• SOA in its Prime• Stages of SOA Adoption• Don’t Forget the Way We Work• Oracle SOA Suite

Agenda

SOA in its Prime

SOA in its PrimeAdoption continues to accelerate

Total = 62%, up from 53% a

year ago(mostly in “will

pursue” & “enterprise

commitment”)

Source: ForresterSource: Forrester

A question for you…

If your not using SOA what are you using instead?

POLL• Are you doing SOA?

1. Yes - already doing SOA projects.

2. Planning – will start first SOA project in next 12 months

3. Waiting - No plans to at this stage but still have open mind

4. Never - Will never do SOA – its snake oil

Stages of SOA Adoption & Best Practices

9

The Path to Industrialized SOAStage 1 - Opportunistic

Best Practice – Mediation using Service Bus

• Customer Use Case: • Portal application consumes business

services from back-end applications.• Eliminate the point to point coupling using

a SOA based architecture.

• Requires ESB Characteristics:• Heterogeneous messaging backbone• Content based routing• Service enrichment • Monitoring and reporting• SOA based security• Service workload and management• Message Guarantees• Service orchestration • Distributed services across the enterprise• Service discovery

getCustInfo getCustInfogetCustInfo

getCustAddress getCustCreditgetCustProfile

JMS SOAP MQ

Mainframe.NETJ2EE

Client A Client B Client C

getCustInfo getCustInfogetCustInfo

getCustAddress getCustCreditgetCustProfile

JMS SOAP MQ

Mainframe.NETJ2EE

Client A Client B Client C

Oracle Service Bus

Oracle Service Bus

• Adaptive service messaging - connect any service, any protocol, any endpoint

• Adaptive transformation – any payload XML, binary, text

• Embedded service management - optimized governance of all messaging

• Rich composition environment - configuration driven, no coding approach

• Best-of-breed distributed run-time - reliability, availability, scalability, and performance

Security

Messaging

Visibility

Composition

Services Transport Layer Transport SDK

Portal WS Client BPEL Java

Service Service Service Service

Transformation Discovery/ Validation

Message Flow Modeling

Service Call-out

Test Browser

Transport Security WS-Security Console Security Policy

ReportingSLAsMonitoring Dashboard Open Interfaces

Ent

erp

rise

Ser

vice

Bu

s

12

The Path to Industrialized SOAStage 2 - Systematic

BPEL

submit

Order

JSF

?

ACTIVATION FLOW

CREATEApplications

Customer (DataHub)

BPEL

Exception ManagementPortal – Order Hospital(Human Workflow)

Promotion Management(Business Rules)

BAM –Exception RateSLA Management

?

Order Validation (EJB 3.0)

Best Practice – Enterprise-strength Orchestration Layer

Oracle BPEL Process Manager

Process Console

MA

NA

GE

J2EE Application Server

(Oracle AS, WebLogic, JBoss, WebSphere)

Core BPEL Engine

BPEL

JDeveloper

BPEL Designer

BPEL Process Manager

Integrated BPM Services

Workflow Decision

Service

Sensors

Dehydration Store

(Oracle Database)

WSDL Binding

File, FTP

Web services

Java, JMS

Database

Apps

Enterprise-strength infrastructure for business process automation

• Comprehensive and native BPEL implementation

• Easy-to-use modeling tool

• Scalable and reliable engine

• Flexible binding framework

• Rich management and monitoring

• Support for Oracle AS, JBoss, WebLogic and WebSphere

• Get up and running in less than 15 minutes!

Process Modeler

Workflow Services

15

The Path to Industrialized SOAStage 3 - Enterprise

Common Process Metadata ModelCommon Process Metadata Model

Round-Trip Design & Process OptimizationRound-Trip Design & Process Optimization

Business UsersBusiness Users(BPMN)(BPMN)

DevelopersDevelopers(BPEL)(BPEL)

Best Practice – Shared Visual Business Process Modeling Environment

Oracle BPM Solution Overview A Comprehensive Platform

Office

BPM StudioBPM Studio

Oracle BPA Suite*Oracle BPA Suite*

Content/Image Servers Packaged apps, external services

BPMN (XPDL), BPEL

BPM ServerBPM Server

Human WF Rules BAM

User, Role directory

Modeling (BPMN)

Simulation & Optimization

Worklist

User InteractionUser Interaction

Process Dashboards Collaboration

Office Integration

Org Model & Biz Calendar

Oracle BPM SuiteOracle BPM Suite

Analysis & Reporting

Process Templates and Solutions*Process Templates and Solutions*

Industry specific templates

Imaging solutions

Standards Framework

18

The Path to Industrialized SOAStage 4 - Measured

BPM

SOA Infrastructure

Process improvement

Process implementation Process management

Process definition simulation

BAM （ Business Activity Monitorin

g ）

service service service service

Best Practice – BPM + SOA = Foundation for Business Process Optimisation

Business Activity MonitoringReal Time Process Dashboards

CEP ProcessingCEP Processing

Business KPI Impact AnalysisBusiness KPI Impact Analysis

Action FrameworkAction Framework

Business Event SensorsBusiness Event Sensors

21

The Path to Industrialized SOAStage 5 - Industrialized

Emerging Trends – Event Processing

• More than 200 million containers are shipped every year - 6 containers every second!

• A new product is launched every 3.5 minutes

• Business process automation has resulted into explosion of data emanating from such transactions

• Opportunities and Risks are constantly emerging from these streams of data

• Competitive advantages now achieved by moving closer to the event occurrence and tapping into opportunities as they occur

22

In-Memory Data GridIn-Memory Data Grid

CEP ProcessorCEP Processor

Event Distribution NetworkEvent Distribution Network

Lightweight OSGI ServerLightweight OSGI Server

DatabaseDatabase

ApplicationsApplications

MessagingMessaging

RFIDRFID

Event SourcesEvent Sources

Complex Event ProcessingHigh Speed Event Processing

SELECT S.city, AVG(temp)FROM SOME_STREAM S[range by 10 slide by 5]WHERE S.state = ‘California’GROUP BY S.city

“I want to look at 10 seconds worth of data”

“I want a result generated every 5 seconds”

Unmatched Performance and Scalability

1 Million Events Processed per Second

<1 Millisecond Latency for Events

Dashboard Rules Processes

How can a Data Grid Help?High Speed, Fault Tolerant, Virtualised Data Cache

• Provides a reliable data tier with a single, consistent view of data

• Enables dynamic data capacity including fault tolerance and load balancing

• Ensures that data capacity scales with processing capacity

MainframesDatabases Web Services

Enterprise Applications

Real TimeClients

WebServices

Application Tier

Coherence™Data Grid

Data Sources

Data Services

25

Oracle Restricted and Confidential

Don’t Forget the Way We Work

Why SOA Initiatives Fail:Technology or Governance?

Introduction Spreading Exploitation Plateau

Risk of SOA

Project Failures

Lack of Governance

Risk

Technology Risk

Less Risk

More Risk

Time

Skilled People

Experienced SOA Architects with best practices knowledge

for project oversight

Client Architect

Solution Architect(s)

Product Specialist(s)

SOA Project Methodology which caters every aspects in

the SOA Journey

Formalized Practice

Best-in-Class-Technology

Unified Platform

Best

Practice

ArchitectureArchitecture

SOA GovernanceSOA Governance

ITIT

CorporateCorporate

Best Practice – SOA Governance – People, Practice, Platform

Oracle SOA Governance

• Establish governance early – without governance SOA will fail

• Address the necessary organizational/cultural changes

• Incent the organization on SOA governance processes

• Apply governance throughout the lifecycle, from planning through retirement

• Have the appropriate monitoring and metrics for adapting as you go

• Make it as automated and non-intrusive as possible

28

IDEs

Full SOA Lifecycle Governance

Oracle Enterprise Repository

UDDI

Development & TestingModeling

Analysis

Design

Deployment

Monitoring

Secure &Audit

Runtime ModificationRemoval

Retirement

OWSMSOA Mgmt Pack

29

POLL• Pick two true statements about the motivation for SOA

Governance?

1. Without it you will get Web Service spaghetti-fication

2. It allows business and IT to more closely align goals and objectives

3. It makes geeks sound like they know what their doing

4. Without it SOA will ultimately fail

5. Reduces project risk

6. It gives the vendors yet another product to sell

And The Winner Is…

<Insert Picture Here>

Oracle SOA Suite

Oracle SOA Evolution

Portlet Web Services (WSRP)

Portlet Web Services (WSRP)

Web Services Support

Web Services Support

2001 2002 20042003 20062005

BPEL Process Manager

BPEL Process Manager

J2EE 1.4 Standard Web Services

J2EE 1.4 Standard Web Services

WSDL, UDDI, Development Tools, Expanded Web Services

Platform

WSDL, UDDI, Development Tools, Expanded Web Services

Platform

ServiceRegistryServiceRegistry

Web Services Manager, BAM Web Services

Manager, BAM BPASuiteBPASuite

2007

OracleData

Integrator

OracleData

Integrator

Stellent Doc Mgmt, Image

Proc

Stellent Doc Mgmt, Image

Proc

TangosolTangosol

…

SOA SuiteSOA Suite

2008

WebLogic Server

ALSB

Repository

ALBPM

Event Server

WebLogic Server

ALSB

Repository

ALBPM

Event Server

Apps

AdaptersAdapters B2BB2B

PartnersDB Legacy

CONNECTIVITY

Routing Transform DataQuality

ETL &Replication

Data IntegratorData IntegratorOracle Service BusOracle Service Bus

Mediation

ROUTING & DATA SERVICESNativeBPEL

Business Rules

Human Workflow

BPEL Process ManagerBPEL Process Manager

ORCHESTRATION

Coherence CacheJ2EE Application Server

(Oracle AS, WebLogic, WebSphere, JBoss)Messaging

Oracle SOA and Event Technologies

GOVERNANCESystem

Monitoring

Enterprise Enterprise ManagerManager

UDDI

WS PoliciesSecurity

Web Web Services Services ManagerManager

RegistryRegistry

GOVERNANCE

SOA lifecyclegovernance

EnterpriseEnterpriseRepositoryRepository

JRockit VM & RT

REAL-TIMEVISIBILITY

& PROCESSING AlertsBusiness Monitoring

BAMBAM

EventsData Streams

CEPCEP

ApplicationDevelopmentFramework

EnterpriseModeling

BPA SuiteBPA Suite

JDeveloperJDeveloper

Business UserModeling

BPM SuiteBPM Suite

Oracle SOA Suite

• Oracle BPEL Process Manager

• Oracle Service Bus (based on BEA AquaLogic Service Bus)

• Oracle CEP (based on BEA Event Server)

• Oracle Business Activity Monitoring (BAM)

• Oracle Business Rules

• Oracle Web Services Manager

• Oracle JDeveloper

Comprehensive & Pre-integrated SOA Platform

Oracle SOA Suite

Next Steps

Oracle Resources

• Online – www.oracle.com/soa

• Events – SOA Architect Forum oracle.com/events

• Papers/Tools – SOA Self-Evaluation Tool

• Oracle RedRoom – oracle-gtmi-anz.blogspot.com

Get Started

1. Identify the SOA adoption stage of your organization

2. Validate current infrastructure against best practices

3. Plan for recommended SOA stages to maximize efficiency gains along with rapid expansion

4. Determine potentials areas where new trends such as event processing can deliver competitive advantages

37