ws bus monitor best practices

8/6/2019 Ws Bus Monitor Best Practices

1/54

Best Practices forWebSphere BusinessMonitor v7


2/54

Agenda

Monitor Concepts & Architecture

1

Monitor Model Authoring Tips andPitfalls

High Availability and the BPMGolden Topology

Monitor Runtime Configurationand Tuning


3/54

Business Activity Monitoring (BAM) provides process visibility

Business leaders gain real-time visibility and actionable insight into processes

Real-timeinformation

consolidated intocustomizable, role-based

dashboards

Business leaders

monitor process KPIs andreceive alerts

2


4/54

3


5/54

Individualbusiness

situations

Aggregated KPIsacross multiple

processes

Trend analysis

Analyze a range of process data with BAMTake action faster with up-to-minute information on personalized dashboards

Drill down to investigate

why John Smiths newbank account requesthas not been processedwithin the specifiedservice level agreement

Redirect Group As

backlogged newaccount openingqueue to Group B torebalance workload

Compare new

account openingmetrics across timeperiods to manageresources moreeffectively

4


6/54

For example:

Percentage of sales order lineitems delivered on time

Average time to approve loanapplication

Total amount of loandisbursements this month

Key Performance Indicators (KPIs)are metrics used to quantify and

measure business performance against strategic and operational targets.

Real-time KPIs help you make smarter decisionsKeep track of metrics and targets in the areas most critical to your business

Integrated KPI libraries help users pick the

best metrics to monitor their processes 5


7/54

Predictive KPIs enable proactive managementTake advantage of market opportunities and prevent problems before they occur

Predict future values ofKPIs based on historic andcyclic trends

Pro-actively trigger alerts

when predicted valuesindicate a problem

Feed and correlate alertswith business event

processing for enhancedpattern detection

Predictive KPIs in WebSphere Business Monitor 6


8/54

WebSphere MQWorkflow

WebSphere

Message Broker WebSphereBusiness Events

WebSphere ESB &Process Server

WebSphere

Business ServicesFabric

Third Party

Applications

IBM FileNet P8

WebSphere

Partner Gateway

WebSphere BusinessMonitor

Adapters:SAP, PeopleSoft, etc.

CICS

IMS

WebSphereSensor Events

Events

Event Sources for WebSphere Business MonitorConsume events from broad range of middleware for end-to-end process monitoring

7


9/54

How to Publish Events to Monitor

Options to emit XML for BAM via a variety of approaches

REST Event Emitter API

WebSphere MQ

* Use IBM product already enabled for event emission

* Java Message Service APIs (SIB)

WS-Notification

WebSphere Application Server

Common Event Infrastructure

WebSphere Business Monitor

Note: All options take XSD-described XML no CBEs needed8


10/54

Example: Using the JMS API to send a BAM eventpublic void sendJMSMessage(String xmlToSend, String jmsQueue, String jmsQueueConnectionFactory)

{

// get the Connection Factory

Context context = new InitialContext();

ConnectionFactory qConnectionFactory = (ConnectionFactory) context

.lookup(jmsQueueConnectionFactory);

Connection connection = qConnectionFactory.createConnection();

// get the queue

Queue queue = (Queue) context.lookup(jmsQueue);

//Create session, producer, and message.

// get a session

Session session = connection.createSession(false, Session.AUTO_ACKNOWLEDGE);

// get the producer

MessageProducer producer = session.createProducer(queue);

// build the TextMessage

TextMessage message = session.createTextMessage(xmlToSend);

// send the message

producer.send(message);

} 9


11/54

Action

Services

EventDistribution

MonitorDatabase

Monitor usingBusiness Space

Event/datasource

Send eventsthrough JMS,REST, WS-Notification, etc.

Eventprocessing

Businesssituation events

Take action (email, pager, alert,process/service invocation)

Business

Monitor Toolkit(Modeler, RADor WID)

Author & DeployMonitoringModel

Monitor Server(installed on WebSphere Application Server 7.0 or WebSphere Process Server 7.0)

RESTServices

Call service toretrieve data(optional) Call Monitor

services toretrieve data

Monitor ModelApplication

Personalizespaces, DefineAlerts & KPIs

Monitor Architectural Overview

1

2

6

3 4

7

5

8

10


12/54

Agenda


11





13/54

Model Authoring Tips and Pitfalls

***Business*** Monitoring

Model granularity

Model constructs to use with care

Child MCsRecurring wait-time triggers

Deliver to All

Support multi-threaded event processing

12


14/54

Business-relevant Events

Only turn on event emission

where truly necessary for

business activity monitoring WebSphere Business Monitor should not

be used for IT monitoring

Enabling emission for all possible event

types might cause 100 events to beemitted per process instance, but yourmonitor model may only have KPIs, etc.that care about 10 of those

Best practice is to just turn on eventsused in selected templates and variables

Turning off unneeded events improvesperformance of both the emitting app

and the monitor model 13


15/54


16/54

Generate high and low level monitor modelsIBM developerWorks Download for Modeler

15


17/54

Child Monitoring Contexts

When generating an MM from BPEL, consider using

Event Groups rather than Child MCs for activities

- Reduces number of cubes, simplifies dashboard usage

16


18/54

Recurring wait time triggers

Triggers that should beevaluated periodically

Be careful with manyactive instances and a

short wait time

With 100 new instances

per minute, averaging aweek to complete, a 15minute period wouldresult in over 1000evaluations/second

Consider dashboarddefined KPI alerts over

modeled KPI alerts 17


19/54

Deliver to All

Event delivery option for multiple correlation matches

Be careful when you have many active instances and

the event could correlate to a high percentage of them With 1 million active instances, an event that correlates to

1/3 of them, arriving once every 5 minutes, would result inover 1000 event deliveries/second

18


20/54

Multi-threaded event processing

Events are processed more efficiently in multi-threaded mode

Requirements to support multi-threading:

All inbound events must contain the key to the root MC

All correlation expressions (including for events for child/grandchildMCs) must reference that key to the root MC

Only multi-threaded models can utilize the error queue An event causing an exception, along with all future events that

correlate to the same instance, will be routed to the error queue

Otherwise the entire model halts processing all events if any single

event fails to be processed successfully

Only multi-threaded models can support event reordering

Such as would be desirable if using asynchronous event emission

19


21/54

Agenda


20





22/54

Monitor Runtime Components

CEI Event Service

Queue Bypass

Service Integration Bus Dimensional Analysis & Reporting

Business Space

Business Monitor API REST Service

Business Monitor Action Services

Business Monitor Data Movement Services

Business Monitor Data Services Scheduler

21


23/54

CEI Event Service

Business Monitor uses the CEI Event Service to emit outbound events.

Which CEI Event Service is used is specified by defining an EmitterFactory for use by Business Monitor.

Business Monitor emits outbound events synchronously by default to

ensure that event order is preserved.

22


24/54

CEI Event Service

Event Emitters being monitored by Business Monitor dont haveto use the same CEI Event Service.

When configuring the CEI Event Service for Business Monitordecide if you are going to:

Create an Event Service just for Business Monitors outbound events. Create an Event Service for both Business Monitors outbound events

and other event emitters. Configure Business Monitor to use an existing Event Service to emit

outbound events.23


25/54

Queue Bypass

Simpler to configure

No cross-cell bus links

Enhanced reliability

Improved performance

Single-phase commit

Monitor 6.2 introduced a

new configuration option

that enables CEI to directlyinsert events into the MM

database tables24


26/54

Service Integration Bus

For queue based event delivery: Business Monitor processes events delivered to various JMS Queues. The JMS Queues are provided by Queue Destinations on the Service

Integration Bus. In order to automatically configure JMS and SI Bus resources, a specific

SI bus is expected to exist:

MONITOR.cellname.Bus For queue bypass event delivery:

Business Monitor processes events directly from MONITOR database. Monitor bus not used for monitor model event delivery, but input queue for

Action Services still exists. Note queues on CEI bus still used if asynch event emission is chosen

25


27/54

Service Integration Bus

A Message Engine is the runtime of a Service Integration Bus. By default, when a message engine is deployed to a cluster, only

one member is active at a time.

It is possible to change this behavior to, for example, have allmessage engine members active at once, but this is not supportedby Business Monitor.

Using anything other than the 1-of-N policy for the message enginewill cause events to be delivered to Business Monitor out of order.

26


28/54

Dimensional Analysis & Reporting

Embeds analytics support into Business Monitor Multidimensional analysis enabled in Dashboard

Dimension and Report views.

Now installed / configured as part of the product

Upgrade to Cognos BI for advanced analytics of

data collected by Business Monitor27


29/54

Business Space

Business Space widgets provide visualization of theBusiness Monitor data.

Uses AJAX for a rich user experience in a web browser.

Uses the Business Monitor REST API to retrieve datafrom the Business Monitor server. No need for Portal Server. Packaged as a web application.

28


30/54

Business Space with a Proxy

Business Space widgets for Monitor are client-side mashups. In a client side mash-up the web browsers Same-Origin Policy

prevents loading data from multiple web servers. Proxy allows you to install REST Service, Alphablox, Business

Space Manager, and the Business Space Widgets in separateservers. When these components are installed into clusters, you need an

HTTP server to distribute traffic among all the cluster members;this same HTTP server can act as a proxy.

29


31/54

Business Monitor API REST Service

Provides access to the data that Business Monitor has collected

Packaged as a Web Application that conforms to RepresentationalState Transfer (REST) architectural style

JSON formatted responses enable easy integration of BusinessMonitor data when developing Web 2.0 Applications

Use of the API REST Service is not limited to Web applications For example, Business Monitor provides a Microsoft Excel plugin that

uses the REST APIs to import business monitoring metrics 30


32/54

Business Monitor Action Services

Listens for Business Situation Events emitted by a model. Performs actions in response to Business Situation Events,

for example: Send an email

Have an alert displayed in a users Business Space Send a page or SMS message Invoke a Web Service or SCA component

Also required for dashboard-defined alerts Packaged as an EAR

31


33/54

Data Movement Service

Optimizes server processing and reporting in higher volumeproduction environments.

Moves data from operational tables to reporting tables whilepruning completed instances from the operational tables.

Operational tables are optimized for inserts and updates, andthe reporting tables are optimized for dashboard queries.

Optional recommended for use in high-volume environments

32


34/54

Data Services Scheduler

Performs data services at scheduled intervals:

Data movement service

Cube summary table refresh

Cube refresh

KPI history

KPI predictions Dynamic alert evaluation

Data archiving and pruning

Packaged as an EAR33


35/54

Monitor Runtime Configuration

Tuning parameters

Release-to-release performance results

Error Handling

Error Queue

34


36/54

Tuning Parameters

Use multi-threaded mode

Tune batch and cache sizes

Defaults are pretty good

Stand-off delays allow grouping

related events togetherAffects dashboard latency

Enable reordering if asynch

event emission was used

Time-based trigger tuning35


37/54

Additional Tuning Suggestions

Monitor 7.0 Performance Report

CEI: Disable the CEI event data store and the All Events queue,use queue bypass

Database: Increase buffer pools, use RAID disks, use RUNSTATSto help the optimizer

Event processing measurements: 1711 events/second for 1 model,5208 events/second for 8 models

Work Load Estimator sizing tool (available from Techline)

BPM 7.0 Performance Tuning redpaper

http://www.redbooks.ibm.com/redpieces/abstracts/redp4664.html

BPM 7.0 Production Topologies redbook

http://www.redbooks.ibm.com/redpieces/abstracts/sg247854.html

36


38/54

Release-to-Release Performance

0

250

500

750

1000

1250

1500

1750

2000

Monitor 6.0.2 Monitor 6.1 Monitor 6.2 Monitor 7.0*

Events per Second

Results obtained by a monitor model installed to a single machine37


39/54

Error Handling

Hard vs. soft exceptions

Choose which exceptions

should cause that instance tostop processing events

Correlation exceptions

Parent exceptions

Value out of range behavior

Retry settings

38


40/54

Error Queue

Use the admin console (or wsadmin/Jython)to view and administer the error queue

Hard exceptions sent here (multi-threadedmode only)

All future events that correlate to the sameinstance also

Check here if dashboards not showingexpected results

39

Just Announced


41/54

40

Increasing Visibility with Advanced MonitoringWebSphere Business Monitor V7 for z/OS

Now you can run the entire Monitorinfrastructure on z/OS

This adds to previous z/OS related Monitorcapability

Monitoring events from infrastructure running onz/OS (CICS, IMS, MQ, WebSphere MessageBroker, WebSphere Process Server, etc)

RACF for user registry/security repositoryMonitor data in DB2 for z/OS (performanceimprovement in 7.0)

Ability to federate Monitor running on zLinuxinto a z/OS cell

Monitor V7 for z/OS: You can now runmonitor models on z/OS. Now you canhave your entire BPM suite running in asingle, homogeneous z/OS cell.


42/54

Agenda


41





43/54

High Availability

Use clustering to avoid a Single Point of Failure,and for workload management*

Vertical and Horizontal clustering optionsCan also mix, or have a cluster of one

Consider using an HA database DB2 HA/DR

Oracle RAC

Your apps arent HA unless their monitoring is HA!Eventually event emission will fail if MM is down too long

Consider using WebSphere MQ to support deep queues42


44/54

High Availability, continued

Cluster the emitting application (if J2EE-based)

Use synchronous delivery if sequence info not in events

Cluster the CEI event server application

CEI can become the bottleneck otherwise

Cluster the monitor model applications

HA Manager enforces singleton policy

Use core-group policies to pin each MM to its own

desired cluster member, to spread work around

Offers fail-over in the event of an outage; avoids aSingle Point of Failure; supports fail-back

43

Business Monitor as part of BPM Deployment


45/54

Business Monitor as part of BPM DeploymentEnvironments

v6.2 Background WPS has provided Deployment Environment

concept since 6.1.x. DeploymentEnvironments encapsulate a cells entire

topology configuration, making it easy tocreate topologies from best practice patterns

Sample 4-cluster topology with 2 nodes for failover and scalability

v7 Improvement WPS has made Deployment Environment

framework a common componentavailable to all BPM stack products.

Monitor exploits Deployment Environmentframework and offers two out of the boxtopology patterns:

Create a 1-cluster topology for POCs andsmall production environments that needsimple failover

Create a 4-cluster topology for increasedproduction isolation and scalability

44

Business Monitor as part of BPM Deployment


46/54

Business Monitor as part of BPM DeploymentEnvironments

This option creates a 4 clusterBPM Golden Topology

Administrator enters configuration parameters in a six-step wizard. TheDeployment Environment wizard then automatically updates 500+configuration files that comprise the topology configuration. 45


47/54

The whole story!

46


48/54

Summary

Model with performance in mind

Follow tuning recommendations

Choose queue-bypass

Plan for highly availability

Use the BPM Golden Topology

47


49/54

48

We Value Your Feedback !

Please complete the session survey for this session by:

Accessing the SmartSite on your smart phone or computer

at: http://imp2010.confnav.com Surveys / My Session Evaluations

Visiting any onsite event kiosk

Surveys / My Session Evaluations

Each completed survey increases your chance to win anApple iPod Touch with daily drawing sponsored byAlliance Tech

Get started on the path to agility performance and


50/54

49

Get started on the path to agility, performance, andgrowth TODAY !

Learn about Getting Started with IBMBPM for Rapid ROI

Read case studies to see real examplesof business value derived by BPMenabled by SOA

Learn about BPM FastPath Goal to

achieve BPM success in 90 days forinitial projects

Get started quickly with no-cost cloud-

based BPM tools on BPM BlueWorks

Contact an IBM Representative to schedule a no-cost BPM DiscoverySession and let us show you how BPM can help optimize your business

ibm.com/bpm


51/54

50

Visit the BPM Samples and Tutorials page!

http://publib.boulder.ibm.com/bpcsamp/

Go to the Business Process Management Zone!


52/54

51

Go to the Business Process Management Zone!

http://www.ibm.com/developerworks/bpm

Learning More about WebSphere BPM


53/54

52

Learning More about WebSphere BPMIBM Education Assistant

http://publib.boulder.ibm.com/infocenter/ieduasst/v1r1m0/topic/com.ibm.iea.wbmonitor_v7/plugin_coverpage.html

C i ht d T d k


54/54

53

Copyright and Trademarks

IBM Corporation 2010. All rights reserved. IBM, theIBM logo, ibm.com and the globe design aretrademarks of International Business MachinesCorporation, registered in many jurisdictionsworldwide. A current list of IBM trademarks is availableon the Web at "Copyright and trademark information"

at www.ibm.com/legal/copytrade.shtml. Othercompany, product, or service names may betrademarks or service marks of others.

ws bus monitor best practices

Documents