Event Driven Business Intelligence

By Ali BELCAID – Managing Consultant

Business Event Implementation

Business Event Approach to Project

New BI Architecture

Event Management - Where it is Applied

Context : Traditional BI

ContextTraditional BI Architectures

Business Intelligence (BI)• Reports• Olap• Dashboards

Real-time BI• Real-time Operational

Dashboards• Alerts and escalation• Collaboration

Files

ERP

CRM

FIN

HR

ETL

ETL

ETL

Datawarehouse or ODS

DatamartsOperational sources• Relational Databases• Mainframe• Flat files

ContextTraditional BI Architectures

As matter of fact :

Business users are relying on inflexible, heavy and costly BI platform : each time they ask for new request, they have to wait for

Business users are relying on past figures, so that they are delaying their decision every time waiting for the right information until they get it

Their BI platform is not synchronized with their business processes : there is a clear GAP between their BI and their processes

There is no way to have insights from what Business User is doing at the moment : He has to wait for having it !

Many companies are struggling to get people having real-time data but they are doing it in the wrong way

Avoid :Data Latency

Analysis LatencyDecision Latency

Do not wait for a long Time:

quicker response to detected issues

Pote

nti

al B

usi

ness

Valu

e

Business Event

Data Stored

Information Delivered

Information Analyzed

Action Taken

Action time

Business Event Trigger every Data

Handling

ContextContinuous Intelligence – Avoid Latency

Data Latency is what is causing Traditional BI not to reach the goal of having the right data at the right time.

CustomerLogon

Fed Base RateIncrease

ProductionItem

Arrives at Store

CustomerChecks

“Close Account”Web Page

NewLiabilityAdded

RentalCar

Returned

NewOrder

ContractSubmitted

ContractReturnedthru EDI

RentalCar

Crashed

Mobile Callfrom CT@11.13

ContextReal World Event

In real world (and real business also) we are surrounded by Events. We have to respond to these events in such way there will be no interruption in what we are doing : This is where Business Event comes to play a new role in the BI universe as support to our Business decisions.

Fraud Risk!

Risk of CustomerDefection

EmployeeOver hours

CustomerCrossSell

Opportunity

ComplianceLimit

Approached Customernow rated

Gold

Change inProduct Sales

Trend

ContractValidated

ContractValid

RentalContract Complete

Cell phonefraud alert

ContextWhere is the information ?

These Events when there identified they could mitigate many risks that companies are facing in day to day operations

So, applying Business Event Processing to BI makes a real sense to bring real-time support decision to Business Users

Business Event Implementation

Business Event Approach to Project

New BI Architecture

Event Management - Where it is Applied

Context : Traditional BI

New BI ArchitectureStreaming Analytics

Business Intelligence (BI) Reports Olap Dashboards

Real-time BI Operational Dashboards Alerts and escalation Collaboration

X

Events

Files

ERP

CRM

FIN

HR

ETL

ETL

ETL

Datawarehouseor ODS

Datamarts

Store Data for : Trend Analysis Comparative analysis Analysis on historical data

ADAPTERS

ESB

External Data

Event Database

Business Event

Processing

Filter / Aggregate

Correlate

Act

Capture

Continuous data flows

OKCancelHelp

Execute Action

Provide values for the following action parameters:

WestRegion

Begin Marketing Campaign

Campaign ID 42684

New BI ArchitectureExample – Action from Insight

This is an illustration of the way a Marketing Director can manage his campaigns according to info's brought into his dashboard. This is all about bringing intelligence into processes.

Bringing real-time data will turn this into Continuous Process Intelligence

Business Event Implementation

Business Event Approach to Project

New BI Architecture

Event Management - Where it is Applied

Context : Traditional BI

Business Event ApproachHow do we tackle a Business Management Event

Project?

Bringing Event Processing Management into BI world requires the use of new approach to

tackle projects. You can use a phased approach containing 3 steps : Sense, Analyze and

Respond. This approach is well known in the CEP (Complex Event Processing) arena.

Event 1

Event 2

Event 3

Event 4

Event 5

…

Event n

Correlation with external Events

Business Rules

Analysis

Act byMaking

Decision

- Alert in Dashboard- Activate a Process- Activate another application- …

Sense Analyze Respond

The sensing part obtains information from within and outside the enterprise. This part obtains the data that defines “reality.”

The analysis part correlates or fuses data to determine an estimate of the current state, and to compare the real state with the plan. In effect, the analysis part continuously evaluates the when clauses of when-then rules by fusing information from all the sensors and determines if the then clauses should be executed.

The responders execute the then clauses. This part responds when reality deviates from expectation by modifying expectation (the plan) and executing responses such as sending alerts, invoking applications, and initiating operations by actuators.

Business Event ApproachProject Phases - Sense

Group 1

Group 2

Group 3

Group 4

Functional Requirements

1. Determine Business Objectives that you are looking at

2. Determine the kind of events you want to manage and if your system allows you to get them internally or externally.

3. Classify and group events that could be threats or opportunities depending on the expected analysis.

Technical Requirements

1. Determine Event Sources• Do you have access to the events ?• What are the security Requirements

2. Determine Event Transport Services• Publish and subscribe messaging• Feed backed transport such as RSS or ATOM• Request / Reply (Pooling) and SOA

3. Determine your adaptation requirement• SNMP• File adapters• Database

Events

Business Event ApproachProject Phases - Analyze

3. What rules & calculations should be applied?

truetrue

false

false

1. What are the sources of data?

2. What is the temporal or spatial link between the data sequences?

Group 1

match

match

Stream1

Stream 2

Stream 3

Stream n

Event Correlation

Complex Event

Stream Adapters

4. How to correlate ?

Business Event ApproachProject Phases - Respond

Decision-Centric Automation

Routes work among people

Keeps track of work statusTask-oriented Collaborative Informational

Transaction-Centric Automation

Straight-through-processing

Optimized to avoid manual steps and redundancy

Event-driven

Investigate to Respond

AutomaticResponse

Manage Exceptions

Automated Detection

Business Event Implementation

Business Event Approach to Project

New BI Architecture

Event Management - Where it is Applied

Context : Traditional BI

Business Event ImplementationTIBCO Business Event Server – The platform

Complex Event Processing Event Filtering, Aggregation,

Correlation Missing Event Detection Causal & Timing Relationships Multiple Event Patterns & their

relationships Reactive Rules Triggered By

Event Patterns

End-to-end visibility intocorporate performance SLA violation Fraud detection Up-sell opportunity

Offers Real-Time Analysisof Events

Source Tibco®

Business Event ImplementationTIBCO Business Event Server – State Model

– Visualize Object Life Cycle

Source Tibco®

• Visualize dependencies of Rules.• Eliminate conflicts among Rules/Conditions.• Visualize Concept and Event relationships through rules.• Drill down to a concept, and see its dependencies.• Visualize what gets fired when something changes, and

its ripple effect.

• Profile runtime metrics/statistics of the engine for each rule, and optimize the rule.• Combined with the debugger, shows when a rule is fired.

Business Event ImplementationTIBCO Business Event Server – BE

Features – Rules Analyzer

Source Tibco®

Business Event ImplementationTIBCO Business Event Server – BE

Features – Decision Manager

Source Tibco®

Business Event ImplementationTIBCO Business Event Server – BE

Features – Rules Tester

Source Tibco®

Business Event Implementation

Business Event Approach to Project

New BI Architecture

Event Management - Where it is Applied

Context : Traditional BI

Business Event Management Fields where it is applied

Financial Services

Algorithmic Trading in many asset classes

MIFID compliance, Surveillance Fraud detection SWIFT money transfers Real-time risk management Smart order routing Market making Market aggregation Treasury centralization International funds transfers ATM monitoring and control Clearing Cash and securities payments

with interbanking compensation

Health Care

Patient monitoring Fraud detection

Public Sector / Government

Electronic battlefield Surveillance Emergency response War fighter monitoring Security Net centric applications

Travel

Flight logistics and operations Automated customer service

(kiosks, etc.) Automated and computer

assisted baggage handling (e.g., with RFID)

Real-time fare pricing

Telecommunications

Network management SLA management OSS/BSS systems Location-based services

Retail / Supply Chain

Automated supply chain Smart shelves Real-time point-of-sales analysis

and one-to-one marketing

Energy

Energy trading Pipeline monitoring Power grid monitoring and

control

Web

Click-stream analysis Real-time web page analysis On-line fraud detection

Entertainment

Casino fraud detection Dynamic customer loyalty programs On-line gambling and gaming.

http://intelligenteenterprise.blogspot.com/http://www.linkedin.com/in/albel