live demo: streaming analytics - vitria · hadoop cellular radio network . vip 1 .. vitria oi...

© 2014. VITRIA TECHNOLOGY, INC. All rights reserved.

Live Demo: Streaming Analytics

Dale Skeen, CTO & Co-Founder

Rajiv Onat, Director of Product Management

May 8, 2014

© 2014 | www.vitria.com | 2

Topics

What is Streaming Analytics?

What Problems Does It Solve?

Customer Use Cases

Live Demonstration

Streaming Analytics in Big Data Ecosystem


Request-based (when you ask)

One-time evaluation

Bulk algorithms

Disk-based (usually)

Traditional Analytics vs. “Streaming Analytics”

Event-based (when something happens)

Continuous evaluation

Incremental algorithms

In-memory (by design)

On-Demand “Real-time” Streaming Real-time ✔

In memory

Prospective

Predictive

Proactive

Investigative

Retrospective

Reactive

Retrospective

Investigative

Reactive


Streaming

Analytics

Streaming Analytics

Required capabilities

• Correlate and Enrich - across diverse sources

• Correlate across Time - Track and trace

• Detect Patterns & Trends

• Advanced Real-time Analytics

• Predictive Analytics


Real-Time

VISIBILITY

Immediate

ACTION

Vitria Operational Intelligence

powered by Streaming Analytics

• Respond quickly using Automated Processes & Guided Workflows

• Location and Situation Awareness

• Real-time Information in context

• Rich Dashboards

• User Empowerment

Streaming

Analytics

• Correlate and Enrich - across diverse sources

• Correlate across Time - Track and trace

• Detect Patterns & Trends

• Advanced Real-time Analytics

• Predictive Analytics


Se

cu

rity

&

Su

rveil

lan

ce

Str

ate

gic

Init

iati

ves

(custo

mer

sa

t.)

Streaming Analytics Use Cases

Customer Sat.

Brand Loyalty

Revenue

Cyber

Security

Fraud

Detection

Situational

Awareness

Asset Protection

Loss Prevention

& Reduction

Op

era

tio

na

l

Pe

rfo

rman

ce

Network

Service

Assurance

SLA

Monitoring

& Mgmt

Resource Optimization

Operational Health

Cost Reduction

Process

Efficiency

Real-time

Customer

Experience

Real-time

1-1

Marketing

Intelligent

Contact

Centers

Supply

Chain

Visibility

Intelligent

Processes


Success Story – O2, a UK Mobile Telco Real-Time Mobile Customer Experience

#1: Real-time VIP Customer Experience Monitoring

Detect events affecting VIP Customers, e.g. dropped calls

#2: Real-time, Predictive 1-1 Marketing

Predict where a customer’s needs and where his is going

#3: SPAM Detection

Detect “subscribers” texting SPAM

More than 24 problems identified for Streaming Analytics

Big Data in Motion

250,000 events/second

~10 billion events/day

2 TB per day

Largest Carrier in UK 40 Million Customers

in Europe

Subsidiary of Telefonica 7th Largest Telco WW

>320 Million Customers


Network Visibility vs. Customer Insight: How to ensure the best service for VIP Customers?

Telco Network Operations

200,000 devices

250,000 status events per second

~ 10 Billion events per day

Source: O2

No Notion of Customer


O2 Requirements How to ensure the best service for VIP Customers?

Volume of Data Velocity of Data

250,000’s events

per second Cellular

Network

CRM

Continuous Monitoring for Anomalous Events (Dropped calls)

Correlate among disparate sources CRM, Network Data, Device DB, …

Continuous Real-time Analytics # VIPs affected per Cell Tower

Automated Actions Immediate action based on analytics

< 1 sec


O2: VIP Customer Experience

Scalable Event Processing

Sources

Analytic Server

Analytic Server

Analytic Server

iBPM

iBPM

iBPM

Analytic Server

Analytic Server

Analytic Server

Analytic Server

Analytic Server

Analytic Server

Detect anomalous events

Correlate customer info

Multidimensional Analysis

Customer

Device

Automated Actions

Elastic Grid of compute

servers

Each use case deployed

as a long lived “project”

Project contains multiple

“tasks” pipelined together

Task uses Map-Reduce to

scale

Contextual data is

preloaded into memory

Intelligent BPM enables

quick action


Configurable

time window

Worst performing

cells sites

Drill-down by

cause code

Alarms on cells

exceeding

thresholds

Zoomable map of cell

performance with heat map Who is affected

Success Story – O2 Real-Time Mobile Customer Experience


Success Story – O2 Predictive 1-1 Marketing

10 million passengers/ year travel on

Eurostar trains via the Channel Tunnel

between UK and Europe.

Many are O2 customers.

Most turn off data roaming just before

leaving the UK.

Opportunity:

Text them a great data roaming offer just

before leaving UK.

Challenge:

Local Javelin trains share same routes

Highways next to train routes & stations

Problem:

Javelin Trains

share UK routes

Eurostar


O2 Requirements Predictive 1-1 Marketing

Volume of Data Velocity of Data

250,000’s events

per second Cellular

Network

CRM Correlate among disparate sources CRM, …

Correlate location to train route Geospatial (location) context

Track & Trace Passenger over time Ensure a train passenger

Correlate to Train Schedule Only track Eurostar passengers

Automated Actions Text the Roaming Offer

In-Time – between Ashford & Chunnel

Route


Mobile SPAM Detection (Fraud)

Detected spammers (IMSIs),

shown geographically

Most active spammers

Most active spam locations

Spammers are detected via a variety of

statistical techniques:

High bursts of SMS messages

Large daily message rates

High message rates from same location,

multiple IMSIs


DEMO


Vitria Operational Intelligence Platform Powered by Streaming Analytics


Data & Process Analysts

Business Users IT & Developers

OI Apps Designed for simplicity

Designed for business users Instant business Insights

OI Workbench Designed for power users Full power of OI Platform

Unified modeling

+

Faster and

Easier

Operational

Intelligence

=

Data To Insights to Actions In Minutes

Demo

Agile Development


Easily create and monitor real-time KPIs

Discover, analyze and create baseline process from live stream of events

Define, monitor, act and predict on activities

Easily compose custom dashboards from live data and analytic resources

Easily share insights and follow activities

Follow activity streams and receive notifications

Unified model driven development environment and development tools to create

multi stage event processing networks

Dashboards and notifications optimized for tablets and smartphones

Vitria OI Apps Demo What You Saw …


DEMO

© 2014 | www.vitria.com | 20 Hadoop

Cellular

Radio

Network

. . .

VIP

1

. . .

. . .

Vitria OI Platform Vitria OI continuously detects predictive failure patterns in real-time.

Event Flow

1. Raw events are captured by Vitria OI and sent to Hadoop

2. Failure Patterns are discovered offline in Hadoop

3. New Failure Patterns are dynamically added & monitored by Vitria OI

Hadoop for Offline Discovery of Patterns to Predict Equipment Failure

. . .

. . .

. . .

250,000 events/sec

VIP

2

VIP

3

Equip

Fail

1

Equip

Fail

2

Equip

Fail

3

Use

Case

1

Use

Case

2

Use

Case

3

CRM

Network

Config. DB Event

Capture

New

Patterns

MapReduce HDFS HDFS

Pattern Discovery

Telco Success Story Predicting Equipment Failure


Vitria OI and Hadoop Continuous Insight into Big Data in Motion & at Rest

Vitria OI + Hadoop

Lambda Architecture

Raw event are sent to both Vitria OI

and Hadoop.

Vitria OI for streaming analytics.

(Speed Layer)

Hadoop provides historical storage

and historical analytics.

(Batch layer)

Vitria OI can also query Hadoop to

provide real-time insight with

historical context

Event

Capture

Queries,

Use Cases

Data & Result

Streaming

Vitria

Capture &

Integration

Real-Time

Dashboards

Streaming

Analytics

Intelligent

BPM

Correlate Predict

Analyze Alert

Processes

Workflows

Advanced

Analytics

Time-Series

Analytics

Connectors

Transforms

Predictive

Analytics

Hadoop

MapReduce HDFS HDFS


In Summary: Streaming Analytics

Streaming Analytics applicable

across a wide variety of

problems:

Fraud & Security

Operational Performance

Revenue and Brand

Across Industries:

Telco

Energy

Retail

Supply Chain

Banking

Complementary and synergistic

with Big Data Initiatives


Questions?

Try Vitria OI At Your Own Pace – www.vitria.com/trynow

Learn More About Vitria OI – www.vitria.com

http://www.vitria.com/trynow

http://www.vitria.com/


Operational Intelligence Powered by Streaming Analytics

www.vitria.com

live demo: streaming analytics - vitria · hadoop cellular radio network . vip 1 .. vitria oi...

Documents