real-time streaming analytics: business value, use cases and architectural considerations: impetus...

Real-time Streaming Analytics

Business Value, Use Cases and Architectural Considerations

Big Data Solutions and Services Partner for Enterprises

Anand Venugopal – Sr. Director Business DevelopmentBig Data Solutions

1

Yue Cathy Chang – Sr. Director Business DevelopmentAlliances and Partnerships

Picture your house

2

What if this was happening now to your home ?

3 Recorded version available at http://bit.ly/1i6OrwR

http://bit.ly/1i6OrwR

When do you want to know ?

4

Later

or

Now ?

Recorded version available at http://bit.ly/1i6OrwR


Your best buddy from school

You haven’t met in years

5Recorded version available at http://bit.ly/1i6OrwR


Is in Vegas same time as you

Your buddyYour buddy

You You



When do you want to know ?

After you return

or

NOW ?



• Whether individual or Business

• Important things are always happening NOW

• NOW is the ONLY time life REALLY happens

• Maximize data value process and act sooner!

Life is happening NOW

Real-time insight preserves or creates value

8

Topics we will cover today

Why ?Business Value

What ? Is Real-time Streaming Analytics and what it is not

How?Architectural considerations

Use cases

Who and Where ?

What next ?Recommendations



What it is NOT

• Quick-response interactive analytics on static data

• Batch processing

• Could be close but still NOT – Micro Batch processing

What is Real-time Streaming Analytics ?



• Data analyzed in motion – as it arrives

• Routine: Monitoring, Counting, Alerting, Reporting

• Complex Decision Making with Predictive analytics

• Every incoming event is distinctly processible

• Receive, Inspect, Analyse, Store, Distribute

• Events may be stored later or in parallel

• Immediate actions possible after processing

What is Real-time Streaming Analytics ?



Real time vs. Batch analytics

Sec/

ms

Sec/

ms

Sec/

ms

Sec/

ms

BATCHBATCH

Real timeReal time




Why ?Business Value



Use cases

Who and Where ?




Business Value

Diminishes with the age of data

The drop is non-linear

$$$ ?

Before

• Predictive analytics based on current events

• Value depends on accuracy

$$ NOW

• Real-time• Certainty is high – REAL• Value based on quick

response

$$$

Later

• Descriptive

• Diagnostic

• Least value

15

Value of Data

Age of Data

• Routine business operations (Real time systems)

• Cutting preventable losses

• Finding and monetizing missed opportunities

• More revenue

• Cost savings

• Creating new opportunities

• New Business models (Products, Services, Revenue)

Business Value from RTSA




Why ?Business Value



Use cases

Who and Where ?




Routine Operations (RT systems)

• Manufacturing – Control Systems (Closed loop)

• IT - Systems & Network Monitoring

• Field Assets Monitoring and Alerting

• Trucks, Oil rigs, Vending machines, Radio towers

• Financial Transactions Processing

• Authentications, Validations, Fraud



Cutting Preventable Losses

• MH 370 – Loss of lives and assets

• GM – Manufacturing defects

• Target – Major Security breach

• Stock Exchange Meltdown

Many headline stories are failures inroutine operations and were preventable losses



Cutting Preventable Losses (2)

• Medical / Clinical – Complex analytics in ICU

• Disaster Warning Systems: Chile / Sandy

• Brokerage - Fraudulent or Risky Trades

• Preventive Maintenance – Machines, Plants

• Customer Churn

• Brand Reputation on Social Media


Missed Opportunities - Revenue

• Customer Service always happens in real-time

• Listening and Learning from customers (Social)

• Context sensitive inventory – Products, Ads

• Recommend - Upsell – Cross-sell


Missed Opportunities - Efficiency

• Operational Efficiency of systems or processes

• Network Optimization for cost, quality of service

• Dynamic capacity management

• Dynamic re-routing of traffic, cargo

• Insurance Adjudication – Drone image analysis


New Opportunities

• Tractors are becoming soil sensors

• Information service to farmers

• Nike – becoming a healthcare company ??

• Quantified self movement

• Telecom giants selling data and insights


Business Value of RTSA Summary



Why ?Business Value


How ?Architectural considerations

Use cases

Who and Where ?



Architectural Considerations (1/3)

ALW

AYS

ACCURATELY

APPROPRIATELY


Real time + Batch Analytics


Real-time streaming analytics pipeline and flow


Real-time streaming analytics pipeline and flow

Scale and Robustness

Reliability - Guarantees

Publish-Subscribe

Flexibility – Dynamic

Integration with Batch

Loose Coupling

Visualization

Ease of Administration


StreamAnalytix


•Proprietary platforms

• Vendor lock-in

• No leverage of open source movement

•Do it yourself

• Open source stitch up

• Integration and maintenance nightmare

• Significant delays in time-to-market

Approaches to Stream Analytics


• An “App Server” for real-time apps

• Based on best-of-breed Open source

• Focus on your Business logic leave infrastructure to the platform

• Handle all the 3V’s of Big Data in one platform

• Seamless integration with Hadoop, NoSQL or any other DB

• Rapidly operationalize pre-built analytical models or new ones

• Significant time to market acceleration

• Impetus provides full product support and professional services

Introducing ‘StreamAnalytix’



Why ?Business Value

What ? Is Real time streaming anaytics and what it is not


Use cases

Who and Where ?



• Important things are always happening NOW

• Maximize data value process and act sooner!

• There is value – find it Improve Ops, Cut losses, Find missed & new opportunities

• Architecture: Sense Analyse Act Sense

RECAP

38

Real time insight preserves and creates business value

38

• Get Real time streaming analytics in your roadmap

• Talk to experienced peers and consultants

• Start now with opportunities search, solution architecture and vendor conversations

• Instrument (SENSE) everything – find gaps and fill

• Prove value with “faster batch” with current infra is possible

• Establish mechanisms to ACT on the insights

• Close the loop – Sense and Analyse effectiveness

• DO IT

RECOMMENDATIONS



Why ?Business Value

What ? Is Real time streaming anaytics and what it is not


Use cases

Who and Where ?


40

Big Data Solutions and Services partner for Enterprises

Request a demo of StreamAnalytix

[email protected]


@impetustech

real-time streaming analytics: business value, use cases and architectural considerations: impetus...

Technology

recorded version available

revenue business value

realtime streaming analytics

value of data age of

data value process

business value of rtsa

predictive analytics

high real value