new release: solve your it performance issues with big ... · unique ip on splunk logs using...

43
© Copyright 2015 Vivit Worldwide © Copyright 2015 Vivit Worldwide New Release: Solve Your IT Performance Issues with Big Data Analytics February 10, 2015

Upload: others

Post on 09-Aug-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2015 Vivit Worldwide © Copyright 2015 Vivit Worldwide

New Release: Solve Your IT Performance Issues with Big Data Analytics

February 10, 2015

Page 2: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2015 Vivit Worldwide

Brought to you by

Page 3: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2015 Vivit Worldwide

Hosted by

Akshar Dave

Vivit Big Data SIG Leader

Page 4: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2015 Vivit Worldwide

Today’s Speaker

Alina Gicqueau

Product Line Manager - HP Analytics Center

HP Software

Page 5: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2015 Vivit Worldwide

Housekeeping

• This “LIVE” session is being recorded

Recordings are available to all Vivit members

• Session Q&A:

Please type questions in the Questions Pane

Page 6: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2015 Vivit Worldwide

Webinar Control Panel

Questions

Toggle View Window between

Full screen/window mode.

Page 7: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.

Solve IT performance issues with big data analytics

Alina Gicqueau

Product Line Manager, Analytics Center

HP Software, BSM

February 10,2015

with HP Operations Analytics

Page 8: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Polling question

How often does your team deal with impactful outages or performance degradation where the cause is not obvious?

every day

once/week

once/month

once a quarter

never

Page 9: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Evolution to Big Data Analytics Insights for IT operations management

Reacti

ve

Pro

acti

ve

Event triage

Statistical correlation

Known root

cause

Log management

Advanced analytics

Unknown root

cause

IT operations

Page 10: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Does this look like your last outage?

Applications

Storage Networks Servers

Applications

Networks Storage Servers

When all indicators are good

When too many events are triggered

?

Page 11: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

The answer lies in your data … but how do you make sense of it?

Data

• Immense volumes of data (up to 2Gb/server/day)

• Many different types (log data, events, topology, etc.)

• Numerous siloed data

sources (apps, storage, servers, networks,

mobile, etc.)

• And the complexity is

growing…

Page 12: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 12

Introducing HP Operations Analytics

Mobile app

Network

Storage

Cloud

System

Third-party tools e.g., Splunk

LOB

data

Non IT Data

Big Data Store

Vertica

Faster problem

resolution

Optimized resources

Higher staff productivit

y

Fewer outages

Metrics

Events

Topology

Logs

Application HP Operations Analytics Standalone, scalable platform

Visual Analytics

Automated Log Analytics

Predictive Analytics

Real time Alerting

Intelligent Search

Guided Troubleshooting

Page 13: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 13

Introducing HP Operations Analytics

Mobile app

Network

Storage

Cloud

System

Third-party tools e.g., Splunk

LOB

data

Non IT Data

Metrics

Events

Topology

Logs

Application

DATA – Store and analyze

everything!

• Vendor agnostic – analyze anything!

• Out of the box BSM integrations

• Non-IT data to perform analysis to aid LOB in

decision making

Page 14: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 14

Introducing HP Operations Analytics

Mobile app

Network

Storage

Cloud

System

Third-party tools e.g., Splunk

LOB

data

Non IT Data

Big Data Store

Vertica

Metrics

Events

Topology

Logs

Application

DATABASE for Big

Data

• Designed to process HUGE data volumes

• Store all data you want to keep in one

place

• Efficient compression, store, and retrieval

• Trusted by Facebook and Apple

Page 15: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 15

Introducing HP Operations Analytics

Faster problem

resolution

Optimized resources

Higher staff productivit

y

Fewer outages

HP Operations Analytics Standalone, scalable platform

Visual Analytics

Automated Log Analytics

Predictive Analytics

Real time Alerting

Intelligent Search

Guided Troubleshooting

Big Data Analytics

• Transforms data into

intelligence

• Tuned to work on complex,

hard to diagnosed, or

intermittent problems

• Delivers intelligence to the

right hands at the right time

• Highlights actionable trends

within and across IT domains

before they become issues

Page 16: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 16

Introducing HP Operations Analytics

Mobile app

Network

Storage

Cloud

System

Third-party tools e.g., Splunk

LOB

data

Non IT Data

Big Data Store

Vertica

Faster problem

resolution

Optimized resources

Higher staff productivit

y

Fewer outages

Metrics

Events

Topology

Logs

Application HP Operations Analytics Standalone, scalable platform

Visual Analytics

Automated Log Analytics

Predictive Analytics

Real time Alerting

Intelligent Search

Guided Troubleshooting

Page 17: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Find relevant logs

Overlooked

relevant

messages

Comb through for meaningful messages

From 100s

Scrutinize

findings

To 10s

Remember lessons learned

Uncertain

results

Act

Instead of human driven, manual trouble shooting Ad hoc process and results

T+ hours/days/weeks

Page 18: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Use automated log analytics Solving problems when the cause is unknown before performance is affected

From 1,000,000s

to 10,000s of

messages

To 1000s To 100s To 10s 1s

Root cause

T+ minutes

Clustering Severity and

keywords

Abnormal detection

Expert sourcing

Page 19: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Predictive analytics Using machine learning to anticipate the future

3. Trend analysis 1. Establish baseline high & low

2. Analyze seasonality

Page 20: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Two solutions. One unbeatable opportunity

Operations

Bridge

Operations

Analytics

• Unified

business data

• Visual

representatio

n

• Automated

Analytics

• Intelligent and

Predictive

Page 21: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Big Data

Trouble shooting

Operations Analytics

Remediate

Monitor Correlate

Operations Bridge

Service driven

Predict

Adapt to manage the known Analyze the unknown

Turn unknown

into known

Bi-directional Integration – Out of the Box

Analytics

Page 22: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

A day in the life of real-time analytics in action

Oracle is a registered trademark of Oracle and/or its affiliates.

Page 23: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Survey question

Over the last year, on average, what is your MTTR / incident?

<2 hours

>4 hours and <1 day

>2 days

don’t know

don’t track

Page 24: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

We’ve all seen this picture The problem is knowing where to act…

UNIX is a registered trademark of The Open Group.

Page 25: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

What we used to do Begin war room analysis

UNIX is a registered trademark of The Open Group.

Business as usual

Time to find root cause 36 hours

Resources engaged 5 experts from Application,

Database, UNIX®,

Network, and Storage

Revenue impact 2 weeks order backlog

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Page 26: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Assess the situation in real-time

Correlate related

metrics in a common

sleeve of time

Correlate related

metrics in a common

sleeve of time

Page 27: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Automatically analyze millions of logs to reveal root cause

Automatically reveals

time and count of most

significant log events.

Page 28: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Drill down to actual root cause log messages

Automatically reveals

time and count of most

significant log events.

Number of occurrences

of significant log data

over time

View the log message

content to identify root

cause

Page 29: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

HP Operations Analytics— minimizing revenue impact

Before

Ops Analytics

After

Ops Analytics

Time to find root cause 36 hours 30min

Resources engaged

5 experts from

Application, Database,

UNIX®, Network,

and Storage

1 expert

Revenue impact

(order backlog) 2 weeks ~4.5 hours

UNIX is a registered trademark of The Open Group.

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Page 30: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

New 2.2 features

Page 31: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Prevent problems with

near real-time alerting

Analytics based,

trigger scripts to

automate response

New: HP Operations Analytics 2.2

Analytics for converged

infrastructure

HP OpsA for HP OneView

Out of the box data, logs

import and dashboards

Add value to Splunk data

and find root cause in

minutes

Automated log analysis of

Splunk data

Page 32: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Prevent problems with

near real-time alerting

Analytics based,

trigger scripts to

automate response

1. Analytics Based Alerting

• Help user to know about re-occurring issues

without performing an investigation

• OpsA2.2 Alerts provide a capability to schedule

AQL execution on a selected time range

• Actions can be executed as a response to

alert: Email, Script execution, SNMP traps

• Suppression of alert actions to avoid recurring

notifications over the same data

Page 33: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

2. HP OpsA for HP OneView product

Analytics for converged

infrastructure

HP OpsA for HP OneView

Out of the box data, logs

import and dashboards

Power

HP OneView

Servers

Cooling

Enclosures

Power

devices

Page 34: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Upgrade to HP Operations Analytics

Application

HP OneView

Mobile app

Storage

Cloud

System

Third-party tools e.g., Splunk

LOB

data

Non IT Data

Metrics

Events

Topology

Logs

Trend analysis

Predictive insights

Anomaly detection

Unknown root cause resolution

Big Data Store

Vertica

HP Operations Analytics Standalone, scalable platform

Visual Analytics

Automated Log Analytics

Predictive Analytics

Content Framework

Intelligent Search

Guided Troubleshooting

Page 35: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

3. Automate Root Cause Analysis On Splunk Data

Add value to Splunk data

and find root cause in

minutes

Automated log analysis of

Splunk data

• Points to causes of the IT Operations issues without having to write search queries

• Reduce downtime with automatic root-cause analysis of log data coming from Splunk

• Improve staff efficiency by eliminating the need to build search queries to find root cause

Page 36: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Identify the most

significant

messages

Find real value in

hidden log data

Rapid analysis of terabytes of

log messages into clusters,

types

“No query needed” analysis of Splunk logs

Unique IP on Splunk logs using automatic Learning

Algorithms

OOTB behavior prediction based on behavioral learning

Splunk logs are analyzed, ranked,

and prioritized using machine

learning and algorithms developed

by HP Laps

3. Automate Root Cause Analysis On Splunk Data Rapidly identify root cause of the problem

Page 37: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 37

Analyze

millions of

data

points in

seconds

Avoid

outages

Increase

business

insights

Lower TCO Break the

silos

HP Operations Analytics Delivers

$

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Page 38: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 38

Polling question

About what % of time do you find the root

cause of your outages?

<25%

25-50%

51-75%

>75%

don’t know/don’t track

Page 39: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

Demo

Page 40: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

HP Operations Analytics

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

More data More power More results

Page 41: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

Questions?

Page 42: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2015 Vivit Worldwide

Thank you

• Complete the short survey and opt-in for more

information from HP Software.

www.hp.com/go/opsanalytics

www.vivit-worldwide.org

Page 43: New Release: Solve Your IT Performance Issues with Big ... · Unique IP on Splunk logs using automatic Learning Algorithms OOTB behavior prediction based on behavioral learning Splunk

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Survey question Please rank the following questions on a scale from 1-5, 5 being the

highest.

1. Please rank the relevancy of the topic presented.

2. Please rank the presentation made by the presenter

3. What future topics would you like to see.