efficient big data solutions: how to maximize results with less effort and lower costs
DESCRIPTION
TRANSCRIPT
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
Do you know who this is?
© 2014 PSC Group, LLC
Big Data Today
© 2014 PSC Group, LLC
Agenda – Big Data v Complexities of Terabyte Storage
v Storage Array Networks
v Ultra-Fast Networking Requirements
v Data Warehouse Basics
v Analytics Tool Recommendations – Hadoop?
v Ad-hoc Reporting
v Back-up Strategies
© 2014 PSC Group, LLC
v Complexities of Terabyte Storage
v Storage Array Networks
v Ultra-Fast Networking Requirements
v Data Warehouse Basics
v Analytics Tool Recommendations
v Ad-hoc Reporting
v Back-up Strategies
Agenda – Big Data
stop thinking like a geek
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
For Production
From Consumption
Our Focus needs to be on Information Consumption
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
We exist to help others make better decisions.
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
Real vs. Perceived Value
If we just provide the INFORMATION…
v Do we care if the message is received?
v Do we care if the message is understood?
v Do we care if the proper action is taken?
v Are we JUST providing information or are we helping the business to achieve a result?
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
What is our
Delivering Information CONDUIT
COMMUNICATOR
PARTNER
Describing a Situation
Guiding the User
Knowledge
Information
Wisdom
© 2014 PSC Group, LLC
What is our
Delivering Information CONDUIT
COMMUNICATOR
PARTNER
Describing a Situation
Guiding the User
Knowledge
Information
Wisdom
© 2014 PSC Group, LLC
What is our
Delivering Information CONDUIT
COMMUNICATOR
PARTNER
Describing a Situation
Guiding the User
Knowledge
Information
Wisdom Better Relationship between Business & IT
© 2014 PSC Group, LLC
Seems Logical…���but it’s just not that easy
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
Impediments to Success v Statistics
v Attention
v Perception
v Motivation
v Extreme Speed
v Information Overload
© 2014 PSC Group, LLC
Compelling Influences
© 2014 PSC Group, LLC
Statistics of Statistics v Who has taken a statistics class?
v Who has applied the scientific method at work?
v Who wishes their staff would?
v Who has recently done a Chi-squared test?
v Who has recently peformed a t-test?
v Who has done a correlation analysis?
v Who has done a regression analysis?
© 2014 PSC Group, LLC
A man is described as meek, shy, tidy and helpful…
© 2014 PSC Group, LLC
A man is described as meek, shy, tidy and helpful…
Is he more likely to be a librarian or a farmer?
© 2014 PSC Group, LLC
Statistics FAIL
© 2014 PSC Group, LLC
Statistics FAIL
Don’t Assume the People with the Statistics Understand Statistics
© 2014 PSC Group, LLC
Statistics Success v Large Global Insurance Firm
v Large Investments/Improvements in Network
v Perceived Network Sluggishness by Users
v Sr. Management Getting Negative Feedback
v We Executed a Large Statistical Analysis
v Compared Technical Data & User Surveys
v Suprising & Statistically Significant Finding!
© 2014 PSC Group, LLC
Attention?
© 2014 PSC Group, LLC
Paying Attention?
In our distracted world, people often miss critical changes
© 2014 PSC Group, LLC
What Letter Is This?
© 2014 PSC Group, LLC
What Letter Is This?
C T
© 2014 PSC Group, LLC
Are you sure?
C T T E
© 2014 PSC Group, LLC
Are you sure?
C T T E
CONTEXT is VERY IMPORTANT
© 2014 PSC Group, LLC
Motivation
Distractions CONFLICTS Choices
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
In 60 Seconds… v 1 new definition in urban dictionary
v 1600+ reads on Scribd
v 13,000+ hours of music streaming on Pandora
v 12,000+ new ads posted on Craigslist
v 370,000+ minutes of voice calls on Skype
v 98,000+ Tweets
v 320+ new Twitter accounts
v 100+ new LinkedIn accounts
v 1 new associatedcontent article published
v 6,600+ new pictures uploaded on Flikr
v 50+ WordPress downloads
v 125+ WordPress plugin downloads
v 695,000+ Facebook status updates
v 79,364 Facebook wall posts
v 510,040 Facebook comments
v 1,700+ Firefox downloads
v 694,445 Google search queries
v 168 million emails are sent
v 60+ new blogs
v 1,500+ new blog posts
v 70+ domains registered
v 600+ new YouTube videos
v 25+ hours of duration of new YouTube videos
v 100+ questions asked on the Internet
v 40+ questions answered on the Internet
v 13,000+ iPhone applications downloaded
v 20,000+ new posts on Tumblr
© 2014 PSC Group, LLC
Which one would you read?
© 2014 PSC Group, LLC
The Pace of Business is Incredibly Fast
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
It’s all about
processing the Past INFORMATION
predicting the Future
Observing the Present KNOWLEDGE
WISDOM The VELOCITY of Information is Increasing
CONTEXT facilitates consumption DELIVERY method favors speed
© 2014 PSC Group, LLC
All Efficient Systems/Processes want Matching Velocities
© 2014 PSC Group, LLC
Don’t let Precision���Slow You Down
© 2014 PSC Group, LLC
Information Velocity
is a function of
ACCURACY, CONTEXT
and DELIVERY
© 2014 PSC Group, LLC
Information Overload
© 2014 PSC Group, LLC
Multi-Tasking?
© 2014 PSC Group, LLC
Our Changing World
© 2014 PSC Group, LLC
The Real Deal?
© 2014 PSC Group, LLC
Training vs. Frequency
TRAI
NING
FREQUENCY OF EXECUTION
© 2014 PSC Group, LLC
Zombie Systems
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
500mph?
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
In-Race Adjustments
© 2014 PSC Group, LLC
v A simple business process is running a race
v A simple metric is the distance x(t) you cover
v To measure success you need to know your position at time t
v In order to improve you need to know distance and time… which gives you velocity v(t) = δx/δt
v And if you take that one step further you get acceleration a(t) = δv/δt
v This is great because changes in acceleration are an early warning system – Predictive Analytics!
WARNING! Calculus Content
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
Context, Context, Context Business Processes & Time, Location, etc.
Interpret & Present Visually Interpret Results & Reveal Change!
It’s all about TIME Velocity, Accuracy & Half-Life
Split Times & Training Information that is useful DURING the race
CLEAR
EASY
RELEVANT
ACTIONABLE
© 2014 PSC Group, LLC © 2010 PSC Group, LLC
Location
GPS
Proximity
Social Network
Tools
You were on fire tonight!
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
Technology alone does not provide context CONTEXT is the product of
Environment & Information
Right TIME, Right PLACE, Right PERSON
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
© 2014 PSC Group, LLC
Inside Sales - Quoting
Accounts Receivable Clerk
Customer
© 2014 PSC Group, LLC
The focus should be on the business processes���NOT the Technology
v Do you have a written inventory of key business processes?
v Do you know expected completion times?
v Do you collect any split-times?
v Do you benchmark against others?
v Do you benchmark internally?
© 2014 PSC Group, LLC
Split-Times are the Key to
RESULTS
© 2014 PSC Group, LLC
Annur & Panel – SPOT ON!
People
Process
Technology
© 2014 PSC Group, LLC
Context, Context, Context Business Processes & Time, Location, etc.
Interpret & Present Visually Interpret Results & Reveal Change!
It’s all about TIME Velocity, Accuracy & Half-Life
Split Times & Training Information that is useful DURING the race
CLEAR
EASY
RELEVANT
ACTIONABLE
© 2014 PSC Group, LLC
Big Data Pattern Quiz
v 12 Days
v 32 Years
v 32,000 Years
© 2014 PSC Group, LLC
Big Data Pattern Quiz
v 12 Days ≈ 1 Million Seconds
v 32 Years ≈ 1 Billion Seconds
v 32,000 Years ≈ 1 Trillion Seconds
© 2014 PSC Group, LLC
$100
© 2014 PSC Group, LLC
$10,000
© 2014 PSC Group, LLC
$1 Million
© 2014 PSC Group, LLC
$100 Million
© 2014 PSC Group, LLC
$1 Billion
© 2014 PSC Group, LLC
$1 Trillion
© 2014 PSC Group, LLC
$1 Trillion
© 2014 PSC Group, LLC
Our National Debt
© 2014 PSC Group, LLC