2015: where the rubber meets the road for big...
TRANSCRIPT
2015: Where The
Rubber Meets The
Road For Big Data
Wednesday, 18th March 2015
WANDISCO.COM
WANdisco: Who we are
WANdisco: Wide Area Network Distributed Computing
• Leader in tools for software engineers
• Highly successful IPO, London Stock Exchange, June 2012 (LSE:WAND)
• US patented active-active replication technology granted, November 2012
• Global locations o San Ramon (CA), Sheffield (UK), Belfast (UK)
o Chengdu (China)
o Tokyo (Japan)
o Boston (MA)
o Chennai (India)
WANdisco: Who we work with
“Go ahead – make my day, punk. Tell me again about Big Data”
“I'm Big Data and so's my
wife”
Big Data: Technology Moves in Dog Years
Sheikh Zayed Road, Dubai – 1990
Big Data: Technology Moves in Dog Years
Sheikh Zayed Road, Dubai – 2013
2006 2008 2009 2010 2011 2012 Present
Core Hadoop
Hbase
Zoo Keeper
Hive
Pig
Whirr
Avro
Flume
Big Top
Solr
Spark
Parquet
Sentry
Fact: Hadoop Isn‘t Just Hadoop Anymore
The stack is continually growing and evolving,
with new layers added every year
Driver for Big Data is the business (not IT)
2012 2013 2014 2015 2016 2017
Digital Storage:
Annual Growth 60%
IT Budget:
Annual Growth 5%
2014 Year of the Proof of Concept
2015 Year of Production Deployment
2015: Year of Production Deployment
“Build it and they will come?”
Big Data: Build it and they will come?
Maybe not…
2015: Year of Production Deployment
“Are we making money
in China?”
“Are my actuarial risk
assumptions correct?”
“Can we do better at
stopping credit card
fraud?”
“Can I wish my
customers happy
birthday?”
UCI Health: Saving lives with big data
Challenge: In medical emergencies data
must be entered in real-time and available
for immediate retrieval and analysis
Hadoop ensures: Real-time access to
patient data in virtually any format and
elimantion of unecessary downtime
WANdisco brings: Virtual around the clock
doctor. All types of data can be stored,
retrieved and analysed at a low cost
International Bank: Understanding customers, protecting customers
Challenge: Targeting of financial products
using more complete customer intelligence.
Real-time risk management including fraud
prevention
Hadoop ensures: Consolidating
unstructured customer data – 50% of all
data. Cost of ownership 90% lower than
legacy platform
WANdisco brings: No more redundant
data storage. Analysis run time down from
hours to minutes
2015: Year of Production Deployment
Big Data in Numbers
• Roughly 1,400 customers now subscribing to Hadoop distributions
• Hortonworks customers rose from 54 to 292 in 2014
• Oracle 2015 predictions: “Hadoop will graduate from experimental pilots to standard
enterprise data management
• $3.0bn invested in Hadoop technologies last year
2015: Year of Production Deployment
Hadoop is now at the point where the
rubber meets the road
• Operational Tooling
• Security
• Reliability
2015: Year of Production Deployment
Hadoop is now at the point where the
rubber meets the road
• Operational Tooling
• Security
• Reliability
“Twice before over the past 50 years,
information technology radically reshaped
competition and strategy; we now stand at the
brink of a third transformation.”
Michael E. Porter, HBR Nov 2014
[http://hbr.org/2014/11/how-smart-connected-products-are-transforming-
competition/ar/1]