big data survey - ioug - 2013 - 594292
TRANSCRIPT
![Page 1: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/1.jpg)
![Page 2: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/2.jpg)
2
Big Data,
Big Challenges,
Big Opportunities
Joe McKendrick
Lead Analyst
![Page 3: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/3.jpg)
3
Survey on Big Data
• 298 data management and IT
managers/professionals
• Members of Independent Oracle Users Group
(IOUG); 98% run Oracle Databases
• Large organizations (>10,000 employees) 22%;
small firms (1-500 employees) 16%
• Major industries represented: manufacturing;
government/education/non-profit;
utility/telecommunications/transportation;
retail/wholesale; high-tech
![Page 4: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/4.jpg)
4
Observations
• Big Data is here now, and is flowing through all
organizations.
• With all this Big Data now on the scene, more
needs to be done to educate the business about
the potential of Big Data.
• Capitalizing on Big Data doesn’t mean making
huge financial investments or tearing down your
current infrastructure; rather, it can be
integrated and incorporated into your existing
assets.
![Page 5: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/5.jpg)
5
1.
Big Data is here now,
and is flowing through
all organizations.
![Page 6: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/6.jpg)
6
Total Amount of Data Managed Today
11% of organizations now
manage more than a petabyte of
data ...
...another 20% have data in the
hundreds of terabytes.
![Page 7: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/7.jpg)
7
It’s Mainly Larger Organizations, But...
28% of the largest
organizations have >1PB
8% of medium-size businesses
have >1PB
... Soon, most businesses of
all sizes will have data stores in
the PBs.
![Page 8: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/8.jpg)
8
Many types of data: transactional,
user-generated, machine generated
![Page 9: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/9.jpg)
9
Where It’s Coming From, Right Now:
![Page 10: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/10.jpg)
10
The Problem...
SILOS,
SILOS,
SILOS
![Page 11: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/11.jpg)
11
Growing Amounts of Unstructured Data
![Page 12: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/12.jpg)
12
Industries With the Most Unstructured Data
![Page 13: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/13.jpg)
13
2. With Big Data now
on the scene, more needs
to be done to educate the business
about its potential.
![Page 14: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/14.jpg)
14
Barriers: Business Doesn’t Understand the Value
Yet—Thus, Budgets are Falling Short ...
![Page 15: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/15.jpg)
15
Most Data Executives Do Not Feel Their
Data Infrastructure Is or Will Be Capable
72% of survey respondents are not completely
confident in their IT infrastructure and their
database systems for managing Big Data now ...
81% are not completely confident in their IT
infrastructure and their database systems for
managing Big Data in three years.
![Page 16: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/16.jpg)
16
Where Confidence in Data Infrastructure
is Lowest
![Page 17: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/17.jpg)
17
3.
Capitalizing on Big Data
doesn’t mean making huge
financial investments or
tearing down your current
infrastructure—it can be
integrated into your
existing assets.
![Page 18: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/18.jpg)
18
Big data is a
“natural resource”—
and it’s unlimited!
![Page 19: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/19.jpg)
19
There is Business Value in Big Data
55% of survey respondents
acknowledge that Big Data is
either “extremely” or “very”
important to their
business.
![Page 20: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/20.jpg)
20
Industries Where Big Data Really Matters
“Speed and accuracy are of the essence in
winning new business and maintaining current
customers.”
![Page 21: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/21.jpg)
21
Survey Respondents
Say Big Data Helps Them:
Just a few
other areas of
Big Data value:
customer
profitability,
text analytics,
e-commerce,
risk
management!
![Page 22: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/22.jpg)
22
Different Industries, Different Motivations
![Page 23: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/23.jpg)
23
“As the big data applications begin to
come on line, priorities within the
security/compliance group will become
more risk oriented. This focus will
allow the business to focus resources
toward those items that pose the
highest degree of risk to data.
Additionally, conditions that could be
seen as possible threat vectors or the
beginnings of events can be found
easier.”
![Page 24: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/24.jpg)
24
Technology That Will Get Us There
![Page 25: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/25.jpg)
25
Big Data Foundation Being Built on
Existing, Proven Environments—
Relational Databases
![Page 26: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/26.jpg)
26
How Data is Integrated With BI Applications
32% pre-process
Big Data then load
into data warehouse for
integrated analysis, but
...
... 46% are still unsure
how this
will play out.
![Page 27: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/27.jpg)
27
Are Data Warehouses a Big Company Thing?
36% of large organizations (>10,000
employees) pre-process Big Data
then load into data warehouse for
integrated analysis.
26% of small firms (<100 employees) use
data warehouses to manage
Big Data.
![Page 28: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/28.jpg)
28
Hadoop— especially for ad-hoc queries
and data mining
![Page 29: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/29.jpg)
29
Who Uses Hadoop?
(now/planned for this year)
![Page 30: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/30.jpg)
30
How Hadoop Is and Will Be Used
![Page 31: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/31.jpg)
31
Strive for a
“co-existence” strategy
between data systems—
not either/or.
![Page 32: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/32.jpg)
32
Managing and Staffing
Big Data Environments
![Page 33: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/33.jpg)
33
“We already have as close a
relationship with management as is
possible. We intend to keep it that
way by doing a great job on Big
Data, but we have no idea what the
percentage of the data flying past
[is]us good enough to capture.
Understanding the potential benefits
and liabilities of capturing a wide
range of data beyond traditional
transactions is an open-ended
subject.”
![Page 34: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/34.jpg)
34
Where Do Big Data Projects Originate?
![Page 35: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/35.jpg)
35
Even when business
takes the lead,
IT responsible for
implementation
In larger organizations, others also help oversee
implementations:
54% of respondents in large organizations say
BI/analytics team oversees Big Data projects.
62% of large organizations also charge Big Data
implementations to DBAs.
![Page 36: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/36.jpg)
36
Who Makes It Happen?
![Page 37: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/37.jpg)
37
Business-Side Driver of Big Data Initiatives
![Page 38: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/38.jpg)
38
Financial Decisions
![Page 39: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/39.jpg)
Recommendations
• Develop a business case.
• Get business buy-in and support.
• Develop an integration strategy between
unstructured and “traditional” enterprise
data.
• Strive for a “co-existence” strategy between
data systems—not either/or.
• Develop an integrated information
management lifecycle strategy.
![Page 40: Big Data SurVey - IOUG - 2013 - 594292](https://reader031.vdocuments.us/reader031/viewer/2022020218/55a727d11a28ab7e5e8b4668/html5/thumbnails/40.jpg)