the rise of analytics 3.0. thomas davenport

8/19/2019 The Rise of Analytics 3.0. Thomas Davenport

1/35

THE RISE OF ANALYTICS 3.0

How to Compete in the Data Economy

By Thomas H. Davenport, IIA Research Director

Copyright© 2013 IIA All Rights Reserved


2/35


About IIA

iianalytics.com | 2

IIA is an independent research firm for organizations committed to accelerating

their business through the power of analytics. We believe that in the new data

economy only those who compete on analytics win. We know analytics inside andout—it’s what we do. IIA works across a breadth of industries to uncover

actionable insights gleaned directly from our network of analytics practitioners,

industry experts, and faculty. In the era of analytics, we are teachers, guides and

advisors. The result? Our clients learn how best to leverage the power of

analytics for greater success in the new data economy.

Let IIA be your guide. Contact us to accelerate your progress:

Click: iianalytics.com

Call: 503-467-0210

Email: [email protected]


3/35


About Thomas Davenport

iianalytics.com | 3

IIA Research Director Tom Davenport is the

President's Distinguished Professor of IT and

Management at Babson College, and a

research fellow at the MIT Center for DigitalBusiness. Tom’s "Competing on Analytics"

idea was recently named by Harvard

Business Review as one of the twelve most

important management ideas of the past

decade and the related article was named

one of the ten ‘must read’ articles in HBR’s75 year history. His most recent book, co-

authored with Jinho Kim, is Keeping Up with

the Quants: Your Guide to Understanding

and Using Analytics.


4/35

CONTENTS

Introduction 5


1.0

2.0

3.0intro

sum

Analytics 3.0—Fast Impact

for the Data Economy 16

Summary &

Recommendations 29

Analytics 1.0—

Traditional Analytics 9

Analytics 2.0— Big Data 12

Analytics 3.0 is an environment that combines the best of 1.0 and 2.0 —a blend of bigdata and traditional analytics that yields insights with speed and impact.

iianalytics.com | 4


5/35

The impact of the data economy

goes beyond previous roles for data

and analytics; instead of slowly

improving back-office decisions, the

data economy promises newbusiness models and revenue

sources, entirely new operational

and decision processes, and a

dramatically accelerated timescale

for business.


Introduction:

The Rise of Analytics 3.0

Big-thinking gurus often argue that we havemoved from the agricultural economy to the

industrial economy to the data economy.

It is certainly true that more and more of our

economy is coordinated through data and

information systems. However, outside of the

information and software industry itself, it’s

only over the last decade or so that data-

based products and services really started to

take off.

iianalytics.com | 5- Introduction -


6/35


Around the turn of the 21st century, as the

Internet became an important consumer andbusiness resource, online firms including

Google, Yahoo, eBay, and Amazon began to

create new products and services for

customers based on data and analytics.

A little later in the decade, online network-oriented firms including Facebook and

LinkedIn offered services and features based

on network data and analytics.

These firms created the technologies and

management approaches we now call “bigdata,” but they also demonstrated how to

participate in the data economy. In those

companies, data and analytics are not just an

adjunct to the business, but the business

itself.

Examples of products and services

based on data and analytics:

search algorithms

product recommendations

fraud detection

iianalytics.com | 6

THE PIONEERS

“Cust

om Audiences” for targeted ads

“People You May Know”

- Introduction -


7/35

How GE adopted a big data approach:

► $2B initiative in software and analytics

► Primary focus on data-based products andservices from “things that spin”

► Will reshape service agreements forlocomotives, jet engines, and turbines

► Gas blade monitoring in turbines produces588 gigabytes/day—7 times Twitter dailyvolume


As large firms in other industries also adoptbig data and integrate it with their previous

approaches to data management and

analytics, they too can begin to develop

products and services based on data and

analytics, and enter the data economy.

GE is one of the early adopters of this

approach among industrial firms. It is placing

sensors in “things that spin” such as jet

engines, gas turbines, and locomotives, and

redesigning service approaches based on the

resulting data and analysis.

Since half of GE’s revenues in these

businesses come from services, the data

economy becomes critical to GE’s success.

“things that spin”

iianalytics.com | 7

Analytics 3.0 in Action

- Introduction -


8/35

ANALYTICS 3.0│FAST BUSINESS IMPACTFOR THE DATA ECONOMY

1.0Traditional

AnalyticsFast BusinessImpact for the DataEconomy

Big Data2.0

3.0

Copyright© 2013 IIA All Rights Reserved iianalytics.com | 8

“Analytics 3.0” is an appropriate name for this next evolution of the

analytics environment, since it follows upon two earlier generations ofanalytics use within organizations.

Analytics 3.0 represents a new set of opportunities presented by the dataeconomy, and a new set of management approaches at the intersection oftraditional analytics and big data.

- Introduction -


9/35Copyright© 2013 IIA All Rights Reserved

Analytics 1.0—TraditionalAnalytics

Analytics are not a new idea. To be sure, there

has been a recent explosion of interest in thetopic, but for the first half-century of activity,the way analytics were pursued in mostorganizations didn’t change much.

This Analytics 1.0 period predominated for halfa century from the mid-1950s (when UPSinitiated the first corporate analytics group in

the U.S.) to the mid-2000s, when online firmsbegan innovating with data.

Of course, firms in traditional offline industriescontinued with Analytics 1.0 approaches for alonger period, and many organizations stillemploy them today.

Analytics 1 0 Characteristics

1.0 Traditional Analytics

• Data sources relatively small andstructured, from internal systems;

• Majority of analytical activity wasdescriptive analytics, or reporting;

• Creating analytical models was atime-consuming “batch” process;

• Quantitative analysts were in “backrooms” segregated from business

people and decisions;• Few organizations “competed on

analytics”—analytics were marginal

to strategy;

• Decisions were made based onexperience and intuition.

iianalytics.com | 9- Analytics 1.0 -


10/35

Analytics 1 0 Data Environment

This was the era of the enterprise data

warehouse and the data mart.

More than 90% of the analysis activityinvolved descriptive analytics,

or some form of reporting.


From a technology perspective, this was the

era of the enterprise data warehouse and the

data mart. Data was small enough in volume

to be segregated in separate locations for

analysis.

This approach was successful, and many

enterprise data warehouses became

uncomfortably large because of the number of

data sets contained in them. However,preparing an individual data set for inclusion in

a warehouse was difficult, requiring a complex

ETL (extract, transform, and load) process.

For data analysis, most organizations used

proprietary BI and analytics “packages” thathad a number of functions from which to

select.

iianalytics.com | 10

Copyright 2013, SAS Best Practices

- Analytics 1.0 -



The Analytics 1.0 ethos was internal,

painstaking, backward-looking, and slow. Data

was drawn primarily from internal transaction

systems, and addressed well-understood

domains like customer and product

information.

Reporting processes only focused on the past,

without explanation or prediction. Statistical

analyses often required weeks or months.Relationships between analysts and decision-

makers were often distant, meaning that

analytical results often didn’t meet executives’

requirements, and decisions were made on

experience and intuition.

Analysts spent much of their time preparing

data for analysis, and relatively little time on

the quantitative analysis itself.

Analytics 1 0 Ethos

►Stay in the back room—as far away fromdecision-makers as possible—and don’tcause trouble

► Take your time—nobody’s that interestedin your results anyway

► Talk about “BI for the masses,” but

make it all too difficult for anyone butexperts to use

► Look backwards—that’s where thethreats to your business are

► If possible, spend much more timegetting data ready for analysis thanactually analyzing it

► Keep inside the sheltering confines ofthe IT organization



12/35

Analytics 2.0—Big Data

Starting in the mid-2000s, the world began to

take notice of big data (though the term only

came into vogue around 2010), and thisperiod marked the beginning of the Analytics

2.0 era.

The period began with the exploitation of

online data in Internet-based and social

network firms, both of which involved massiveamounts of fast-moving data. Big data and

analytics in those firms not only informed

internal decisions in those organizations, but

also formed the basis for customer-facing

products, services, and features.

Copyright© 2013 IIA All Rights Reserved iianalytics.com | 12

Big Data2.0

• Complex, large, unstructureddata sources

• New analytical andcomputational capabilities

• “Data Scientists” emerge

• Online firms create data-basedproducts and services


- Analytics 2.0 -



These pioneering Internet and social network

companies were built around big data from thebeginning. They didn’t have to reconcile or

integrate big data with more traditionalsources of data and the analytics performedupon them, because for the most part theydidn’t have those traditional forms.

They didn’t have to merge big datatechnologies with their traditional ITinfrastructures because those infrastructuresdidn’t exist.

Big data could stand alone, big data analytics

could be the only focus of analytics, and bigdata technology architectures could be theonly architecture.


Analytics 2.0 Data Environment

Copyright 2013, SAS Best Practices

- Analytics 2.0 -



Big data analytics as a standalone entity in

Analytics 2.0 were quite different from the 1.0

era in many ways.

As the big data term suggests, the data itself

was either very large, relatively unstructured,fast-moving —or possessing all of these

attributes.

Data was often externally-sourced, coming

from the Internet, the human genome, sensors

of various types, or voice and video.

A new set of technologies began to be

employed at this time.


Key Developments in 2.0

- Analytics 2.0 -

► Fast flow of data necessitated rapid

storage and processing► Parallel servers running Hadoop for fast

batch data processing

► Unstructured data required “NoSQL”databases

► Data stored and analyzed in public

or private cloud computing environments

► “In-memory” analytics and “in-database”analytics employed

► Machine learning methods meant theoverall speed of analysis was much faster(from days to minutes)

► Visual analytics often crowded outpredictive and prescriptive techniques


15/35


The ethos of Analytics 2.0 was quite different

from 1.0. The new generation of quantitativeanalysts was called “data scientists,” with both

computational and analytical skills.

Many data scientists were not content with

working in the back room; they wanted to work

on new product offerings and to help shape

the business.

There was a high degree of impatience; one

big data startup CEO said, “We tried agile

[development methods], but it was too slow.”

The big data industry was viewed as a “land

grab” and companies sought to acquirecustomers and capabilities very quickly.

Analytics 2 0 Ethos

► Be “on the bridge” if not in charge of it ► “Agile is too slow”

► “Being a consultant is the dead zone”

► Develop products, not PowerPoints orreports

► Information (and hardware andsoftware) wants to be free

► All problems can be solved in ahackathon

► Share your big data tools with thecommunity

► “Nobody’s ever done this before!”



16/35


Analytics 3.0—Fast Impact for

the Data Economy

Big data is still a popular concept, and one

might think that we’re still in the 2.0 period.

However, there is considerable evidence that

large organizations are entering the Analytics

3.0 era.

It’s an environment that combines the best of

1.0 and 2.0—a blend of big data andtraditional analytics that yields insights and

offerings with speed and impact.

Rapid Insights ProvidingBusiness Impact

3.0

• Analytics integral to running thebusiness; strategic asset

• Rapid and agile insight delivery

• Analytical tools available atpoint of decision

• Cultural evolution embeds

analytics into decision andoperational processes

• All businesses can create data-based products and services



- Analytics 3.0 -


17/35


ANALYTICS 3.0 │THE ERA OF IMPACT

1.0 TraditionalAnalytics

Rapid InsightsProviding BusinessImpact

Big Data2.0 3.0

• Primarily descriptiveanalytics and reporting

• Internally sourced,relatively small,

structured data

• “Back room” teamsof analysts

• Internal decisionsupport



• Analytical tools available at pointof decision

• Cultural evolution embedsanalytics into decision and

operational processes

• All businesses can create data-based products and services




• Online firms create data-based products and services



18/35

The most important trait of the

Analytics 3.0 era is

that not only online firms,

but virtually any type of firm

in any industry, can participate

in the data economy.


Although it’s early days for this new model, the

traits of Analytics 3.0 are already becoming

apparent.

Banks, industrial manufacturers, health care

providers, retailers—any company in anyindustry that is willing to exploit the

possibilities—can all develop data-based

offerings for customers, as well as support

internal decisions with big data.



19/35


There is considerable evidence that when big

data is employed by large organizations, it is

not viewed as a separate resource from

traditional data and analytics, but merged

together with them.

In addition to this integration of the 1.0 and

2.0 environments, other attributes of Analytics

3.0 organizations are described on the

following pages.

"From the beginning of our Science

function at AIG, our focus was on bothtraditional analytics and big data. We

make use of structured and unstructured

data, open source and traditional

analytics tools. We're working on

traditional insurance analytics issues like

pricing optimization, and some exotic big

data problems in collaboration with MIT. It

was and will continue to be an integrated

approach.”

—Murli Buluswar, Chief Science Officer

AIG



- Analytics 3.0 -


20/35


Multiple Data Types,

Often Combined

Organizations are combining large and small

volumes of data, internal and external sources,

and structured and unstructured formats to

yield new insights in predictive and

prescriptive models.

Often the increased number of data sources is

viewed as incremental, rather than arevolutionary advance in capability.

At Schneider National, a large

trucking firm, the company is

increasingly adding data from new

sensors—monitoring fuel levels,

container location and capacity,

driver behavior, and other key

indicators—to its logistical

optimization algorithms.

The goal is to improve—slowly and

steadily—the efficiency of the

company’s route network, to lower

the cost of fuel, and to decrease

the risk of accidents.



- Analytics 3.0 -


21/35


A New Set of DataManagement Options

In the 1.0 era, firms employed data

warehouses with copies of operational data as

the basis for analysis. In the 2.0 era, the focus

was on Hadoop clusters and NoSQL

databases.

Now, however, there are a variety of options

from which to choose in addition to these

earlier tools: Database and big data

appliances, SQL-to-Hadoop environments(sometimes called “Hadoop 2.0”), vertical and

graph databases, etc.


Enterprise data warehouses are stillvery much in evidence as well. Thecomplexity and number of choicesthat IT architects have to make aboutdata management have expandedconsiderably, and almost every

organization will end up with a hybriddata environment.

The old formats haven’t gone away,but new processes need to bedeveloped by which data and the

focal point for analysis will moveacross staging, evaluation,exploration, and productionapplications.

- Analytics 3.0 -


22/35

The challenge in the 3.0 era is to

adapt operational and decision

processes to take advantage of whatthe new technologies and methods

can bring forth.


Technologies and Methods areMuch Faster

Big data technologies from the Analytics 2.0period are considerably faster than previousgenerations of technology for datamanagement and analysis.

To complement the faster technologies, new“agile” analytical methods and machinelearning techniques are being employed thatproduce insights at a much faster rate.

Like agile system development, these methodsinvolve frequent delivery of partial outputs toproject stakeholders; as with the best datascientists’ work, there is an ongoing sense ofurgency.



23/35


Integrated and Embedded Analytics

Consistent with the increased speed ofanalytics and data processing, models inAnalytics 3.0 are often being embedded intooperational and decision processes,

dramatically increasing their speed andimpact.

Some firms are embedding analytics into fullyautomated systems based on scoringalgorithms or analytics-based rules. Others arebuilding analytics into consumer-orientedproducts and features.

In any case, embedding the analytics intosystems and processes not only means greaterspeed, but also makes it more difficult fordecision-makers to avoid using analytics—usually a good thing.

Procter & Gamble’s leadership is

passionate about analytics and has

moved business intelligence fromthe periphery of operations to the

center of how business gets done.

P&G embeds analytics in day-to-day

management decision-making,

with its “Business Sphere”management decision rooms and

over 50,000 desktops equipped with

“Decision Cockpits.”



- Analytics 3.0 -


24/35


Hybrid TechnologyEnvironments

It’s clear that the Analytics 3.0 environmentinvolves new technology architectures, butit’s a hybrid of well-understood andemerging tools.

The existing technology environment forlarge organizations is not being disbanded;some firms still make effective use ofrelational databases on IBM mainframes.

However, there is a greater use of big datatechnologies like Hadoop on commodityserver clusters; cloud technologies (privateand public), and open-source software.

The most notable changes in the

3.0 environment are new options

for data storage and analysis ,

and attempts to eliminate the ETL

(extract, transform, and load)step before data can be assessed

and analyzed.

This objective is being addressed

through real-time messaging and

computation tools such asApache Kafka and Storm.


Analytics 3.0 Data Environment

- Analytics 3.0 -


25/35


Data Science/Analytics/IT Teams

Data scientists often are able to run the whole show—or at least have a lot of

independence—in online firms and big data startups. In more conventional large firms,however, they have to collaborate with a variety of other players.

In many cases the “data scientists” in large firms may be conventional quantitative

analysts who are forced to spend a bit more time than they like on data management

activities (which is hardly a new phenomenon).



26/35


And the data hackers who excel at extracting

and structuring data are working with

conventional quantitative analysts who excel

at modeling it.

This collaboration is necessary to ensure that

big data is matched by big analytics in the 3.0

era.

Both groups have to work with IT, which

supplies the big data and analytical

infrastructure, provides the “sandboxes” in

which they can explore data, and who turnsexploratory analyses into production

capabilities.

Teams of data hackers and

quant analysts are doing

whatever is necessary to get

the analytical job done,and there is often a lot of

overlap across roles.



27/35


Chief Analytics Officers

When analytics and data become this

important, they need senior management

oversight.

And it wouldn’t make sense for companies tohave multiple leaders for different types of

data, so they are beginning to create “Chief

Analytics Officer” roles or equivalent titles to

oversee the building of analytical capabilities.

We will undoubtedly see more such roles in

the near future.


► AIG

► University of Pittsburgh MedicalCenter

►The 2012 Barack Obamareelection campaign

► Wells Fargo

► Bank of America

► USAA

► RedBox

► FICO

► Teradata

Organizations with C-level

analytics roles:

- Analytics 3.0 -


28/35


The Rise of Prescriptive

Analytics

There have always been three types ofanalytics:

1 descriptive, which report on the past;

2 predictive, which use models based on

past data to predict the future;3 prescriptive, which use models to specify

optimal behaviors and actions.

Analytics 3.0 includes all types, but there is anincreased emphasis on prescriptive analytics.

These models involve large-scale testing andoptimization. They are a means of embeddinganalytics into key processes and employeebehaviors. They provide a high level ofoperational benefits for organizations, butrequire high-quality planning and execution.

UPS is using data from digital

maps and telematics devices in

its trucks to change the way it

routes its deliveries.

The new system (called ORION,

for On-Road IntegratedOptimization and Navigation)

provides routing information to

UPS’s 55,000 drivers.



- Analytics 3.0 -


29/35


SummaryEven though it hasn’t been long since theadvent of big data, these attributes add up toa new era.

It is clear from our research that largeorganizations across industries are joining thedata economy. They are not keeping traditionalanalytics and big data separate, but arecombining them to form a new synthesis.

Some aspects of Analytics 3.0 will no doubtcontinue to emerge, but organizations need tobegin transitioning now to the new model.

It means changes in skills, leadership,organizational structures, technologies, andarchitectures. Together these new approachesconstitute perhaps the most sweeping changein what we do to get value from data since the1980s.

Analytics 3 0

Competing In The Data Economy

► Every company—not just online firms—can create data and analytics-basedproducts and services that change thegame

► Not just supplying data, but customerinsights and guides to decision-making

► Use “data exhaust” to help customersuse your products and services moreeffectively

► Start with data opportunities or startwith business problems? Answer is yes!

► Need “data products” team good at data

science, customer knowledge, newproduct/service development

► Opportunities and data come at highspeed, so quants must respond quickly

iianalytics.com | 29- Summary -


30/35


It’s important to remember that the primary

value from big data comes not from the data

in its raw form, but from the processing and

analysis of it and the insights, decisions,products, and services that emerge from

analysis.

The sweeping changes in big data

technologies and management approaches

need to be accompanied by similarly dramaticshifts in how data supports decisions and

product/service innovation processes.

These shifts have only begun to emerge, and

will be the most difficult work of the Analytics

3.0 era. However, there is little doubt thatanalytics can transform organizations, and the

firms that lead the 3.0 charge will seize the

most value.

The primary value from bigdata comes not from the data

in its raw form, but from the

processing and analysis of it

and the insights, decisions,

products, and services thatemerge from analysis.



31/35

SUMMARY OF THE IDEA

Era 1.0: Traditional Analytics 2.0: Big Data 3.0: Data Economy

Timeframe Mid-1950s to 2000

Early 2000s to Today

Today and in the Future

Culture, Ethos Very few firms “compete on

analytics”…”we know what we know.”

Agile, experimental, hacking…new

focus on data-based products and

services for customers

Agile methods that speed “time to

decision”…all decisions driven (or

influenced) by data…the data economy

Type of analytics • 5% predictive, prescriptive

• 95% reporting, descriptive

• 5% predictive, prescriptive• 95% reporting, descriptive (visual)

• 90%+ predictive, prescriptive• Reporting automated commodity

Cycle time Months (“batch” activity)

An insight a week

Millions of insights per second

Data

Internal, structured…very few externalsources available or perceived as

valuable

“data”

Very large, unstructured, multi-source…much of what’s interesting is

external…explosion of sensor data

“Big Data”

Seamless combination of internal andexternal…analytics embedded in

operational and decision processes…

tools available at the point of decision

“Data Economy”

Technology Rudimentary BI, reporting

tools…dashboards…data stored in

enterprise data warehouses or marts

New technologies: Hadoop, commodity

servers, in-memory, machine learning,

open source…”unlimited” compute

power

New data architectures…beyond the

warehouse

New application architectures…specific

apps, mobile

Organization &

Talent

Analytical people segregated from

business and IT…”Back Room”

statisticians, quants without

formal roles

Data Scientists are “on the

bridge”…talent shortage

noted…educational programs on

the rise

Centralized teams, specialized

functions among team members,

dedicated funding… Chief Analytics

Officers … recognized training,

education programs

Copyright© 2013 IIA All Rights Reserved iianalytics.com | 31- Summary -

│


32/35

ANALYTICS 3.0│FAST BUSINESS IMPACTFOR THE DATA ECONOMY

1.0Traditional

AnalyticsFast BusinessImpact for the DataEconomy

Big Data2.0

3.0

• Primarily descriptiveanalytics and reporting

• Internally sourced,relatively small,

structured data

• “Back room” teamsof analysts

• Internal decisionsupport

• Seamless blend of traditionalanalytics and big data



• Analytical tools available at pointof decision

• Cultural evolution embedsanalytics into decision and

operational processes




• Online firms create data-based products and services

Today

Copyright© 2013 IIA All Rights Reserved iianalytics.com | 32- Summary -


33/35


Recipe for a 3.0 World

Start with an existing capability for data management and analytics

Add some unstructured, large-volume data

Throw some product/service innovation into the mix

Add a dash of Hadoop

Cook up some data in a high-heat convection oven

Embed this dish into a well-balanced meal of processes and systems

Promote the chef to Chief Analytics Officer



34/35


Recommendations for Success

in the New Data Economy


► Use five factors (DELTA), five levels(1-5) to establish and measureanalytical capability

► Become a student of the analytics

environment

► Educate your leaders on thepotential of analytics based onwhat you’re seeing

► Use IIA as your barometer

- Recommendations -


35/35

Click: iianalytics.com

Call: 503-467-0210

Email: [email protected]

ARE YOU POISED TO COMPETE IN

THE DATA ECONOMY?

Let IIA be your guide.

Contact us to accelerate your progress.

the rise of analytics 3.0. thomas davenport

Documents