hortonworks - how hadoop makes the successful retailer

43
How Hadoop makes The Successful Retailer Mats Johansson Solutions Engineer EMEA © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Upload: mats-johansson

Post on 15-Apr-2017

505 views

Category:

Data & Analytics


3 download

TRANSCRIPT

Page 1: Hortonworks - How Hadoop makes the successful Retailer

How Hadoop makesThe Successful Retailer

Mats JohanssonSolutions Engineer -­ EMEA

© Hortonworks Inc. 2011 – 2015. All Rights Reserved

Page 2: Hortonworks - How Hadoop makes the successful Retailer

About HortonworksONLY100

open sourceApache Hadoop data platform

% Founded in 2011

HADOOP1ST distribution to go public

IPO Fall 2014 (NASDAQ: HDP)

subscriptioncustomers+700

employees across800+

countries

technology partners1500+

17

TM

Hortonworks is the fastest ever public company to reach $100M in revenue.

Barclays, July 2015

Page 3: Hortonworks - How Hadoop makes the successful Retailer

Page 3 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Hortonworks Leads the Market

Hortonworks Is a Leader

• 75% of F100 Telcos• 65% of F100 P&C Insurers• 55% of F100 Manufacturers

• 46% of F100 Retailers• 40% of F100 Health Insurers

“The Forrester Wave™: Big Data Hadoop Solutions”

Hortonworks: Leads the market

Page 4: Hortonworks - How Hadoop makes the successful Retailer

Page 4 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Agenda

What is really going on in Retail

Data Explosion

Challenges

Retail Use Case

Page 5: Hortonworks - How Hadoop makes the successful Retailer

Page 5 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Challenges in Retail

Consumer Demand

Demand Signal

Management

Basket Analysis

Assortment Optimization

Path to Purchase

E-­Commerce activity

Transferred to Physical Locations

Engaging Millennials

Sentiment Data

Social Listening

Targeted Promotions

“Market of one”

Cross Sell

Upsell

Consumer Loyalty

Spend History

Shared Sentiment

Trending styles

Supply Chain

Optimization

Quality Assurance

Sustainability

Back-­office efficiency

ETL Offload

Market speedvs

ITs speed

Traditional Challenges

Page 6: Hortonworks - How Hadoop makes the successful Retailer

Page 6 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

What is really going on in Retail?

Page 7: Hortonworks - How Hadoop makes the successful Retailer

Page 7 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

They require answers, convenience and immediacy!

What is really going in Retail

Consumers are in control!

On Assortment, Product details, Price, Inventory, Availability and Reputation!

Page 8: Hortonworks - How Hadoop makes the successful Retailer

Page 8 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

What do the Retailer get back?

What is really going in Retail

Demographics

and sometimes

Psychographics

Page 9: Hortonworks - How Hadoop makes the successful Retailer

Page 9 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

?

Page 10: Hortonworks - How Hadoop makes the successful Retailer

Page 10 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

#relationship

Page 11: Hortonworks - How Hadoop makes the successful Retailer

Page 11 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Customer 360

Single View of Customer

Page 12: Hortonworks - How Hadoop makes the successful Retailer

Page 12 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

came

The search engine is the advisor

#interact

55% -­ of people 15-­35 yearsuse search engines to learn aboutproducts.

Page 13: Hortonworks - How Hadoop makes the successful Retailer

Page 13 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

#interact

Page 14: Hortonworks - How Hadoop makes the successful Retailer

Page 14 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

#interact

Page 15: Hortonworks - How Hadoop makes the successful Retailer

Page 15 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

came

Shopping behavior is changing beyond search

#interact

75% -­ The YoY growth in subscription of Youtube foodchannels from mobile devices.

Page 16: Hortonworks - How Hadoop makes the successful Retailer

Page 16 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Data Enrichment

Page 17: Hortonworks - How Hadoop makes the successful Retailer

Page 17 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

came

Mobile is the go-­to device

#mobile

75% -­ of people 15-­35 yearsgo online via smartphone moreoften than computer.

Page 18: Hortonworks - How Hadoop makes the successful Retailer

Page 18 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

came

The smartphone is the in-­store assistant

#mobile

71% of in-­store shoppers saytheir device has become moreimportant to their in-­store experience.

Page 19: Hortonworks - How Hadoop makes the successful Retailer

Page 19 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Mobile

Page 20: Hortonworks - How Hadoop makes the successful Retailer

Page 20 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Agenda

What is really going on in Retail

Data Explosion

Challenges

Retail Use Case

Page 21: Hortonworks - How Hadoop makes the successful Retailer

Page 21 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

#dataexplosion

Consumer Behavior• 2.5 Billion Connected People on Social networks by 2020• $65 Trillion (USD) Global Trade by 2020• 75 Billion Connected Devices by 2020• 2014 -­ 1 % of grocery retail revenue in Sweden were from online stores

Data Explosion• POS detail level and history

• Beacons, Smart Shelves, Smart Hangers, Smart Bins, Smart Racks, Smart…• Social Media, Tweets, Likes, Mentions, News• Clickstream, Web logs

Page 22: Hortonworks - How Hadoop makes the successful Retailer

Page 22 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Traditional systems under pressure

Clickstream

ERP, CRM, SCM

Web & Social

Geolocation

Internet of Things, Media

Server Logs

Files, Emails

New DataChallenges• Constrains data to app• Can’t manage new data• Costly to Scale

1

2.8 Zettabytesin 2012

44 Zettabytesin 2020

N E W

1 Zettabyte (ZB) = 1 million Petabytes (PB); Sources: IDC, IDG Enterprise, and AMR Research

Transform your industry via full fidelity of data in-­flight, at rest and advanced analytics

Opportunity

T R A D I T I O N A L

LAGGARDS

LEADERS2

Business Value

ERP CRM SCM

Page 23: Hortonworks - How Hadoop makes the successful Retailer

Page 23 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Agenda

What is really going on in Retail

Data Explosion

Challenges

Retail Use Case

Page 24: Hortonworks - How Hadoop makes the successful Retailer

Page 24 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

• Collect

• Store

• Protect

• Understand

• Analyze, compare and decide

• All in near real-­time

Challenges

Page 25: Hortonworks - How Hadoop makes the successful Retailer

Page 25 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Hortonworks Data Platformpowered by Apache Hadoop

Hortonworks Data Platformpowered by Apache Hadoop

EnrichContext

Store Data and Metadata

Internetof Anything

Hortonworks DataFlow powered by Apache NiFi

Perishable Insights

HistoricalInsights

Hortonworks DataFlow Adds to Hadoop Capabilities

Page 26: Hortonworks - How Hadoop makes the successful Retailer

Page 26 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Only Hortonworks Delivers Open Enterprise Hadoop

HOR TONWOR K S D ATA P L AT FORM

YARN: Data Operating System

CLICKSTREAM SENSOR SOCIAL MOBILE GEOLOCATION SERVERLOG

Batch Interactive Search Streaming Machine Learning

EXISTING

Page 27: Hortonworks - How Hadoop makes the successful Retailer

Page 27 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Offering You the Most Flexibility

AN Y D ATAExisting and new datasets

A N Y A P P L IC AT IONMultiple engines for data analysis

A N YWH ER EComplete range of deployment options

Batch

Interactive

Search

Streaming

Machine Learning

Click-­stream Sensor

Social Mobile

Geo-­Location

ServerLog Linux Windows

CloudOn-­Premise

Page 28: Hortonworks - How Hadoop makes the successful Retailer

Page 28 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Hortonworks Capabilities

The Data Flow Thing

Processand

AnalyzeCollect

Store & Integrate

Page 29: Hortonworks - How Hadoop makes the successful Retailer

Page 29 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

New requirements

…to Activity InsightFrom reaction

…to OptimizationFrom planning

From break then fix

A shift from Reactive… …to Proactive

…to Preventive

Page 30: Hortonworks - How Hadoop makes the successful Retailer

Page 30 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Data Science

Page 31: Hortonworks - How Hadoop makes the successful Retailer

Page 31 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Iterative learning process

Visualize, Explore

Hypothesize;;Model

Measure/EvaluateAcquire Data

Clean Data

Question Answer

Page 32: Hortonworks - How Hadoop makes the successful Retailer

Page 32 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Tools

Page 33: Hortonworks - How Hadoop makes the successful Retailer

Page 33 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Agenda

What is really going on in Retail

Data Explosion

Challenges

Retail Use Case

Page 34: Hortonworks - How Hadoop makes the successful Retailer

Page 34 © Hortonworks Inc. 2011 – 2014. All Rights ReservedPage 34 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Historical Records

OPEXReduction

Mainframe Offloads

Fraud Prevention

Dataas a

Service

Public Data Capture

IT executives are delivering substantial reductions in operating costs by modernizing their data architectures with Open Enterprise Hadoop. These cost saving innovations include active archive of cold data, offloading ETL processes and enriching existing data.

Digital Protection

Device DataIngest

Rapid Reporting

Page 35: Hortonworks - How Hadoop makes the successful Retailer

Page 35 © Hortonworks Inc. 2011 – 2014. All Rights ReservedPage 35 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Payment Tracking

Call Analysis

Machine Data

Product Design

Social Mapping

Factory Yields

Defect Detection

Due Diligence

M & A Proactive Repair

Disaster Mitigation

Investment Planning

Next Product Recs

Store Design

Risk Modeling

Ad Placement

Inventory Predictions

Sentiment Analysis

Ad Placement

Basket Analysis Segments

Customer Support

Supply Chain

Cross-­Sell

Customer Retention

Vendor Scorecards

Optimize Inventories

Business executives are driving transformational outcomes with next-­generation applications that empower new uses of Big Data including: data discovery, a single view of the customer and predictive analytics.

Page 36: Hortonworks - How Hadoop makes the successful Retailer

Page 36 © Hortonworks Inc. 2011 – 2014. All Rights ReservedPage 36 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Hortonworks® customers leverage our technology to transform their businesses, either by achieving new business objectives or by reducing costs. The journey typically involves both of those goals in combination, across many use cases.

Social Mapping

Payment Tracking

FactoryYields

Defect Detection

Call Analysis

Machine Data

Product Design M & A

Due Diligence

Next Product Recs

Store Design

Risk Modeling

Ad Placement

Proactive Repair

Disaster Mitigation

Investment Planning

Inventory Predictions

Customer Support

Sentiment Analysis

Supply Chain

Ad Placement

Basket Analysis Segments

Cross-­Sell

Customer Retention

Vendor Scorecards

Optimize Inventories

OPEX Reduction

Mainframe Offloads

Historical Records

Dataas a Service

PublicData Capture

Fraud Prevention

Device DataIngest

Rapid Reporting

Digital Protection

Page 37: Hortonworks - How Hadoop makes the successful Retailer

Page 37 © Hortonworks Inc. 2011 – 2014. All Rights ReservedPage 37 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Page 38: Hortonworks - How Hadoop makes the successful Retailer

Page 38 © Hortonworks Inc. 2011 – 2014. All Rights ReservedPage 38 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Zulily

• Zulily

– US online fashion, apparel and toys retailer– target audience are mothers and their children– daily-­deals retailer – bringing active customers fresh products every day.

– 4.5 million customers– US$ 1B in revenue 2014

Page 39: Hortonworks - How Hadoop makes the successful Retailer

Page 39 © Hortonworks Inc. 2011 – 2014. All Rights ReservedPage 39 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Challenges

• Zulily

– Zulily creates over 100 daily online events that launch more than 9000 unique products each day.

– more than 50% of Zulily’s orders come from mobile devices.

– data fragmented across multiple systems– impressions tells more than clicks

Page 40: Hortonworks - How Hadoop makes the successful Retailer

Page 40 © Hortonworks Inc. 2011 – 2014. All Rights ReservedPage 40 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Solution

• Zulily

– All data managed in Hortonworks Open Enterprise Hadoop.– Creation of Millions individual stores – from cluster based to 1to1 personalization

– Relevancy seamless across all platforms and channels –from store to e-­mail.

– 86 % increase YoY

Page 41: Hortonworks - How Hadoop makes the successful Retailer

Page 41 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Architecture

HDFS/HBase

Feeds

SQLStreaming

Search UISearch Index

Retail: Real Time Offer ManagementReal Time Inventory ManagementReal Time PersonalizationReal Time Stream Analytics

Page 42: Hortonworks - How Hadoop makes the successful Retailer

Page 42 © Hortonworks Inc. 2011 – 2014. All Rights ReservedPage 42 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Customer Journey with Open Enterprise Hadoop

• Zulily

Store DesignIndividualization

Sentiment Analysis

BasketAnalysis

Optimize Inventories

Next Product to BuyRecommendation

Historical Records

PublicData Capture

DeviceData Ingest

Customer Retention

Page 43: Hortonworks - How Hadoop makes the successful Retailer

Page 43 © Hortonworks Inc. 2011 – 2014. All Rights Reserved

Thank You!

Mats Johansson

[email protected]

@matsjo66

https://se.linkedin.com/in/matsjo66