data stack considerations: build vs. buy at tout
TRANSCRIPT
Data Stack Considerations:Build vs. Buy at Tout
July 14, 2016
Housekeeping
• We will do Q&A at the end.
• You should see a box on the right
side of your screen.
• There is a button marked “Q&A” on
the bottom menu.
• We will be recording this
• We will send you the recording
tomorrow.
• We will also send you the slides
tomorrow.
RecordingQ&A
Jad DeFantiVP, Technical Operations
John HamminkDeveloper Evangelist
Ming LiuSr. Software Architect
Erin FranzAlliances Analyst
2
Meet Our Presenters
David BankerDirector, Product
Management
4
AGENDA
1.2.3.4.
Quick intro to Treasure Data
Quick intro to Looker
Build vs. Buy at Tout
Q & A
Treasure Data makes ….
WHO WE ARE
WHO WE ARE
BEFORE
• Data loss• Inflexible• Silos• Complex Integrations• High Costs• High Time-To-Market
ETL Team
EDW Team
BITeam
End UserSystem
AFTEROPTION
1
OPTION 2
AFTER
Make it easy for everyone to find, explore and
understandthe data that drives your
business.
2
A DATA PLATFORM THAT DOES BOTHFind, explore and understand all the data
Explore EverythingFind, explore and
understand all the data
Create StandardsDefine your data and
business metrics
Any SQL DatabaseAnalyze all of your data
where it is stored
Build a Data Culture
Anyone can ask and answer questions
How is pipeline for Q4?
Will we meet our revenue
targets?
Which campaigns
convert best?
Which rep is converting
best?
Which customer is at risk?
Can we speed up our
operations?
THE TECHNICAL PILLARS THAT MAKE IT POSSIBLE
100% In Database
Leverage all your dataAvoid summarizing or moving it
Modern Web Architecture
Access from anywhereShare and collaborate
Extend to anyone
LookML Intelligent Modeling Layer
Describe the dataCreate reusable and shareable
business logic
Leverage a Looker Block or App or quickly implement a custom deployment for a complete analytics solution
Looker makes TD data accessible and interactive for anyone from Finance to Marketing to Customer Service
Leverage the TD platform in real time with Looker to get actionable insights to anyone
Full flexibility over defining data at query time with LookML w/o modeling ahead of time.
Best of Breed
Fast Time to Value
Analytic Flexibility
Data for Everyone
Simplified Analytics, Powerful Data Discovery.
15
How Treasure Data & Looker saved us from our Analytics stack and vendor
15
20
Analytics & Tout Platform usage growth
• Tout utilized both a turnkey analytics solution and an internal home-grown service
• Analytics events and costs skyrocketed in Q4 2015
21
Legacy systems issues• Single source vendor
• Home grown solution not reliable and difficult to support
22
What problems were we trying to solve with analytics?
22
repetitive, long term
unpredictive, short term
customers' predefined
dashboards
customers' ad-hoc reports
requests
internal routine reports
internal ad-hoc reports
external, direct impact
internal, indirect impact
foundation
foundation
23
What were our demands and costs?
23
customer demand internal demand
direct & indirectEngineering / OPEX cost vendor cost
our options
24
What to build?
buy one-stop solution
(blackbox)
build custom solution
(whitebox)
rent and integrate specialized components (greybox)
less flexibleless time / effortmore expensive
more flexiblemore time / effort
less expensive
Blackbox, Whitebox or something in between?
25
What were the attributes of analytics reports required?
Charts&
Reports
Aggregated Data
Raw Data
smaller, faster, comprehensible
bigger, slower, incomprehensibl
e
flexible, detailed
rigid, brief
26
How we fixed the problem• Completely re-think data analytics
Best of breed over single vendor and home-grown solutions
• Outsource as much as possibleScale-Out over Scale-Up
27
What does our solution look like?Data Collection & Storage
Reporting Database Data Analytics/Visualization
Primary Owner Treasure Data MySQL / Redshift LookerInfrastructure Vendor & Customer Customer Vendor
28
How does it work? Amazon S3
backup data
aggregated dataAmazonRedshift
Looker
Treasure Data
coordinator
events
scaleable
receiver
SinatraPumaRack
TD logger
Fluentd
Tout’s logic
TD outputTout’s config
Tout’s logic
29
Keeping up with the businessCustomers will adopt our services if we provide better
• Daily Reports• Monthly Reports• Better insights into Tout platform usage data
30
Deliver Insight Quickly
31
Deliver Customized Insights Quickly
32
Room to EvolveWhere do we go from here?
• Customized and generic platform usage reports• Predictive revenue analytics• Analytics now open to all stakeholders• Upsell Additional Analytics Reporting
33
Summary• Tout now meets its customers’ and internal stakeholders’
reporting needs
• Tout analytics OPEX has been reduced by 50%
• Tout Engineering & Operations can now focus on applications & infrastructure most relevant to our value to customers
Q&A
12
THANK YOU FOR JOINING
Recording and slides will be posted.
We will email you the links tomorrow.
See you next time!
Next from Looker Webinars: Winning with Data on July 28
See how Treasure Data and Looker work on
your data.
Visit treasuredata.com and looker.com/free-trial or email
THANK YOU!