building a beer recommender with yhat (papis.io - november 2014)

107
Building a Beer Recommender with Yhat PAPIs.io November 2014

Upload: yhat

Post on 02-Jul-2015

3.542 views

Category:

Technology


0 download

DESCRIPTION

Building the predictive aspect of applications is the fun, sexy part. New tools like scikit-learn, pandas, and R have made building models less painful, but deploying/embedding models into production applications is challenging. We'll show how Yhat makes deploying predictive models written in Python or R fast and easy by building a beer recommendation system and an accompanying webapp.

TRANSCRIPT

Page 1: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Building a Beer Recommender with Yhat

PAPIs.ioNovember 2014

Page 2: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

1) Intro2) The Problem: Building predictive apps3) Solutions4) Case Study: Beer Recommender5) Demo6) Q/A

Page 3: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Here I am on the Internet.

Founder/CTO @ Yhat

Hi, I’m Greg!

Page 4: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 5: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Founders Company

InvestorsGreg Lamp, CTO

Austin Ogilvie, CEO ● Launched in 2013● HQ in New York

Page 6: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 7: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Why is Data Science so talked about?

regression

Page 8: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 9: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 10: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 11: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 12: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 13: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Get Raw Data

Strategic Insights

Real World Scoring

Data Driven ProductsBusiness Impact

Clean Data

Stages of the Analytics Project Life Cycle

Expert data teams

Management

Customers & Front Line Employees

Page 14: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

What makes building analytical apps hard?

Page 15: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Hi, I’m Trey.

Meet Trey, the Data Scientist

Page 16: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

We need to reduce churn. Okay. I'll look into it.

Page 17: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

I figured out that....some complex stuff about vector space that'll improve...

....and that's how we'll reduce churn.

Sounds good. Let's do that...

The "a ha" moment isn't the end.

Page 18: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Any of you know what Gradient Boosting is?

So when can we go live with the new model?

Page 19: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Now what?

Page 20: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Options

Page 21: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

1) Translate Code

Page 22: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 23: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

2 Rebel Policemen 2

Page 24: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

2) PMML

Page 25: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 26: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

?

Page 27: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

3) Batch Jobs

Page 28: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 29: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 30: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

use your tools

Page 31: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

use your tools move quickly

Page 32: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

use your tools move quickly

any workflow

Page 33: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

use your tools move quickly

any workflow no translating

Page 34: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Case Study

Page 35: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

+ = ?

Page 36: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

A Beer Recommender in Python

Page 37: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

http://beers.yhathq.com

Page 38: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

The Data

Page 39: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

http://snap.stanford.edu/data/web-BeerAdvocate.html

Page 40: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 41: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 42: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 43: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 44: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 45: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 46: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 47: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 48: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 49: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 50: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 51: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Beers

Page 52: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Users

Page 53: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Ratings

Page 54: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Distance

Page 55: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

vs

Page 56: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 57: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 58: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 59: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 60: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 61: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 62: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

vs

Page 63: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 64: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 65: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

measuring similarity

Page 66: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

eeny

? ?

Page 67: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

eeny meeny

?

Page 68: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

?Cosine

eeny meeny miny

Page 69: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

?Cosine

moe

Page 70: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

pick one.you can always

change

Page 71: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Thank you,

Page 72: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 73: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 74: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 75: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 76: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 77: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 78: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 79: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 80: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Scoring

Page 81: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 82: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Aggregate

Page 83: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Sort

Page 84: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Filter

Page 85: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Return

Page 86: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 87: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Deployment

Page 88: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

What does this mean?

Page 89: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 90: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Import Yhat

Page 91: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Create a YhatModel

Page 92: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Define execute

Page 93: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Grab incoming data

Page 94: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Call your function

Page 95: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Format and return results

Page 96: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 97: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 98: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Demohttps://beers.yhathq.com/

Page 99: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 101: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

We’re [email protected]

Page 102: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Thanks!@yhathq

[email protected]

Page 103: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Appendix

Page 104: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 105: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

アーノルド坊やは人気者Little Arnold Boy is Popular

Diff’rent Strokes

Page 106: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)
Page 107: Building a Beer Recommender with Yhat (PAPIs.io - November 2014)

Unitless y-axis

Time