wise.io: a machine-learning platform (pydata sv 2013)

37
Henrik Brink, CTO PyData SV 2013, March 19 Machine Learning, Python and Raspberry Pi’s @brinkar @wiseio

Upload: pydata

Post on 01-Jul-2015

795 views

Category:

Technology


0 download

DESCRIPTION

Video can be found here: https://vimeo.com/63271828

TRANSCRIPT

Page 1: Wise.io: A Machine-Learning Platform (PyData SV 2013)

Henrik Brink, CTO

PyData SV 2013, March 19

Machine Learning, Python and Raspberry Pi’s

@brinkar @wiseio

Page 2: Wise.io: A Machine-Learning Platform (PyData SV 2013)
Page 3: Wise.io: A Machine-Learning Platform (PyData SV 2013)
Page 4: Wise.io: A Machine-Learning Platform (PyData SV 2013)

11kly

11kx

Reference New Difference

Palomar Transient Factory (PTF) ~1.5 million candidates per night

~10 new transients

http://www.astro.caltech.edu/ptf/

Page 5: Wise.io: A Machine-Learning Platform (PyData SV 2013)

PTF11kly (SN 2011fe)

©Peter Nugent

Supernova Discovery in the Pinwheel Galaxy

11 hr after explosion

Nearest SN Ia in >3 decades

Page 6: Wise.io: A Machine-Learning Platform (PyData SV 2013)

http://bigmacc.info

Page 7: Wise.io: A Machine-Learning Platform (PyData SV 2013)
Page 8: Wise.io: A Machine-Learning Platform (PyData SV 2013)

Python Bootcamps at Berkeley

Page 9: Wise.io: A Machine-Learning Platform (PyData SV 2013)

Machine Learning in

Page 10: Wise.io: A Machine-Learning Platform (PyData SV 2013)

ML pain points I

• Data is messy!

• Hard to scale non-linear algorithms to large datasets

• Ad-hoc feature engineering

• Collaboration on data, features and models is difficult

data scientists

Page 11: Wise.io: A Machine-Learning Platform (PyData SV 2013)
Page 12: Wise.io: A Machine-Learning Platform (PyData SV 2013)

Random Forest®Random Forest® is a registered trademark of Salford Systems

Page 13: Wise.io: A Machine-Learning Platform (PyData SV 2013)

Brink+2012

Page 14: Wise.io: A Machine-Learning Platform (PyData SV 2013)

Brink+2012

10% label noise

Page 15: Wise.io: A Machine-Learning Platform (PyData SV 2013)

http://wise.io

Page 16: Wise.io: A Machine-Learning Platform (PyData SV 2013)
Page 18: Wise.io: A Machine-Learning Platform (PyData SV 2013)

WiseRF™

12 GB MNIST in 90 seconds

8 core EC2 instance

Page 19: Wise.io: A Machine-Learning Platform (PyData SV 2013)

WiseRF™

A brain for the Internet of Things!

Page 21: Wise.io: A Machine-Learning Platform (PyData SV 2013)

Higher speeds

Larger datasets

Hadoop / Mahout

Energy sensorsAd bidding

Credit card fraud detection

Video tracking

Financial predictions

Batch product recommendations Real-time

recommendations

Internet of ThingsHealthcaresensors

Fast vs Scalable

Page 22: Wise.io: A Machine-Learning Platform (PyData SV 2013)

High-frequency data science

High-frequency prediction

Feature engineering

Data ingestion

Raw data

Model deployment

Model validation

High-frequency Machine Learning

Page 23: Wise.io: A Machine-Learning Platform (PyData SV 2013)

• Statistical validation of models

• Lack of feature engineering expertise

• Dealing with data and computing infrastructure

ML pain points IIapplication developers

Page 26: Wise.io: A Machine-Learning Platform (PyData SV 2013)

Reusable features

Page 27: Wise.io: A Machine-Learning Platform (PyData SV 2013)

Collaboration

Page 28: Wise.io: A Machine-Learning Platform (PyData SV 2013)

Integration

Page 29: Wise.io: A Machine-Learning Platform (PyData SV 2013)
Page 30: Wise.io: A Machine-Learning Platform (PyData SV 2013)

docs.wise.io

Page 31: Wise.io: A Machine-Learning Platform (PyData SV 2013)
Page 32: Wise.io: A Machine-Learning Platform (PyData SV 2013)
Page 33: Wise.io: A Machine-Learning Platform (PyData SV 2013)
Page 34: Wise.io: A Machine-Learning Platform (PyData SV 2013)

• Scalable infrastructure required

• Hard to go from data science experiments to production.

• Complete privacy / security.

ML pain points IIIbusiness and enterprise

Page 35: Wise.io: A Machine-Learning Platform (PyData SV 2013)
Page 36: Wise.io: A Machine-Learning Platform (PyData SV 2013)