visual recognition with anki cozmo and tensorflow

10
Visual Recognition with Anki Cozmo and TensorFlow Deployed on IBM Cloud via Kubernetes and Apache OpenWhisk December 2017 Niklas Heidloff Developer Advocate, IBM @nheidloff Ansgar Schmidt Developer Advocate, IBM @ansi

Upload: niklas-heidloff

Post on 22-Jan-2018

201 views

Category:

Software


5 download

TRANSCRIPT

Page 1: Visual Recognition with Anki Cozmo and TensorFlow

Visual Recognition with Anki Cozmo and TensorFlow

Deployed on IBM Cloud via

Kubernetes and Apache OpenWhisk

December 2017

Niklas Heidloff Developer Advocate, IBM

@nheidloff

Ansgar Schmidt Developer Advocate, IBM

@ansi

Page 2: Visual Recognition with Anki Cozmo and TensorFlow

Setup

Cozmo recognizes different Toys

Cozmo’s View:

@nheidloff @ansi

Page 3: Visual Recognition with Anki Cozmo and TensorFlow

Dem

o

Demo

@nheidloff @ansi

Video

Page 4: Visual Recognition with Anki Cozmo and TensorFlow

Dem

o

Demo

@nheidloff @ansi

Cozmo’s View

Page 5: Visual Recognition with Anki Cozmo and TensorFlow

Dem

o

Demo

@nheidloff @ansi

Cozmo’s Brain

Page 6: Visual Recognition with Anki Cozmo and TensorFlow

Training

Training – Circle around Toys and take Pictures

@nheidloff @ansi

Page 7: Visual Recognition with Anki Cozmo and TensorFlow

Training

Training – Architecture

MobileNet

@nheidloff @ansi

Page 8: Visual Recognition with Anki Cozmo and TensorFlow

Classification

Classification – Architecture

@nheidloff @ansi

Page 9: Visual Recognition with Anki Cozmo and TensorFlow

Classification

Web App to test the extended MobileNet Model

@nheidloff @ansi

Page 10: Visual Recognition with Anki Cozmo and TensorFlow

Resources

Resources

•  https://github.com/nheidloff/visual-recognition-for-cozmo-with-tensorflow

•  https://github.com/anki/cozmo-python-sdk •  https://codelabs.developers.google.com/codelabs/

tensorflow-for-poets

•  https://www.ibm.com/cloud •  https://openwhisk.apache.org