pepper workshop humix

21
Pepper Innovation & Humix Jeffrey [email protected]

Upload: jeffrey-liu

Post on 16-Apr-2017

270 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Pepper workshop   humix

Pepper Innovation & Humix

Jeffrey [email protected]

Page 2: Pepper workshop   humix
Page 3: Pepper workshop   humix
Page 5: Pepper workshop   humix

This expertise will combine with Watson's natural language processing, pattern recognition, and other cognitive computing technologies to create highly personalized learning

experiences intended to complement the roles that parents and teachers play in early development

Page 6: Pepper workshop   humix

http://www.slideshare.net/IBMWatson/innovation-and-inspiration-through-cognitive-computing-ibm-watson

Page 7: Pepper workshop   humix

http://www.smh.com.au/technology/innovation/professor-reveals-to-students-that-his-assistant-was-an-ai-all-along-20160513-gou6us.html

Professor reveals to students that his assistant was an AI all along

Page 8: Pepper workshop   humix

http://www.dailymail.co.uk/sciencetech/article-2229967/Could-Miss-replaced-robot-Autistic-pupils-learn-better-android-buddies-human-teachers.html

Autistic children could be further helped to learn by robot in the classroom

Page 9: Pepper workshop   humix

http://www.telegraph.co.uk/technology/2016/03/24/microsofts-teen-girl-ai-turns-into-a-hitler-loving-sex-robot-wit/

Page 10: Pepper workshop   humix

https://www.youtube.com/watch?v=wB7imgUQ26Y

Page 11: Pepper workshop   humix

http://ai.xprize.org

Page 12: Pepper workshop   humix

Part II

Page 13: Pepper workshop   humix

HUMIX SENSE

HUMIX THINK

Support Multiple Interaction Channels

Facebook Messages / Other Messengers

RESTFul API

IoT Foundation (MQTT) WebSocketsensor event / command image / audio

IFTTT

There are many ways for the robot to sense the world

Page 14: Pepper workshop   humix

Humix Architecture

Sensor Module (Temperature/Humid/Light)

Dialog ModuleNAO Proxy

Humix Sense Messaging Bus

Dashboard

HUMIX THINK

Flow Engine

KnowledgeSet

Physical Robot

Cloud Brain

Dialog Design

HUMIX Sense

Kiosk ModuleCamera Module

KnowledgePersistent Module

Cloudant

NodeRed

core

WebSocket or MQTT

KnowledgeSet KnowledgeSet KnowledgeSet

Page 15: Pepper workshop   humix
Page 16: Pepper workshop   humix

Programming Model

1. Require Humix-Sense and provide module config

Page 17: Pepper workshop   humix

Programming Model

2. Connect to “Think”

Page 18: Pepper workshop   humix

Programming Model

3. Process “commands”, send “events” on device

Page 19: Pepper workshop   humix

Programming Model

4. Support Synchronous “commands”

Sync Command

HUMIX SENSE

HUMIX THINK

Programming in Synchronous manner

ModuleA

handle request in asynchronous manner

Page 20: Pepper workshop   humix

Dynamic Module Registration

HUMIX SENSE

ModuleA ModuleB ModuleC

NATS

WebSocket

Dashboard

HUMIX THINK

Flow Engine

{ moduleName: ‘Temperature’ commands: [‘cmd1’,’cmd2’], events: [‘event1’,’event2’] }

humix.sense.mgmt.cmd.register

Page 21: Pepper workshop   humix

Module Status Monitoring & Management

HUMIX SENSE

ModuleA ModuleB ModuleC

Dashboard

HUMIX THINK

Flow Engine

PING

PONG

DeviceModule Status

APIstatus

mgmt