of food and computers - clark science center...mith college c omputer science dominique thiébaut...
TRANSCRIPT
![Page 1: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/1.jpg)
mith College
Computer Science
Dominique Thiébaut [email protected]
Of Food and ComputersPresentation for
The Kahn InstituteNov 2, 2018
![Page 2: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/2.jpg)
D. Thiebaut, Computer Science, Smith College
A Two-PartDegustation
https://encrypted-tbn0.gstatic.com/shopping?q=tbn:ANd9GcQeDV-F2E-QDSY2IpPVFG0o0sFqxDz1FYh3fQsSwmucJGpb34AQG1hUHZeObj0o-u1zDBFYLIgZrL3bdamwisMHNMibJerEAQ&usqp=CAYhttp://lh6.ggpht.com/6f4-GGlXjSPVddlQvIqDQNflex3BmSPIxvz3nXF-rfBqlarz76nLPsJITZacrg3_fEww-drM867dQZb6=s480
![Page 3: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/3.jpg)
D. Thiebaut, Computer Science, Smith College
Examples of ML
https://www.youtube.com/watch?v=-RHG5DFAjp8
Google’s CEO, Sundar Pichai, demonstrated the capability on stage at the Shoreline Amphitheater during Google I/O
![Page 4: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/4.jpg)
D. Thiebaut, Computer Science, Smith College
Examples of ML
https://www.youtube.com/watch?v=-RHG5DFAjp8
Google’s CEO, Sundar Pichai, demonstrated the capability on stage at the Shoreline Amphitheater during Google I/O
![Page 5: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/5.jpg)
D. Thiebaut, Computer Science, Smith College
Examples of MLFully driverless cars are on public roads in Texas. Drive.ai is the second company to remove the safety driver from its autonomous vehicles
https://www.theverge.com/2018/5/17/17365188/drive-ai-driverless-self-driving-car-texas
![Page 6: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/6.jpg)
D. Thiebaut, Computer Science, Smith College
Examples of ML
https://www.youtube.com/watch?v=rVlhMGQgDkY
![Page 7: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/7.jpg)
D. Thiebaut, Computer Science, Smith College
Examples of ML
https://qz.com/877721/the-ai-master-bested-the-worlds-top-go-players-and-then-revealed-itself-as-googles-alphago-in-disguise/
In March 2016, DeepMind's AlphaGo beat Lee Sedol in a five-game match, the first time a computer Go program has beaten a 9-dan professional without handicaps.[5] Final score: 4 games to 1 in favor of AlphaGo.
![Page 8: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/8.jpg)
D. Thiebaut, Computer Science, Smith College
Examples of ML
![Page 9: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/9.jpg)
D. Thiebaut, Computer Science, Smith College
Examples of ML
https://www.youtube.com/watch?v=AmUC4m6w1wo
Researchers at the University of Washington have produced a photorealistic former US President Barack Obama. Artificial intelligence was used to precisely model how Mr Obama moves his mouth when he speaks. Their technique allows them to put any words into their synthetic Barack Obama’s mouth.
![Page 10: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/10.jpg)
D. Thiebaut, Computer Science, Smith College
Neural Networks
![Page 11: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/11.jpg)
D. Thiebaut, Computer Science, Smith College
Neural Nets
![Page 12: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/12.jpg)
D. Thiebaut, Computer Science, Smith College
From https://docs.google.com/viewer?url=http%3A%2F%2Ftimes.cs.uiuc.edu%2Fcourse%2F510f17%2Fppt%2Fdeep-learning.pptx
![Page 13: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/13.jpg)
D. Thiebaut, Computer Science, Smith College
From https://docs.google.com/viewer?url=http%3A%2F%2Ftimes.cs.uiuc.edu%2Fcourse%2F510f17%2Fppt%2Fdeep-learning.pptx
100
60
20
![Page 14: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/14.jpg)
D. Thiebaut, Computer Science, Smith College
From https://docs.google.com/viewer?url=http%3A%2F%2Ftimes.cs.uiuc.edu%2Fcourse%2F510f17%2Fppt%2Fdeep-learning.pptx
100
60
20
Go
Stop
0.6
0.3
r
y
g
![Page 15: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/15.jpg)
D. Thiebaut, Computer Science, Smith College
From https://docs.google.com/viewer?url=http%3A%2F%2Ftimes.cs.uiuc.edu%2Fcourse%2F510f17%2Fppt%2Fdeep-learning.pptx
Go
Stop
r
y
g
h1
h2
h3
h4
h1= r*w11 + y*w12 + g*w13
r
y
g
![Page 16: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/16.jpg)
D. Thiebaut, Computer Science, Smith College
From https://docs.google.com/viewer?url=http%3A%2F%2Ftimes.cs.uiuc.edu%2Fcourse%2F510f17%2Fppt%2Fdeep-learning.pptx
Go
Stop
r
y
g
h1
h2
h3
h4
h1= r*w11 + y*w12 + g*w13
r
y
g
y1 = h1*w21 + h2*w22 + h3*w23 + h4*w24
y1
y2
![Page 17: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/17.jpg)
D. Thiebaut, Computer Science, Smith College
From https://docs.google.com/viewer?url=http%3A%2F%2Ftimes.cs.uiuc.edu%2Fcourse%2F510f17%2Fppt%2Fdeep-learning.pptx
Go
Stop
r
y
g
h1
h2
h3
h4
h1= r*w11 + y*w12 + g*w13
r
y
g
y1 = h1*w21 + h2*w22 + h3*w23 + h4*w24
y1
y2
![Page 18: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/18.jpg)
D. Thiebaut, Computer Science, Smith College
From https://docs.google.com/viewer?url=http%3A%2F%2Ftimes.cs.uiuc.edu%2Fcourse%2F510f17%2Fppt%2Fdeep-learning.pptx
Go
Stop
h1
h2
h3
h4
h1= r*w11 + y*w12 + g*w13
r
y
g
y1 = h1*w21 + h2*w22 + h3*w23 + h4*w24
y1
y2
Train
![Page 19: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/19.jpg)
D. Thiebaut, Computer Science, Smith College
From https://docs.google.com/viewer?url=http%3A%2F%2Ftimes.cs.uiuc.edu%2Fcourse%2F510f17%2Fppt%2Fdeep-learning.pptx
Go
Stop
h1
h2
h3
h4
h1= r*w11 + y*w12 + g*w13
r
y
g
y1 = h1*w21 + h2*w22 + h3*w23 + h4*w24
y1
y2
Train
![Page 20: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/20.jpg)
D. Thiebaut, Computer Science, Smith College
From https://docs.google.com/viewer?url=http%3A%2F%2Ftimes.cs.uiuc.edu%2Fcourse%2F510f17%2Fppt%2Fdeep-learning.pptx
Go
Stop
h1
h2
h3
h4
h1= r*w11 + y*w12 + g*w13
r
y
g
y1 = h1*w21 + h2*w22 + h3*w23 + h4*w24
y1
y2
Train
![Page 21: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/21.jpg)
D. Thiebaut, Computer Science, Smith College
From https://docs.google.com/viewer?url=http%3A%2F%2Ftimes.cs.uiuc.edu%2Fcourse%2F510f17%2Fppt%2Fdeep-learning.pptx
Go
Stop
h1
h2
h3
h4
h1= r*w11 + y*w12 + g*w13
r
y
g
y1 = h1*w21 + h2*w22 + h3*w23 + h4*w24
y1
y2
Test
![Page 22: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/22.jpg)
D. Thiebaut, Computer Science, Smith College
Model Error
![Page 23: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/23.jpg)
D. Thiebaut, Computer Science, Smith College
Data VisualizationDaniel Smilkov and Shan Carter
Daniel Smilkov and Shan Carter (Google) Fernanda Viégas and Martin Wattenberg (IBM)
![Page 24: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/24.jpg)
D. Thiebaut, Computer Science, Smith College
What can be "Learned?"
https://ml4a.github.io/ml4a/looking_inside_neural_nets/
http://techundred.com/how-snapchat-filter-work/
28
28
![Page 25: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/25.jpg)
D. Thiebaut, Computer Science, Smith College
What can be "Learned?"
https://think-data.github.io/machine%20learning/python/2016/12/03/simple-neural-network-using-tensorflow.html
![Page 26: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/26.jpg)
D. Thiebaut, Computer Science, Smith College
/ …….Training = Testing
From https://docs.google.com/viewer?url=https%3A%2F%2Fcs.brown.edu%2Fcourses%2Fcs143%2Flectures%2F17.ppt
Training Images Testing Images
![Page 27: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/27.jpg)
D. Thiebaut, Computer Science, Smith College
What can be "Learned?"
Recognize bird songs Ask Alexa for the current weather Identify sounds in a video
![Page 28: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/28.jpg)
D. Thiebaut, Computer Science, Smith College
What can be "Learned?"
the quick red fox jumped over the lazy brown sleeping dog
1: brown 2: dog 3: fox 4: jumped 5: lazy 6: over 7: quick 8: red 9: sleeping 10: the
brown dog: 1 1 0 0 0 0 0 0 0 0 red lazy: 0 0 0 0 1 0 0 1 0 0
quick over: 0 0 0 0 0 1 1 0 0 0 the sleeping fox: 0 0 1 0 0 0 0 0 1 1
![Page 29: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/29.jpg)
D. Thiebaut, Computer Science, Smith College
What can be "Learned?"
1: eggs 2: flour 3: water 4: salt 5: parsley 6: cheese 7: milk 8: spinach 9: tomatoes 10: …
Recipe 1: 1 1 1 0 0 0 0 0 0 0… Recipe 2: 1 0 0 1 1 1 0 0 0 0… Recipe 3: 0 0 0 0 0 1 1 0 0 0… Recipe 4: 0 0 0 0 0 0 1 0 0 0…
![Page 30: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/30.jpg)
D. Thiebaut, Computer Science, Smith College
What can be "Learned?"
egg
s fl
our
wat
er
sal
t p
arsle
y c
hees
e m
ilk
spi
nach
t
omat
oes
…
Recipe 1: 1 1 1 0 0 0 0 0 0 0… Recipe 2: 1 0 0 1 1 1 0 0 0 0… Recipe 3: 0 0 0 0 0 1 1 0 0 0… Recipe 4: 0 0 0 0 0 0 1 0 0 0…
![Page 31: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/31.jpg)
D. Thiebaut, Computer Science, Smith College
#1
Dessert Time!
Photo credits: Zeng Mu
![Page 32: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/32.jpg)
D. Thiebaut, Computer Science, Smith College
ML and Food
![Page 33: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/33.jpg)
D. Thiebaut, Computer Science, Smith College
ML and Food
Computer VisionIEEEACM
![Page 34: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/34.jpg)
D. Thiebaut, Computer Science, Smith College
Watson
![Page 35: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/35.jpg)
D. Thiebaut, Computer Science, Smith College
Watson
• 2011, Jeopardy
• Ken Jennings & Brad Rutter
• About Watson: "It is no longer purely a question answering computing system designed from Q&A pairs but one that can now 'see', 'hear', 'read', 'talk', 'taste', 'interpret', 'learn' and 'recommend'."
![Page 36: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/36.jpg)
D. Thiebaut, Computer Science, Smith College
Watson
• Applied to healthcare, investment management, insurance, diamond purchasing, oncology, and
food! • $1M for hardware, $1M for algorithm
• Currently, size of 3 stacked pizza boxes
![Page 37: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/37.jpg)
D. Thiebaut, Computer Science, Smith College
![Page 38: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/38.jpg)
D. Thiebaut, Computer Science, Smith College
Chef Watson!
• Started 2015, released to public 2016, retired 2018
• Based on the recipe archive of Bon Appétit
• Implements hedonic psychophysics & food pairing
• Web-based app
• Cookbook!
![Page 39: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/39.jpg)
D. Thiebaut, Computer Science, Smith College
Cookbook
![Page 40: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/40.jpg)
D. Thiebaut, Computer Science, Smith College
Instituteof CulinaryEducation
![Page 41: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/41.jpg)
D. Thiebaut, Computer Science, Smith College
Roasted Tomato& Mozzarella Tart
![Page 42: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/42.jpg)
D. Thiebaut, Computer Science, Smith College
In-HouseHigh-Flying Cook
![Page 43: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/43.jpg)
D. Thiebaut, Computer Science, Smith College
https://www.slideshare.net/AndersQuitzauIbm/big-data-in-foods-chef-watson-agrofood-park
![Page 44: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/44.jpg)
D. Thiebaut, Computer Science, Smith College
Watson can invent several dozen recipes that prominently feature prunes; it can satisfy a request for banana biscotti in a Creole or a Basque style; and it makes suggestions that no human would ever make, like adding milk chocolate to a clam linguine or mayonnaise to a Bloody Mary.
Alexandra Kleeman Cooking with IBM The New Yorker, Nov. 2016
https://www.newyorker.com/magazine/2016/11/28/cooking-with-chef-watson-ibms-artificial-intelligence-app
![Page 45: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/45.jpg)
D. Thiebaut, Computer Science, Smith College
1 Million Recipes
#2Photo credits: Zeng Mu
![Page 46: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/46.jpg)
D. Thiebaut, Computer Science, Smith College
http://pic2recipe.csail.mit.edu/
![Page 47: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/47.jpg)
D. Thiebaut, Computer Science, Smith College
pairing of recipes
(instructions + ingredients) with
images
![Page 48: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/48.jpg)
D. Thiebaut, Computer Science, Smith College
DemoUpload image, get recipe
http://pic2recipe.csail.mit.edu/demo
![Page 49: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/49.jpg)
D. Thiebaut, Computer Science, Smith College
Stats
![Page 50: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/50.jpg)
D. Thiebaut, Computer Science, Smith College
Stats12 images/recipe
![Page 51: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/51.jpg)
D. Thiebaut, Computer Science, Smith College
Stats
9 ingredients/recipe
![Page 52: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/52.jpg)
D. Thiebaut, Computer Science, Smith College
Stats
9 ingredients/recipe
34 ingredients!
![Page 53: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/53.jpg)
D. Thiebaut, Computer Science, Smith College
Stats
9 instructions/recipe
![Page 54: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/54.jpg)
D. Thiebaut, Computer Science, Smith College
Stats
9 instructions/recipe
1 instruction!
![Page 55: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/55.jpg)
D. Thiebaut, Computer Science, Smith College
Food Arithmetic
-
-
-
+
+
+
=
=
=
![Page 56: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/56.jpg)
D. Thiebaut, Computer Science, Smith College
And now,for the
piece de resistance
…
#3Photo credits: Zeng Mu
![Page 57: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/57.jpg)
D. Thiebaut, Computer Science, Smith College
A Survey of Dish IdentifyiersComparison of Image Recognition APIs on food imagesRohan Kulkarnibytes.grubhub.com
https://bytes.grubhub.com/https-medium-com-rohan-kulkarni-comparison-of-image-recognition-apis-on-food-images-cddc9105fc33
![Page 58: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/58.jpg)
D. Thiebaut, Computer Science, Smith College
Nancy
![Page 59: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/59.jpg)
D. Thiebaut, Computer Science, Smith College
Nancy
dish, food, cuisine, seafood, asian food, european food, paella, spanish cuisine, thai food, portuguese food
![Page 60: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/60.jpg)
D. Thiebaut, Computer Science, Smith College
Noa
![Page 61: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/61.jpg)
D. Thiebaut, Computer Science, Smith College
Noa dish, cuisine, food, leaf vegetable, vegetarian food, italian food, cookware and bakeware, european food, frittata, meal,
![Page 62: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/62.jpg)
D. Thiebaut, Computer Science, Smith College
Tom
![Page 63: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/63.jpg)
D. Thiebaut, Computer Science, Smith College
Tom
dish, cuisine, food, asian food, recipe, monjayaki, Okonomiyaki Monjayaki Recipe
![Page 64: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/64.jpg)
D. Thiebaut, Computer Science, Smith College
Susie
![Page 65: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/65.jpg)
D. Thiebaut, Computer Science, Smith College
Susie dish, curry, cuisine, food, gravy, stew, vegetarian food, indian cuisine, recipe, soup, taco soup
![Page 66: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/66.jpg)
D. Thiebaut, Computer Science, Smith College
Dominique
![Page 67: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/67.jpg)
D. Thiebaut, Computer Science, Smith College
Dominique dish, escargot, food, vegetarian food, vegetable, finger food, recipe, cuisine, Escargot Vegetarian cuisine
![Page 68: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/68.jpg)
D. Thiebaut, Computer Science, Smith College
Amy
![Page 69: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/69.jpg)
D. Thiebaut, Computer Science, Smith College
Amy
plant, flora, leaf, branch, tree, fruit, cherry, Leaf
![Page 70: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/70.jpg)
D. Thiebaut, Computer Science, Smith College
Susan
![Page 71: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/71.jpg)
D. Thiebaut, Computer Science, Smith College
Susan
vegetable, potato and tomato genus, fruit, food, vegetarian food, tomato, natural foods, nightshade family, Tomato Vegetarian cuisine
La Quinta Inns & Suites
![Page 72: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/72.jpg)
D. Thiebaut, Computer Science, Smith College
Suleiman
![Page 73: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/73.jpg)
D. Thiebaut, Computer Science, Smith College
Suleiman
dish, food, cuisine, vegetarian food, fried food, baked goods, side dish, Vegetarian cuisine Food Side dish
![Page 74: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/74.jpg)
D. Thiebaut, Computer Science, Smith College
Pat
![Page 75: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/75.jpg)
D. Thiebaut, Computer Science, Smith College
Pat
vegetable, potato and tomato genus, tomato, fruit, food, nightshade family, Tomato
![Page 76: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/76.jpg)
D. Thiebaut, Computer Science, Smith College
Roberto
![Page 77: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/77.jpg)
D. Thiebaut, Computer Science, Smith College
Roberto
still life photography, still life, gourd, cucurbita, Still life photography Photography Still life Gourd
![Page 78: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/78.jpg)
D. Thiebaut, Computer Science, Smith College
Roberto(Second
Trial)
![Page 79: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/79.jpg)
D. Thiebaut, Computer Science, Smith College
dish, meat, food, venison, animal source foods, steak, lamb and mutton, cuisine, Lamb and mutton Venison
Roberto(Second
Trial)
![Page 80: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/80.jpg)
D. Thiebaut, Computer Science, Smith College
Lois
![Page 81: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/81.jpg)
D. Thiebaut, Computer Science, Smith College
Lois
"A baked goodie - a fruit crisp I made in the summer, I think blueberry and peach"
![Page 82: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/82.jpg)
D. Thiebaut, Computer Science, Smith College
Lois
chocolate brownie, baking, parkin, recipe, capirotada, stuffing, streusel, american food, bread pudding, chocolate brownie
![Page 83: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/83.jpg)
D. Thiebaut, Computer Science, Smith College
Mona
![Page 84: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/84.jpg)
D. Thiebaut, Computer Science, Smith College
Mona dish, food, meal, cuisine, salad, asian food, breakfast, leaf vegetable, southeast asian food, lunch,
![Page 85: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/85.jpg)
D. Thiebaut, Computer Science, Smith College
Sara
![Page 86: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/86.jpg)
D. Thiebaut, Computer Science, Smith College
Sara
dish, food, cuisine, meal, tableware, breakfast, recipe, vegetarian food, Vegetarian cuisine Breakfast
![Page 87: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/87.jpg)
D. Thiebaut, Computer Science, Smith College
Kris
![Page 88: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/88.jpg)
D. Thiebaut, Computer Science, Smith College
Kris
dish, cuisine, food, vegetarian food, rice, arroz con pollo, recipe, asian food, middle eastern food, breakfast, indian cuisine, full breakfast, american food, Ackee and saltfish
![Page 89: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/89.jpg)
D. Thiebaut, Computer Science, Smith College
To Be
Continued…
![Page 90: Of Food and Computers - Clark Science Center...mith College C omputer Science Dominique Thiébaut dthiebaut@smith.edu Of Food and Computers Presentation for The Kahn Institute Nov](https://reader036.vdocuments.us/reader036/viewer/2022070717/5edd7137ad6a402d666889c0/html5/thumbnails/90.jpg)
D. Thiebaut, Computer Science, Smith College
FIN