from zero to cnns to brains - cbmm...vision barbu,mayo,conwell (mit,harvard) 0 !cnns brains...

From Zero to CNNs to Brains

Andrei Barbu, David Mayo, Colin Conwell

objectnet.dev0xab.com/papers/conwell-brains-mouse-cnn-2020.pdf

bit.ly/31IjH5ubit.ly/3fSAhVh

Barbu, Mayo, Conwell (MIT, Harvard) 0→CNNs→Brains August 12, 2020

objectnet.dev0xab.com/papers/conwell-brains-mouse-cnn-2020.pdfbit.ly/31IjH5ubit.ly/3fSAhVh

Vision

Computer vision failures

NHTSA: Neither Autopilot nor the driver noticed the white side of thetractor-trailer against a brightly lit sky, so the brake was not applied.

Baby machine learning

Classifiers

Linear classifiers

Non-linearities: Sigmoid

−4 −2 2 4

−1

−0.5

0.5

11

1+e−x

Gradient descent

Linear classifiers and kernels

Intro to PyTorch

Convolution

Image convolution

Gaussian blur kernel

Gaussian blur

Early edge detection: Sobel

−1 0 +1−2 0 +2−1 0 +1

−1 −2 −10 0 0+1 +2 +1

Early edge detection: Sobel

Object detection: HoG

Object detection: DPM

Object detection: Deep learning

Object detection

image as inputpropose fixed-size regions that are likely to have objectsfeed each through a network with many layerslinear classifier at the top

Object detection

image as input

propose fixed-size regions that are likely to have objectsfeed each through a network with many layerslinear classifier at the top

Object detection

image as inputpropose fixed-size regions that are likely to have objects

feed each through a network with many layerslinear classifier at the top

Object detection

image as inputpropose fixed-size regions that are likely to have objectsfeed each through a network with many layers

linear classifier at the top

Object detection

image as inputpropose fixed-size regions that are likely to have objectsfeed each through a network with many layerslinear classifier at the top

Performance

Vision . . .

A man and a child are sitting on a plane.

Vision . . .

from zero to cnns to brains - cbmm...vision barbu,mayo,conwell (mit,harvard) 0 !cnns brains...

Documents