neuroscience and machine learning

38
Neuroscience <==> Machine Learning

Upload: chris-hausler

Post on 12-Apr-2017

588 views

Category:

Technology


1 download

TRANSCRIPT

Page 1: Neuroscience and  machine learning

Neuroscience<==>

Machine Learning

Page 2: Neuroscience and  machine learning

Me

Page 3: Neuroscience and  machine learning

Neurons

Page 4: Neuroscience and  machine learning

Artificial Neuronsare simple...

Page 5: Neuroscience and  machine learning

https://blog.dbrgn.ch/2013/3/26/perceptrons-in-python/

Artificial Neuron

Page 6: Neuroscience and  machine learning

Real Neuronsare complex...

Page 7: Neuroscience and  machine learning

Real Neuron

Page 8: Neuroscience and  machine learning

Santiago Ramón y Cajal,

Dendrites

Page 9: Neuroscience and  machine learning

Cell Body

Refractory Period

Page 10: Neuroscience and  machine learning

channels

Figure 21-8, Lodish 4th Edition.

Ion Channels

Page 11: Neuroscience and  machine learning

Different Neuron Types

Page 12: Neuroscience and  machine learning

Gerstner et al. 2014

Spike Patterns

Page 13: Neuroscience and  machine learning

Artificial Neuron Real Neuron

Simple Complex

Deterministic Stochastic

Stateless Stateful

Time Invariant Time Sensitive

Artificial vs Real Neurons

Page 14: Neuroscience and  machine learning

?

Page 15: Neuroscience and  machine learning

Huebel & Wiesel

Page 16: Neuroscience and  machine learning
Page 17: Neuroscience and  machine learning

Dr. V. Aggarwal

Page 18: Neuroscience and  machine learning

Neural Networksbrain vs machine (learning)

Page 19: Neuroscience and  machine learning

Neural Network

Page 20: Neuroscience and  machine learning

Artificial Neural Network

Page 21: Neuroscience and  machine learning
Page 22: Neuroscience and  machine learning

Biological Problemsforward pass

Page 23: Neuroscience and  machine learning

Busbice et al. 2012

Connectome: C. elegans

Page 24: Neuroscience and  machine learning

Biological Problemsbackward pass

Page 25: Neuroscience and  machine learning

Lowery et al 2009

Back Propagation

Page 26: Neuroscience and  machine learning

Biological Problemslearnings

Page 27: Neuroscience and  machine learning
Page 28: Neuroscience and  machine learning

Butthere are similarities

Page 29: Neuroscience and  machine learning

Convolutional nets & Visual cortex

Page 30: Neuroscience and  machine learning

Le et al. 2012

High Level Concepts

Page 31: Neuroscience and  machine learning

Multimodal Embeddings

Weston et al.

Page 32: Neuroscience and  machine learning

Sharing is Caringneuroscience <==> ml

Page 33: Neuroscience and  machine learning
Page 34: Neuroscience and  machine learning

Hopfield Network

Page 35: Neuroscience and  machine learning

Ng et al. 07

Visual Receptive Fields

Page 36: Neuroscience and  machine learning

Neuromorphic Computing

Page 37: Neuroscience and  machine learning

The Brain vs Deep Learning Part I timdettmers.com

Readings

Page 38: Neuroscience and  machine learning

[email protected]

zendesk.com/jobs