a fast learning algorithm for deep belief nets
DESCRIPTION
A Fast Learning Algorithm for Deep Belief Nets. Hinton, Osindero , Teh. Conditional Learning is Hard. Conditional Learning is Hard. Conditional Learning is Hard. Conditional Learning is Hard. ?. Complementary Priors. A specially structured deep network. Training our deep network. - PowerPoint PPT PresentationTRANSCRIPT
A Fast Learning Algorithm for Deep Belief NetsHinton, Osindero, Teh
Conditional Learning is Hard
Conditional Learning is Hard
Conditional Learning is Hard
Conditional Learning is Hard
?
Complementary Priors
A specially structured deep network
Training our deep network
Training our deep network
Training our deep network
• This is the update for a restricted Boltzmann Machine
RBM training
Let’s relax the assumptions
RBM
Input
Greedy Training
Input
Greedy Training
Input
Greedy Training
Input
Fine tuning
Input
Fine tuning
Input
Fine tuning
Input
Fine tuning
Input
Yes, this actually works
All Done!