Download - Variational AutoEncoder
Transcript
![Page 1: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/1.jpg)
1
![Page 3: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/3.jpg)
3
![Page 4: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/4.jpg)
4
![Page 5: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/5.jpg)
5
p(x|y) = p(y|x)p(x)p(y)
p(x, y) = p(y|x)p(x)
p(x) =
Zp(x, y)dy
![Page 6: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/6.jpg)
6
p(✓|D) =p(D|✓)p(✓)
p(D)
p(x|D) =X
✓
p(x|✓,D)p(✓|D)
![Page 7: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/7.jpg)
7
![Page 8: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/8.jpg)
8
![Page 9: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/9.jpg)
9
log p(x) =
+ L= �KL(q(z|x)||p(z))L + E
q(z|x)[log p(x|z)]KL(q(z|x)||p(z|x))
log p(x) = log p(x)
Zq(z|x)dz
= log
p(x, z)
p(z|x)
Zq(z|x)dz
=
Zq(z|x) log q(z|x)
p(z|x)p(x, z)
q(z|x) dz
= �Z
q(z|x) log p(z|x)q(z|x)dz +
Zq(z|x)log p(x, z)
q(z|x) dz
= KL(q(z|x)||p(z|x)) + L
![Page 10: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/10.jpg)
10
![Page 11: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/11.jpg)
11
![Page 12: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/12.jpg)
12
p✓(x|z)
p✓(x|z)
q�(z|x)
q�(z|x)
![Page 13: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/13.jpg)
13
q�(z|x) p✓(x|z)
L(x; ✓,�) = �KL(q�(z|x)||p(z)) + Eq�(z|x)[log p✓(x|z)]
![Page 14: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/14.jpg)
14
L(x; ✓,�) = �KL(q�(z|x)||p(z)) + Eq�(z|x)[log p✓(x|z)]
L(x; ✓,�) = �1
2
dX(1 + log (�2
d)� µ2d � �d)
+ 1
L
lXlog p✓(x|zl)
![Page 15: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/15.jpg)
15
z ⇠ N (µ,�)
z ⇠ N (µ,�)
![Page 16: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/16.jpg)
16
✏ ⇠ N (0, I) z = µ+ ✏�
![Page 17: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/17.jpg)
17
q�(z|x) p✓(x|z)
![Page 18: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/18.jpg)
18
![Page 19: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/19.jpg)
19
![Page 20: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/20.jpg)
20
![Page 21: Variational AutoEncoder](https://reader035.vdocuments.us/reader035/viewer/2022062823/586f79b51a28ab10258b705d/html5/thumbnails/21.jpg)
21