advanced probability theory - university of oxford
TRANSCRIPT
![Page 2: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/2.jpg)
• William of Ockham: model selection
• Thomas Bayes: inference
• Claude Shannon: uncertainty and information
• Edwin Jaynes: logic and inference
![Page 3: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/3.jpg)
![Page 4: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/4.jpg)
![Page 5: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/5.jpg)
![Page 6: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/6.jpg)
(a is just a)
![Page 7: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/7.jpg)
![Page 8: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/8.jpg)
![Page 9: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/9.jpg)
![Page 10: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/10.jpg)
![Page 11: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/11.jpg)
![Page 12: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/12.jpg)
![Page 13: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/13.jpg)
![Page 14: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/14.jpg)
Belief update – learning – basis of modern ML
![Page 15: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/15.jpg)
(Proof of this in Lecture 2)
![Page 16: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/16.jpg)
![Page 17: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/17.jpg)
−10 −8 −6 −4 −2 0 2 4 6 8 100
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
p(x)
p(A|x)
max{p(A|x),p(B|x)}
p(x|A)
Fig 1.2
![Page 18: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/18.jpg)
![Page 19: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/19.jpg)
![Page 20: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/20.jpg)
![Page 21: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/21.jpg)
![Page 22: Advanced Probability Theory - University of Oxford](https://reader030.vdocuments.us/reader030/viewer/2022012017/615b68b48f40fd5bb16dc22e/html5/thumbnails/22.jpg)