Download - 05 cv mil_normal_distribution
![Page 1: 05 cv mil_normal_distribution](https://reader034.vdocuments.us/reader034/viewer/2022042715/5597e1da1a28ab4c758b463d/html5/thumbnails/1.jpg)
Computer vision: models, learning and inference
Chapter 5
The normal distribution
Please send errata to [email protected]
![Page 2: 05 cv mil_normal_distribution](https://reader034.vdocuments.us/reader034/viewer/2022042715/5597e1da1a28ab4c758b463d/html5/thumbnails/2.jpg)
Univariate Normal Distribution
For short we write:
Univariate normal distribution describes single continuous variable.
Takes 2 parameters and 2>02Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
![Page 3: 05 cv mil_normal_distribution](https://reader034.vdocuments.us/reader034/viewer/2022042715/5597e1da1a28ab4c758b463d/html5/thumbnails/3.jpg)
Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
Multivariate Normal Distribution
For short we write:
Multivariate normal distribution describes multiple continuous variables. Takes 2 parameters
• a vector containing mean position,• a symmetric “positive definite” covariance matrix
Positive definite: is positive for any real
3
![Page 4: 05 cv mil_normal_distribution](https://reader034.vdocuments.us/reader034/viewer/2022042715/5597e1da1a28ab4c758b463d/html5/thumbnails/4.jpg)
Types of covariance
Computer vision: models, learning and inference. ©2011 Simon J.D. Prince 4
Symmetric
![Page 5: 05 cv mil_normal_distribution](https://reader034.vdocuments.us/reader034/viewer/2022042715/5597e1da1a28ab4c758b463d/html5/thumbnails/5.jpg)
Diagonal Covariance = Independence
Computer vision: models, learning and inference. ©2011 Simon J.D. Prince 5
![Page 6: 05 cv mil_normal_distribution](https://reader034.vdocuments.us/reader034/viewer/2022042715/5597e1da1a28ab4c758b463d/html5/thumbnails/6.jpg)
Consider green frame of reference:
Relationship between pink and green frames of reference:
Substituting in:
Conclusion:Full covariance can be decomposed into rotation matrix and diagonal
Decomposition of Covariance
Computer vision: models, learning and inference. ©2011 Simon J.D. Prince 6
![Page 7: 05 cv mil_normal_distribution](https://reader034.vdocuments.us/reader034/viewer/2022042715/5597e1da1a28ab4c758b463d/html5/thumbnails/7.jpg)
Transformation of Variables
If and we transform the variable as
The result is also a normal distribution:
Can be used to generate data from arbitrary Gaussians from standard one
Computer vision: models, learning and inference. ©2011 Simon J.D. Prince 7
![Page 8: 05 cv mil_normal_distribution](https://reader034.vdocuments.us/reader034/viewer/2022042715/5597e1da1a28ab4c758b463d/html5/thumbnails/8.jpg)
Marginal Distributions
Marginal distributions of a multivariate normal are also normal
Ifthen
Computer vision: models, learning and inference. ©2011 Simon J.D. Prince 8
![Page 9: 05 cv mil_normal_distribution](https://reader034.vdocuments.us/reader034/viewer/2022042715/5597e1da1a28ab4c758b463d/html5/thumbnails/9.jpg)
Conditional Distributions
If
then
Computer vision: models, learning and inference. ©2011 Simon J.D. Prince 9
![Page 10: 05 cv mil_normal_distribution](https://reader034.vdocuments.us/reader034/viewer/2022042715/5597e1da1a28ab4c758b463d/html5/thumbnails/10.jpg)
Conditional Distributions
Computer vision: models, learning and inference. ©2011 Simon J.D. Prince 10
For spherical / diagonal case, x1 and x2 are independent so all of the conditional distributions are the same.
![Page 11: 05 cv mil_normal_distribution](https://reader034.vdocuments.us/reader034/viewer/2022042715/5597e1da1a28ab4c758b463d/html5/thumbnails/11.jpg)
Product of two normals(self-conjugacy w.r.t mean)
The product of any two normal distributions in the same variable is proportional to a third normal distribution
Amazingly, the constant also has the form of a normal!
Computer vision: models, learning and inference. ©2011 Simon J.D. Prince 11
![Page 12: 05 cv mil_normal_distribution](https://reader034.vdocuments.us/reader034/viewer/2022042715/5597e1da1a28ab4c758b463d/html5/thumbnails/12.jpg)
Change of Variables
where
If the mean of a normal in x is proportional to y then this can be re-expressed as a normal in y that is proportional to x
Computer vision: models, learning and inference. ©2011 Simon J.D. Prince 12
![Page 13: 05 cv mil_normal_distribution](https://reader034.vdocuments.us/reader034/viewer/2022042715/5597e1da1a28ab4c758b463d/html5/thumbnails/13.jpg)
Conclusion
13Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
• Normal distribution is used ubiquitously in computer vision
• Important properties:
• Marginal dist. of normal is normal• Conditional dist. of normal is normal• Product of normals prop. to normal• Normal under linear change of variables