lecture 11 slides may 2 nd , 2006
DESCRIPTION
University of Washington Department of Electrical Engineering EE512 Spring, 2006 Graphical Models Jeff A. Bilmes . Lecture 11 Slides May 2 nd , 2006. Announcements. READING: M. Jordan: Chapters 4,10,12,17,18 Reminder: TA discussions and office hours: - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/1.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 1
University of WashingtonDepartment of Electrical Engineering
EE512 Spring, 2006 Graphical Models
Jeff A. Bilmes <[email protected]>Jeff A. Bilmes <[email protected]>
Lecture 11 Slides
May 2nd, 2006
![Page 2: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/2.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 2
• READING: – M. Jordan: Chapters 4,10,12,17,18
• Reminder: TA discussions and office hours:– Office hours: Thursdays 3:30-4:30, Sieg Ground Floor
Tutorial Center– Discussion Sections: Fridays 9:30-10:30, Sieg Ground Floor
Tutorial Center Lecture Room
• Reminder: take-home Midterm: May 5th-12th, you must work alone on this.
• Note: I am gone all next week (May 8th-12th). Subsequent weeks we will have makeup classes on Mondays at 6:00pm.
Announcements
![Page 3: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/3.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 3
• L1: Tues, 3/28: Overview, GMs, Intro BNs.• L2: Thur, 3/30: semantics of BNs + UGMs• L3: Tues, 4/4: elimination, probs, chordal I• L4: Thur, 4/6: chrdal, sep, decomp, elim• L5: Tue, 4/11: chdl/elim, mcs, triang, ci props.• L6: Thur, 4/13: MST,CI axioms, Markov prps.• L7: Tues, 4/18: Mobius, HC-thm, (F)=(G)• L8: Thur, 4/20: phylogenetic trees, HMMs• L9: Tue, 4/25: HMMs, inference on trees• L10: Thur, 4/27: Inference on trees, start poly
• L11: Tues, 5/2: polytrees, start JT inference• L12: Thur, 5/4• L13: Tues, 5/9• L14: Thur, 5/11• L15: Tue, 5/16• L16: Thur, 5/18• L17: Tues, 5/23• L18: Thur, 5/25• L19: Tue, 5/30• L20: Thur, 6/1: final presentations
Class Road Map
![Page 4: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/4.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 4
• L1: Tues, 3/28: • L2: Thur, 3/30:• L3: Tues, 4/4: • L4: Thur, 4/6:• L5: Tue, 4/11:• L6: Thur, 4/13:• L7: Tues, 4/18:• L8: Thur, 4/20: Team Lists, short abstracts I• L9: Tue, 4/25:• L10: Thur, 4/27: short abstracts II
• L11: Tues, 5/2: today• L12: Thur, 5/4: abstract II + progress• L13: Tues, 5/9• L14: Thur, 5/11: 1 page progress report• L15: Tue, 5/16• L16: Thur, 5/18: 1 page progress report• L17: Tues, 5/23• L18: Thur, 5/25: 1 page progress report• L19: Tue, 5/30• L20: Thur, 6/1: final presentations
• L21: Tue, 6/6 4-page papers due (like a conference paper).
Final Project Milestone Due Dates
• Team lists, abstracts, and progress reports must be turned in, in class and using paper (dead tree versions only).
• Final reports must be turned in electronically in PDF (no other formats accepted).
• Progress reports must report who did what so far!!
![Page 5: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/5.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 5
• Inference on trees• Inference on undirected trees• Example: voting tallying by message passing in trees• Begin inference on poly trees
Summary of Last Time
![Page 6: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/6.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 6
• inference on poly trees• Begin exact inference on junction trees
Outline of Today’s Lecture
![Page 7: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/7.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 7
Books and Sources for Today
• M. Jordan: Chapters 4,10,12,17,18• J. Pearl, Probabilistic Reasoning in Intelligent Systems:
Networks of Plausible Inference, 1988.
![Page 8: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/8.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 8
Bottom up Inference in undirected trees
![Page 9: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/9.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 9
Inference in undirected trees
![Page 10: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/10.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 10
Inference in undirected trees
![Page 11: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/11.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 11
Inference in undirected trees
![Page 12: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/12.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 12
Inference in undirected trees
![Page 13: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/13.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 13
Inference in polytrees
![Page 14: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/14.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 14
Inference in polytrees
![Page 15: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/15.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 15
Required Messages
![Page 16: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/16.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 16
Inference in polytrees
![Page 17: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/17.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 17
Inference in polytrees
![Page 18: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/18.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 18
Required Messages
![Page 19: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/19.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 19
Inference in polytrees
![Page 20: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/20.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 20
Inference in polytrees
![Page 21: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/21.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 21
Inference in polytrees: summary
![Page 22: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/22.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 22
What if cycles exist?
![Page 23: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/23.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 23
Ex: messages not valid
![Page 24: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/24.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 24
Inference
![Page 25: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/25.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 25
Inference: outline
![Page 26: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/26.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 26
Inference: moralization
![Page 27: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/27.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 27
Examples: assigning prob to clique potentials
![Page 28: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/28.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 28
Examples: assigning prob to clique potentials
![Page 29: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/29.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 29
Evidence
![Page 30: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/30.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 30
Goal calculation & Evidence
![Page 31: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/31.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 31
Example potentials
![Page 32: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/32.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 32
Goal
![Page 33: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/33.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 33
Potentials as marginals
![Page 34: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/34.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 34
Potentials don’t start as marginals
![Page 35: Lecture 11 Slides May 2 nd , 2006](https://reader036.vdocuments.us/reader036/viewer/2022062305/56814f58550346895dbd0456/html5/thumbnails/35.jpg)
Lec 11: May 2nd, 2006 EE512 - Graphical Models - J. Bilmes Page 35
Potentials don’t start as marginals