local probabilistic models: tabular cpdssrihari/cse674/chap5/5.1-tabularcpds.pdf · 1.tabular cpds...
TRANSCRIPT
![Page 2: Local Probabilistic Models: Tabular CPDssrihari/CSE674/Chap5/5.1-TabularCPDs.pdf · 1.Tabular CPDs 2.Deterministic CPDs 3.Context-Specific CPDs –(1)Tree CPD (Printer Diagnosis),](https://reader034.vdocuments.us/reader034/viewer/2022042918/5f5eee4a06048c23ac643341/html5/thumbnails/2.jpg)
Probabilistic AI Srihari
Local Probabilistic Models• Bayesian Networks capture global
properties of independence of variables
• Properties of independence allow us to:– factorize high-dimensional joint distribution into
product of lower-dimensional CPDs (or factors)
• Next: exploit additional regularities in CPDs 2
P(D, I ,G,S,L) = P(D)P(I )P(G | D, I )P(S | I )P(L |G)
I(G) = {(D ⊥ I | φ), (G ⊥ S |D, I ), (S ⊥ D,G,L | I ), (D ⊥ I ,S |φ) (L ⊥ I ,D,S |G)}
è
![Page 3: Local Probabilistic Models: Tabular CPDssrihari/CSE674/Chap5/5.1-TabularCPDs.pdf · 1.Tabular CPDs 2.Deterministic CPDs 3.Context-Specific CPDs –(1)Tree CPD (Printer Diagnosis),](https://reader034.vdocuments.us/reader034/viewer/2022042918/5f5eee4a06048c23ac643341/html5/thumbnails/3.jpg)
Probabilistic AI Srihari
Local Probabilistic Model Types
3
![Page 4: Local Probabilistic Models: Tabular CPDssrihari/CSE674/Chap5/5.1-TabularCPDs.pdf · 1.Tabular CPDs 2.Deterministic CPDs 3.Context-Specific CPDs –(1)Tree CPD (Printer Diagnosis),](https://reader034.vdocuments.us/reader034/viewer/2022042918/5f5eee4a06048c23ac643341/html5/thumbnails/4.jpg)
Probabilistic AI Srihari
TOC for Local Probabilistic Models1. Tabular CPDs2. Deterministic CPDs3. Context-Specific CPDs
– (1)Tree CPD (Printer Diagnosis), (2) Rule CPD4. Independence of Causal Influence
– (1) Noisy-OR, (2) Generalized Linear Models5. Continuous Variables: Robotics
– Hybrid Models: Thermostat
6. Conditional BNs: Computer Network4
![Page 5: Local Probabilistic Models: Tabular CPDssrihari/CSE674/Chap5/5.1-TabularCPDs.pdf · 1.Tabular CPDs 2.Deterministic CPDs 3.Context-Specific CPDs –(1)Tree CPD (Printer Diagnosis),](https://reader034.vdocuments.us/reader034/viewer/2022042918/5f5eee4a06048c23ac643341/html5/thumbnails/5.jpg)
Probabilistic AI Srihari
Tabular CPDs
5
• When Random Variables are discrete-valued
• Encode P(X|paX) as a table– Contains an entry for each assignment to X & paX– Proper CPD requires all non-negative values and
• Inference algorithms can use table CPDs in a natural way– Leads to perception that table CPDs are inherent
to BNs, but….........
P x | pa
X( )x∈Val(x )∑ = 1
![Page 6: Local Probabilistic Models: Tabular CPDssrihari/CSE674/Chap5/5.1-TabularCPDs.pdf · 1.Tabular CPDs 2.Deterministic CPDs 3.Context-Specific CPDs –(1)Tree CPD (Printer Diagnosis),](https://reader034.vdocuments.us/reader034/viewer/2022042918/5f5eee4a06048c23ac643341/html5/thumbnails/6.jpg)
Probabilistic AI Srihari
Disadvantages of Tabular CPDs• Continuous case
– Cannot store each conditional probability in a table• Domain of random variable is infinite
• Discrete case– Parameters: exponential with no. of parents:
• for X with n binary parents need 2n values for P(X|paX)
6
Two binaryParentsFour values
![Page 7: Local Probabilistic Models: Tabular CPDssrihari/CSE674/Chap5/5.1-TabularCPDs.pdf · 1.Tabular CPDs 2.Deterministic CPDs 3.Context-Specific CPDs –(1)Tree CPD (Printer Diagnosis),](https://reader034.vdocuments.us/reader034/viewer/2022042918/5f5eee4a06048c23ac643341/html5/thumbnails/7.jpg)
Probabilistic AI Srihari
Unwieldiness of CPTs• Tabular representation becomes rapidly large
as the no. of parents grows• It is a serious one in many settings
– If Fever is caused by 10 diseases, we need to ask expert to answer 1,024 questions– tiresome!
• Regularity among CPDs is not exploited– When D1 true, Fever is certain irrespective of others
D1
Fever
D10..
![Page 8: Local Probabilistic Models: Tabular CPDssrihari/CSE674/Chap5/5.1-TabularCPDs.pdf · 1.Tabular CPDs 2.Deterministic CPDs 3.Context-Specific CPDs –(1)Tree CPD (Printer Diagnosis),](https://reader034.vdocuments.us/reader034/viewer/2022042918/5f5eee4a06048c23ac643341/html5/thumbnails/8.jpg)
Probabilistic AI Srihari
Solution: Different viewpoint
• A CPD needs to specify a conditional probability P(x|paX) for every assignment of values paX and x but does not have to do so by listing each such value explicitly
• View the CPDs not as tables listing all conditional probabilities but as functions that given paX and x return the conditional probability P(x|paX)
8