![Page 1: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/1.jpg)
15-780: Graduate AILecture 3. FOL proofs; SAT
Geoff Gordon (this lecture)Tuomas Sandholm
TAs Byron Boots, Sam Ganzfried
1
![Page 2: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/2.jpg)
Admin
2
![Page 3: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/3.jpg)
HW1
Out todayDue Tue, Feb. 3 (two weeks)
hand in hardcopy at beginning of classCovers propositional and FOLDon’t leave it to the last minute!
3
![Page 4: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/4.jpg)
Collaboration policy
OK to discuss general strategiesWhat you hand in must be your own work
written with no access to notes from joint meetings, websites, etc.
You must acknowledge all significant discussions, relevant websites, etc., on your HW
4
![Page 5: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/5.jpg)
Late policy
You have 3 late days to use on HWsthese account for conference travel, holidays, illness, or any other reasons
After late days, 75% for next day, 50% for next, 0% thereafter (but still must turn in)Day = 24 hrs, HWs due at 10:30AM
5
![Page 6: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/6.jpg)
Office hours
Office hours start this week (see website for times)But, I have a conflict this week due to admissions; let me know by email if there is demand, and if so I can reschedule
6
![Page 7: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/7.jpg)
Matlab tutorial
Thu 1/22, 4–5PM, Wean Hall 5409
7
![Page 8: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/8.jpg)
Review
8
![Page 9: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/9.jpg)
In propositional logic
Compositional semantics, structural inductionProof trees, proof by contradictionInference rules (e.g., resolution)Soundness, completenessHorn clausesNonmonotonic logic
9
![Page 10: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/10.jpg)
In FOL
Compositional semanticsobjects, functions, predicatesterms, atoms, literals, sentencesquantifiers, free/bound variablesmodels, interpretations
Generalized de Morgan’s lawSkolemization, CNF
10
![Page 11: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/11.jpg)
Project Ideas
11
![Page 12: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/12.jpg)
Traffic insanity
12
![Page 13: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/13.jpg)
Sensor planning
Plan a path for this robot so that it gets a good view of an object as fast as possible
13
![Page 14: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/14.jpg)
Mini-robots
Do something cool w/ Lego Mindstormsplan footstep placementsplan how to grip objects
14
![Page 15: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/15.jpg)
Poker
15
![Page 16: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/16.jpg)
Poker
Minimax strategy for heads-up poker = solving linear program1-card hands, 13-card deck: 52 vars, instantaneousRI Hold’Em: ~1,000,000 vars
2 weeks / 30GB (exact sol, CPLEX)40 min / 1.5GB (approx sol)
TX Hold’Em: ??? (up to 1017 vars or so)16
![Page 17: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/17.jpg)
Poker
Learning by repeated play
17
![Page 18: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/18.jpg)
Understand the web
Write a probabilistic knowledge base describing a portion of the webLearn parameters of the model
18
![Page 19: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/19.jpg)
Proofs in FOL
19
![Page 20: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/20.jpg)
FOL is special
Despite being much more powerful than propositional logic, there is still a sound and complete inference procedure for FOLAlmost any significant extension breaks this propertyThis is why FOL is popular: very powerful language with a sound & complete inference procedure
20
![Page 21: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/21.jpg)
Proofs
Proofs by contradiction work as before:add ¬S to KB
put in CNFrun resolutionif we get an empty clause, we’ve proven S by contradiction
But, CNF and resolution have changed
21
![Page 22: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/22.jpg)
Generalizing resolution
Propositional: (¬a ∨ b) ∧ a ⊨ b
FOL: (¬man(x) ∨ mortal(x)) ∧ man(Socrates)
⊨ (¬man(Socrates) ∨ mortal(Socrates))∧ man(Socrates)
⊨ mortal(Socrates)
Difference: had to substitute x → Socrates22
![Page 23: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/23.jpg)
Universal instantiation
What we just did is UI:(¬man(x) ∨ mortal(x))⊨ (¬man(Socrates) ∨ mortal(Socrates))
Works for x → any ground term(¬man(uncle(student(Socrates))) ∨ mortal(uncle(student(Socrates))))For proofs, need a good way to find useful instantiations
23
![Page 24: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/24.jpg)
Substitution lists
List of variable → value pairs
Values may contain variables (leaving flexibility about final instantiation)But, no LHS may be contained in any RHS
i.e., applying substitution twice is the same as doing it once
E.g., x → Socrates, y → LCA(Socrates, z)LCA = last common advisor
24
![Page 25: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/25.jpg)
Unification
Two FOL terms unify with each other if there is a substitution list that makes them syntactically identicalman(x), man(Socrates) unify using the substitution x → Socrates
Importance: purely syntactic criterion for identifying good substitutions
25
![Page 26: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/26.jpg)
Unification examples
loves(x, x), loves(John, y) unify using x → John, y → John
loves(x, x), loves(John, Mary) can’t unifyloves(uncle(x), y), loves(z, aunt(z)):
26
![Page 27: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/27.jpg)
Unification examples
loves(x, x), loves(John, y) unify using x → John, y → John
loves(x, x), loves(John, Mary) can’t unifyloves(uncle(x), y), loves(z, aunt(z)):
z → uncle(x), y → aunt(uncle(x))
loves(uncle(x), aunt(uncle(x)))
27
![Page 28: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/28.jpg)
Quiz
Can we unifyknows(John, x) knows(x, Mary)
What aboutknows(John, x) knows(y, Mary)
28
![Page 29: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/29.jpg)
Standardizing apart
Can we unifyknows(John, x) knows(x, Mary)
What aboutknows(John, x) knows(y, Mary)
No!
x → Mary, y → John
29
![Page 30: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/30.jpg)
Standardize apart
But knows(x, Mary) is logically equivalent to knows(y, Mary)!Moral: standardize apart before unifying
30
![Page 31: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/31.jpg)
Most general unifier
May be many substitutions that unify two formulasMGU is unique (up to renaming)Simple, moderately fast algorithm for finding MGU (see RN); more complex, linear-time algorithm
Linear unification. MS Paterson, MN Wegman. Proceedings of the eighth annual ACM symposium on Theory of Computing, 1976.
31
![Page 32: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/32.jpg)
First-order resolution
Given clauses (a ∨ b ∨ c), (¬c’ ∨ d ∨ e), and a substitution list V unifying c and c’Conclude (a ∨ b ∨ d ∨ e) : V
32
![Page 33: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/33.jpg)
Example
33
![Page 34: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/34.jpg)
First-order factoring
When removing redundant literals, we have the option of unifying them firstGiven clause (a ∨ b ∨ c), substitution V
If a : V and b : V are the sameThen we can conclude (a ∨ c) : V
34
![Page 35: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/35.jpg)
Completeness
First-order resolution (together with first-order factoring) is sound and complete for FOLFamous theorem
35
![Page 36: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/36.jpg)
Completeness
36
![Page 37: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/37.jpg)
Proof strategy
We’ll show FOL completeness by reducing to propositional completeness To prove S, put KB ∧ ¬S in clause form
Turn FOL KB into propositional KBsin general, infinitely many
Check each one in orderIf any one is unsatisfiable, we will have our proof
37
![Page 38: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/38.jpg)
Propositionalization
Given a FOL KB in clause formAnd a set of terms U (for universe)We can propositionalize KB under U by substituting elements of U for free variables in all combinations
38
![Page 39: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/39.jpg)
Propositionalization example
(¬man(x) ∨ mortal(x))
mortal(Socrates)favorite_drink(Socrates) = hemlockdrinks(x, favorite_drink(x))
U = {Socrates, hemlock, Fred}
39
![Page 40: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/40.jpg)
Propositionalization example
(¬man(Socrates) ∨ mortal(Socrates)) (¬man(Fred) ∨ mortal(Fred)) (¬man(hemlock) ∨ mortal(hemlock))drinks(Socrates, favorite_drink(Socrates)) drinks(hemlock, favorite_drink(hemlock)) drinks(Fred, favorite_drink(Fred))mortal(Socrates) ∧ favorite_drink(Socrates) = hemlock
40
![Page 41: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/41.jpg)
Choosing a universe
To check a FOL KB, propositionalize it using some universe UWhich universe?
41
![Page 42: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/42.jpg)
Herbrand Universe
Herbrand universe H of formula S:start with all objects mentioned in Sor synthetic object X if none mentionedapply all functions mentioned in S to all combinations of objects in H, add to Hrepeat
Jacques Herbrand1908–1931
42
![Page 43: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/43.jpg)
Herbrand Universe
E.g., loves(uncle(John), Mary) yieldsH = {John, Mary, uncle(John), uncle(Mary), uncle(uncle(John)), uncle(uncle(Mary)), … }
43
![Page 44: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/44.jpg)
Herbrand’s theorem
If a FOL KB in clause form is unsatisfiableAnd H is its Herbrand universeThen the propositionalized KB is unsatisfiable for some finite U ⊆ H
44
![Page 45: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/45.jpg)
Significance
This is one half of the equivalence we want: unsatisfiable FOL KB ⇒ ∃ finite U. unsatisfiable propositional KB
45
![Page 46: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/46.jpg)
Example
(¬man(x) ∨ mortal(x)) ∧ man(uncle(Socrates)) ∧ ¬mortal(x)
H = {S, u(S), u(u(S)), … }If U = {u(S)}, PKB =(¬man(u(S)) ∨ mortal(u(S))) ∧ man(u(S)) ∧ ¬mortal(u(S))Resolving twice yields F
46
![Page 47: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/47.jpg)
Converse of Herbrand
A. J. Robinson proved “lifting lemma”Write PKB for a propositionalization of KB (under some universe)Any resolution proof in PKB corresponds to a resolution proof in KB… and, if PKB is unsatisfiable, there is a proof of F (by prop. completeness); so, lifting it shows KB unsatisfiable
47
![Page 48: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/48.jpg)
Example
(¬man(u(S)) ∨ mortal(u(S))) ∧ man(u(S)) ∧ ¬mortal(u(S))
We resolved on man(u(S)) yielding mortal(u(S))Lifted, resolve ¬man(x) w/ man(u(S)), binding x → u(S)
48
![Page 49: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/49.jpg)
Proofs w/ Herbrand & Robinson
So, FOL KB is unsatisfiable if and only if there is a subset of its Herbrand universe making PKB unsatisfiableI.e., if we have a way to find proofs in propositional logic, we have a way to find them in FOL
49
![Page 50: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/50.jpg)
Proofs w/ Herbrand & Robinson
To prove S, put KB ∧ ¬S in CNF: KB’
Build subsets of Herbrand universe in increasing order of size: U1, U2, …Propositionalize KB’ w/ Ui, look for proofIf Ui unsatisfiable, use lifting to get a contradiction in KB’If Ui satisfiable, move on to Ui+1
50
![Page 51: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/51.jpg)
How long will this take?
If S is not entailed, we will never find a contradictionIn this case, if H infinite, we’ll never stopSo, entailment is semidecidable
equivalently, entailed statements are recursively enumerable
51
![Page 52: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/52.jpg)
Variation
Restrict semantics so we only need to check one finite propositional KBUnique names: objects with different names are different (John ≠ Mary)
Domain closure: objects without names given in KB don’t existRestrictions also make entailment, validity feasible
52
![Page 53: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/53.jpg)
Who? What?Where?
53
![Page 54: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/54.jpg)
Wh-questions
We’ve shown how to prove a statement like mortal(Socrates)What if we have a question whose answer is not just yes/no, like “who killed JR?” or “where is my robot?”Simplest approach: prove ∃x. killed(x, JR), hope the proof is constructive
5454
![Page 55: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/55.jpg)
Answer literals
Simple approach doesn’t always workInstead of ¬S(x), add (¬S(x) ∨ answer(x))
If there’s a contradiction, we can eliminate ¬S(x) by resolution and unification, leaving answer(x) with x bound to a value that causes a contradiction
5555
![Page 56: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/56.jpg)
Example
56
![Page 57: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/57.jpg)
FOL Extensions
57
![Page 58: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/58.jpg)
Equality
Paramodulation is sound and complete for FOL+equality (see RN)Or, resolution + axiom schema
58
![Page 59: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/59.jpg)
Second order logic
SOL adds quantification over predicatesE.g., principle of mathematical induction:∀P. P(0) ∧ (∀x. P(x) ⇒ P(S(x))) ⇒ ∀x. P(x)
There is no sound and complete inference procedure for SOL (Gödel’s famous incompleteness theorem)
59
![Page 60: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/60.jpg)
Others
Temporal logics (“P(x) will be true at some time in the future”)Modal logics (“John believes P(x)”)Nonmonotonic FOLFirst-class functions (lambda operator, application)…
60
![Page 61: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/61.jpg)
Using FOL
61
![Page 62: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/62.jpg)
Knowledge engineering
Identify relevant objects, functions, and predicatesEncode general background knowledge about domain (reusable)Encode specific problem instancePose queries (is P(x) true? Find x such that P(x))
62
![Page 63: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/63.jpg)
Common themes
RN identifies many common idioms and problems for knowledge engineeringHierarchies, fluents, knowledge, belief, …We’ll look at a couple
63
![Page 64: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/64.jpg)
Taxonomies
isa(Mammal, Animal)disjoint(Animal, Vegetable)partition({Animal, Vegetable, Mineral, Intangible}, Everything)
64
![Page 65: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/65.jpg)
Inheritance
Transitive: isa(x, y) ∧ isa(y, z) ⇒ isa(x, z)
Attach properties anywhere in hierarchyisa(Pigeon, Bird)isa(x, Bird) ⇒ flies(x)isa(x, Pigeon) ⇒ gray(x)
So, isa(Tweety, Pigeon) tells us Tweety is gray and flies
65
![Page 66: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/66.jpg)
Physical composition
partOf(Wean4625, WeanHall)partOf(water37, water)Note distinction between mass and count nouns: any partOf a mass noun is also an example of that same mass noun
66
![Page 67: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/67.jpg)
Fluents
Fluent = property that changes over timeat(Robot, Wean4623, 11AM)
Actions change fluentsFluents chain together to form possible worldsat(x, p, t) ∧ adj(p, q) ⇒ poss(go(x, p, q)) ∧ at(x, q, result(go(x, p, q), t))
67
![Page 68: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/68.jpg)
Frame problem
Suppose we execute an unrelated action (e.g., talk(Professor, FOL))Robot shouldn’t move:
if at(Robot, Wean4623, t), want at(Robot, Wean4623, result(talk(Professor, FOL)))
But we can’t prove it using tools described so far!
68
![Page 69: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/69.jpg)
Frame problem
The frame problem is that it’s a pain to list all of the things that don’t change when we execute an actionNaive solution: frame axioms
for each fluent, list actions that can’t change fluentKB size: O(AF) for A actions, F fluents
69
![Page 70: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/70.jpg)
Frame problem
Better solution: successor-state axiomsFor each fluent, list actions that can change it (typically fewer): if go(x, p, q) is possible,at(x, q, result(a, t)) ⇔ a = go(x, p, q) ∨ (at(x, q, t) ∧ a ≠ go(y, z))
Size O(AE+F) if each action has E effects
70
![Page 71: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/71.jpg)
Sadly, also necessary…
Debug knowledge baseSevere bug: logical contradictionsLess severe: undesired conclusionsLeast severe: missing conclusions
First 2: trace back chain of reasoning until reason for failure is revealedLast: trace desired proof, find what’s missing
71
![Page 72: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/72.jpg)
SAT
72
![Page 73: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/73.jpg)
Satisfiability
SAT is the problem of determining whether a given propositional logic sentence is satisfiableA decision problem: given an instance, answer yes or noA fundamental problem in CS
73
![Page 74: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/74.jpg)
SAT is a general problem
Many other useful decision problems reduce to SATInformally, if we can solve SAT, we can solve these other problemsSo a good SAT solver is a good AI building block
74
![Page 75: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/75.jpg)
Example decision problem
k-coloring: can we color a map using only k colors in a way that keeps neighboring regions from being the same color?
75
![Page 76: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/76.jpg)
Example decision problem
Propositional planning: given a list of operators (w/ preconditions, effects), can we apply operators in some order to achieve a desired goal?Have cake & eat it too exampleWe’ll see later how to represent as SAT
76
![Page 77: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/77.jpg)
Reduction
Loosely, “A reduces to B” means that if we can solve B then we can solve AMore formally, A, B are decision problems (instances ↦ truth values)
A reduction is a poly-time function f such that, given an instance a of A
f(a) is an instance of B, and A(a) = B(f(a))
77
![Page 78: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/78.jpg)
Reduction picture
78
![Page 79: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/79.jpg)
Reduction picture
79
![Page 80: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/80.jpg)
Reduction picture
80
![Page 81: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/81.jpg)
Back to example
Each square must be red, green, or blueAdjacent squares can’t both be red (similarly, green or blue)
81
![Page 82: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/82.jpg)
Back to example
(ar ∨ ag ∨ ab) ∧ (br ∨ bg ∨ bb) ∧ (cr ∨ cg ∨ cb) ∧ (dr ∨ dg ∨ db) ∧ (er ∨ eg ∨ eb) ∧ (zr ∨ zg ∨ zb)(¬ar ∨ ¬br) ∧ (¬ag ∨ ¬bg) ∧ (¬ab ∨ ¬bb)
(¬ar ∨ ¬zr) ∧ (¬ag ∨ ¬zg) ∧ (¬ab ∨ ¬zb)
…
82
![Page 83: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/83.jpg)
Direction of reduction
If A reduces to B:if we can solve B, we can solve Aso B must be at least as hard as A
Trivially, can take an easy problem and reduce it to a hard one
83
![Page 84: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/84.jpg)
Not-so-useful reduction
Path planning reduces to SATVariables: is edge e in path?Constraints:
exactly 1 path-edge touches startexactly 1 path-edge touches goaleither 0 or 2 touch each other node
84
![Page 85: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/85.jpg)
More useful: reduction to 3SAT
We saw that decision problems can be reduced to SAT
is CNF formula satisfiable?Can reduce even further, to 3SAT
is 3CNF formula satisfiable?Useful if reducing SAT/3SAT to another problem (to show other problem hard)
85
![Page 86: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/86.jpg)
Reduction to 3SAT
Must get rid of long clausesE.g., (a ∨ ¬b ∨ c ∨ d ∨ e ∨ ¬f)
Replace with(a ∨ ¬b ∨ x) ∧ (¬x ∨ c ∨ y) ∧ (¬y ∨ d ∨ z) ∧ (¬z ∨ e ∨ ¬f)
86
![Page 87: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/87.jpg)
NP-completeness
S. A. Cook in 1971 proved that many useful decision problems reduce back and forth to SAT
showed how to simulate poly-size-memory computer w/ (very complicated, but still poly-size) SAT problem
Equivalently, SAT is exactly as hard (in theory at least) as these other problems
87
![Page 88: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/88.jpg)
Cost of reduction
Complexity theorists often ignore little things like constant factors (or even polynomial factors!)So, is it a good idea to reduce your decision problem to SAT?Answer: sometimes…
88
![Page 89: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/89.jpg)
Cost of reduction
SAT is well studied ⇒ fast solversSo, if there is an efficient reduction, ability to use fast SAT solvers can be a win
e.g., 3-coloringanother example later (SATplan)
Other times, cost of reduction is too highusu. because instance gets biggerwill also see example later (MILP)
89
![Page 90: 15-780: Graduate AI Lecture 3. FOL proofs; SATggordon/780-spring09/slides/03-fol+sat.pdf · HW1 Out today Due Tue, Feb. 3 (two weeks) hand in hardcopy at beginning of class Covers](https://reader030.vdocuments.us/reader030/viewer/2022020414/5bb6fa5a09d3f23d358c56c5/html5/thumbnails/90.jpg)
Choosing a reduction
May be many reductions from problem A to problem BMay have wildly different properties
e.g., solving transformed instance may take seconds vs. days
90