2007/9/15aiai '07 (aix-en-provence, france)1 reconsideration of circumscriptive induction with...

32
2007/9/15 AIAI '07 (Aix-en-Provence , France) 1 Reconsideration of Cir cumscriptive Induction with Pointwise Circumscrip tion Koji Iwanuma 1 Katsumi Inoue 2 Hidetomo Nabeshima 1 1 University of Yamanashi 2 National Institute of Informatics

Upload: liliana-snow

Post on 27-Dec-2015

216 views

Category:

Documents


0 download

TRANSCRIPT

2007/9/15 AIAI '07 (Aix-en-Provence, France) 1

Reconsideration of Circumscriptive Induction with

Pointwise Circumscription Koji Iwanuma1

Katsumi Inoue2

Hidetomo Nabeshima1

1 University of Yamanashi2 National Institute of Informatics

2007/9/15 AIAI '07 (Aix-en-Provence, France) 2

Contents

Background Explanatory Induction and Descriptive Induction Circumscriptive Induction for unifying both induction

Reconsideration of Circumscriptive Induction General Inductive Leap and Strong Conservativeness

Pointwise Circumscription, i.e., a first-order approximation of circumscription, as Yet Another Induction Framework

Conclusions and Future Works

2007/9/15 AIAI '07 (Aix-en-Provence, France) 3

Induction

Explanatory Induction Definition [Muggleton 95]

Given: B and EFind: H such that B∧H E

Descriptive Induction Definition [Helft 89]

Given: B and EFind: H such that comp (B∧E ) H

the same logical form as abduction

a formalization of nonmonotonic reasoning

2007/9/15 AIAI '07 (Aix-en-Provence, France) 4

Example

Explanatory induction H = Bird (x) ⊃ Flies (x) Inductive leap: B∧H Flies (b)

Descriptive induction H = Flies (x) ⊃ Bird (x) Incompleteness: B ∧H Flies(a)

Background knowledge: B = Bird(a) ∧ Bird(b)

Observations: E = Flies(a)

inductive leap:deduction of new facts not stated in given observations

incompleteness:inability to explainobservations

2007/9/15 AIAI '07 (Aix-en-Provence, France) 5

hypothesis by explanatory induction

hypotheses by descriptive induction

Inductive Leaps and Incompleteness

facts in E

facts not in E inductive leaps uncovered

2007/9/15 AIAI '07 (Aix-en-Provence, France) 6

Difficult to combine

Explanatory induction complete non-conservative (i.e., inductive leaps)

Descriptive induction incomplete conservative (i.e., no inductive leap)

Circumscriptive induction [Inoue and Saito 04] unify both induction for keeping each

merit.

2007/9/15 AIAI '07 (Aix-en-Provence, France) 7

Circumscription

Definition [McCarthy 80, Lifschitz 85]CIRC[A;P;Z ]≡A(P,Z)∧∀ pz (p < P ⊃ ¬ A(p,z))

Policy Minimized predicates P

predicates whose extensions are minimized Variable predicates Z

predicates whose extensions are allowed to vary in minimizing predicates of P

Fixed predicates Qthe rest of predicates whose extensions are fixed

2007/9/15 AIAI '07 (Aix-en-Provence, France) 8

Circumscriptive Induction [Inoue and Saito 04]

Circumscriptive Induction Problem

Given clausal theories B and E, disjoint predicates P

and Z,

〈 B, E, P, Z 〉 is a circumscriptive induction problem

Circumscriptive InductionH is a correct solution to the 〈 B, E, P, Z 〉 if CIRC[B∧E ;P ;Z ] H B ∧H E

descriptive induction

explanatory induction

2007/9/15 AIAI '07 (Aix-en-Provence, France) 9

Example

Explanatory induction H = Bird (x) ⊃ Flies (x) Inductive leap: Flies (b)

Descriptive induction H = Flies (x) ⊃ Bird (x) incomplete: B ∧H Flies(a)

Circumscriptive induction H = Bird (x) ∧(x ≠b) ⊃ Flies (x) conservative and complete

for a new fact Bird (c ), B∧H Flies (c )

Background knowledge: B = Bird(a) ∧ Bird(b)

Observations: E = Flies(a)

2007/9/15 AIAI '07 (Aix-en-Provence, France) 10

Inductive Leaps and Conservativeness

For a clausal theory S , a predicate p , a test set of induction leap TS (S, p) is

TS (S, p ) = {A | S A , A is a ground atomwhose predicate is p }

For clausal theories B , E , and H , H realizes an induction leap if there is p in B ∧E

s.t. TS (B ∧ H, p ) - TS (B ∧ E, p ) ≠Φ

Otherwise, H is said to be conservative.

2007/9/15 AIAI '07 (Aix-en-Provence, France) 11

ConsistencyIf B is consistent and H is conservative, then B ∧H is consistent.

CompletenessIf H is a correct solution to 〈 B, E, P, Z 〉 ,

then H explain all observations E : B∧H E

Advantage of Circumscriptive Induction 1

2007/9/15 AIAI '07 (Aix-en-Provence, France) 13

Advantage of Circumscriptive Induction 2

Conservativeness

If B ∧E is solitary in Z , then H is conservative.

Corollary: If Z appears only in heads of B ∧E and H is a correct solution to 〈 B, E, P, Z 〉 , then H is complete and conservative.

2007/9/15 AIAI '07 (Aix-en-Provence, France) 14

Our Goals

Reconsideration of circumscriptive induction: to generalize the concept of induction leap, and to strengthen the conservativeness.

Study pointwise circumscription, a first-order approximation of circumscription, as Yet Another Induction Framework

2007/9/15 AIAI '07 (Aix-en-Provence, France) 15

General Inductive LeapFor a clausal theory S , a predicate set P , a general test set of induction leap GTS (S, P ) is

GTS (S, P ) = {A | S A , A is a formula involving no positive atom whose predicate

is in P }.

GTS allows a formula to be disjunctive.

Example: P1(s) ∨P1(t) , P1(s) ∨P2(s)  …

2007/9/15 AIAI '07 (Aix-en-Provence, France) 16

Strong Conservativeness

For clausal theories B , E , and H , a predicate set P ,

H realizes an general inductive leap if GTS (B ∧ H, P ) - GTS (B ∧ E, P ) ≠Φ.

Otherwise, H is strongly conservative.

2007/9/15 AIAI '07 (Aix-en-Provence, France) 17

If Circ[B∧E ; P ; Z ] |= H , then H is strongly conservative , i.e.,     GTS (B ∧ H, P ) ⊂ GTS (B ∧ E, P ).

Sufficient Condition for Strong Conservativeness

Strong Conservativeness of Correct Answers

If H is a correct solution to 〈 B, E, P, Z 〉 ,then H is strongly conservative and complete

2007/9/15 AIAI '07 (Aix-en-Provence, France) 18

Problems of Circumscriptive Induction It is unclear what kinds of

formulas can be correct answers?

Second-order formulation makes it difficult to effectively compute.

Pointwise circumscription could be a solution for the above problems, because it is a first-order approximation of circumscription.

2007/9/15 AIAI '07 (Aix-en-Provence, France) 19

Pointwise Circumscription  [Lifschitz 85]

PWC[A ;P ]≡def

A (P ) ∧ ∀ x (P(X )⊃ ¬ A [P/λu (P(u)∧u≠x )])

– where [P /λu (P (u)∧u≠x )] denotes the substitution of all occurrences of P by λu (P (u )∧u ≠x ).

2007/9/15 AIAI '07 (Aix-en-Provence, France) 20

PWC[A ;P ] semantically states that it is impossible to obtain a model of A by eliminating exactly one element from the extension of P .

PWC[A ;P ] is a first-order approximation of CIRC[A;P ], i.e., CIRC[A;P ] PWC[A ;P ].

PWC[A ;P ] is an extension of predicate completion for disjunctive formula A.

Pointwise circumscription PWC[A ;P ]: A (P ) ∧

  ∀ x (P (X ) ⊃ ¬ A [P/λu (P(u)∧u≠x )] )

2007/9/15 AIAI '07 (Aix-en-Provence, France) 21

Pointwise Circumscription for Circumscriptive Induction

1. Pointwise circumscription is a new computation method i.e., a first-oder approximation method which just uses first-order concepts/tools.

2. Pointwise circumscription often generates interesting correct answers for circumscriptive induction.

2007/9/15 AIAI '07 (Aix-en-Provence, France) 22

Pointwise Circumscriptive Induction ProblemGiven clausal theories B and E, disjoint predicates P , 〈 B, E, P 〉 is a pointwise induction problem

Pointwise Circumscriptive InductionH is a correct solution to the 〈 B, E, P 〉 if

PWC[B∧E ;P ;Z ] H B ∧H E

Pointwise Circumscriptive Induction

descriptive induction

explanatory induction

2007/9/15 AIAI '07 (Aix-en-Provence, France) 23

Strong Conservativeness

If H is a correct solution to 〈 B, E, P 〉 ,then H is strongly conservative and complete

Soundness of Pointwise Circumscriptive Induction for Circumscriptive Induction

If H is a correct solution to a poitwise circumscriptive induction 〈 B, E, P 〉 , then for any variable predicates Z, H is a correct answer for circumscriptive induction 〈 B, E, P , Z 〉 ,

2007/9/15 AIAI '07 (Aix-en-Provence, France) 24

Soundness of Pointwise Circumscriptive Induction

If H is a correct solution to a pointwise circumscriptive induction 〈 B, E, P 〉 , thenfor any variable predicates Z s.t. Z∩P=φ,

H is a correct answer for circumscriptive induction 〈 B, E, P , Z 〉 .

Pointwise circumscription can be used as an approximation computation framework for circumscriptive induction.

2007/9/15 AIAI '07 (Aix-en-Provence, France) 25

How to derive a correct answer from pointwise circumscription?

Minimal extension formulas and the ordinary resolution can often interesting correct answers.

2007/9/15 AIAI '07 (Aix-en-Provence, France) 26

PWC[A ;P ]≡A (P ) ∧  ∀ x (P (x) ⊃ ¬ A [P/λu (P(u)∧u≠x )] )

We call the above subformula

¬ A [P/λu (P (u)∧u ≠x )] pointwise formula, denoted as Pwf[A ;P ;x ]

Pointwise Formula

Example

Suppose B ; Bird(a) ∨Bird(b) and E ; Flies(a)∧ Flies(c)

Pwf[B ; Bird ; x] = (Bird (a) ⊃x =a)∧(Bird (b) ⊃ x =b )

Pwf[E; Flies ; x] = (x=a ) ∨ (x=c)

2007/9/15 AIAI '07 (Aix-en-Provence, France) 27

Minimal Extension Formula as Revised Pwf[A ;P ;X]

The minimal extension formula Min[A ;P ;X ] is ¬ B where B is obtained from A by replacing every positive occurrence of P in A as follows;

1. If P (t ) occurs in a definite clause, then P (t ) is replaced by t ≠x

2. Otherwise P (t ) is replaced by P (t )∧t ≠x

Example

Suppose B ; Bird(a) ∨Bird(b) and E ; Flies(a)∧ Flies(c)

Min[B ; Bird ; x] = (Bird (a) ⊃x =a)∧(Bird (b) ⊃ x =b )

Min[E; Flies ; x] = (x=a ) ∨ (x=c)

2007/9/15 AIAI '07 (Aix-en-Provence, France) 28

Some Properties [Iwanuma et al. 90]

For any first-order formula A and any predicate P

PWC[A ;P ] ∀x (P (X ) ≡ Pwf[A; P ;X ] ) PWC[A ;P ] ∀x (P (X ) ≡ Min[A ;P ;X ] )

For any first-order formula A and any predicate P

A ∀x (Min[A ;P ;X ] ⊃P (X ))

  ∀ x (Pwf[A; P ;X ] ⊃ Min[A ;P ;X ] )

2007/9/15 AIAI '07 (Aix-en-Provence, France) 29

Entailment Power of Min [A ;P ;X] and PWC[B∧E;P]

CIRC[B∧E ;P ;Z ] ∀x (P (X )≡ Min[B∧E ;P ;X ])

is always guaranteed. However, whether

B ∧ ∀x (P (X ) ≡ Min [B∧E ;P ;X ]) E

or not depends on individual pairs of B and E.

Min[A ;P ;X] and PWC[B∧E;P] often generates interesting correct answers for circumscriptive induction.

2007/9/15 AIAI '07 (Aix-en-Provence, France) 30

Example1: Definite Case

Bird (x) ≡ Min[B∧E ; Bird ; x]; 1.   x = a ⊃ Bird (x) 2. x = b ⊃ Bird (x)3.   Bird (x) ⊃ x =a ∨ x =b

Flies (x) ≡ Min[B∧E; Flies ; x];4.   x=a ⊃ Flies (x)5.   Flies (x) ⊃ x=a

We can obtain H just by resolution to the clauses (3) and (4), H  :  Bird (x) ∧(x ≠b ) ⊃ Flies (x)

Background knowledge: B = Bird(a) ∧ Bird(b)

Observations: E = Flies(a)

2007/9/15 AIAI '07 (Aix-en-Provence, France) 31

Example 2: Disjunctive Case

Bird (x) ≡ Min[B∧E ; Bird ; x]; 1.   (Bird (a) ⊃x =a)∧(Bird (b) ⊃ x =b ) ⊃ Bird (x) 2. Bird (x) ∧Bird (a) ⊃ x =a 3. Bird (x) ∧Bird (b) ⊃ x =b

Flies (x) ≡ Min[B∧E ; Flies ; x];4.   x=a ⊃ Flies (x)5.   x=c ⊃ Flies (x)6.   Flies (x) ⊃ [x=a ∨x=c ]

By resolving the clauses (2) and (4), we can obtain H:   H: Bird (x) ∧Bird (a) ⊃ Flies (x)  

Background knowledge: B = Bird(a) ∨ Bird(b)Observations: E = Flies(a)∧ Flies(c)

Conditional hypothesis fortreating the disjunctive situtaion

2007/9/15 AIAI '07 (Aix-en-Provence, France) 32

Conclusion and Future Work Conclusion

Reconsideration to circumscriptive induction: General induction leap and strong conservativeness

Propose pointwise circumscription, as a new method for induction tools

Future work Study Extended Pointwise Circumscription, which is a m

ore accurate first-order approximation of circumscription, where minimal models are considered with k-elements difference relation.

Notice that pointwise circumscription just consider one-element difference relation between its models.

2007/9/15 AIAI '07 (Aix-en-Provence, France) 33

Thank you for your attention !!