cse 473: ar+ficial intelligence - university of washington · 2018-03-04 · cse 473: ar+ficial...
TRANSCRIPT
![Page 1: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/1.jpg)
CSE473:Ar+ficialIntelligenceConstraintSa+sfac+onProblems
Instructor:LukeZe@lemoyer
UniversityofWashington[TheseslideswerecreatedbyDanKleinandPieterAbbeelforCS188IntrotoAIatUCBerkeley.AllCS188materialsareavailableath@p://ai.berkeley.edu.]
![Page 2: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/2.jpg)
WhatisSearchFor?§ Assump+onsabouttheworld:asingleagent,determinis+cac+ons,fullyobserved
state,discretestatespace
§ Planning:sequencesofac+ons§ Thepathtothegoalistheimportantthing§ Pathshavevariouscosts,depths§ Heuris+csgiveproblem-specificguidance
§ Iden+fica+on:assignmentstovariables§ Thegoalitselfisimportant,notthepath§ Allpathsatthesamedepth(forsomeformula+ons)§ CSPsarespecializedforiden+fica+onproblems
![Page 3: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/3.jpg)
ConstraintSa+sfac+onProblems
![Page 4: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/4.jpg)
ConstraintSa+sfac+onProblems
§ Standardsearchproblems:§ Stateisa“blackbox”:arbitrarydatastructure§ Goaltestcanbeanyfunc+onoverstates§ Successorfunc+oncanalsobeanything
§ Constraintsa+sfac+onproblems(CSPs):§ Aspecialsubsetofsearchproblems§ StateisdefinedbyvariablesXiwithvaluesfroma
domainD (some+mesDdependsoni)§ Goaltestisasetofconstraintsspecifyingallowable
combina+onsofvaluesforsubsetsofvariables
§ Simpleexampleofaformalrepresenta-onlanguage
§ Allowsusefulgeneral-purposealgorithmswithmorepowerthanstandardsearchalgorithms
![Page 5: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/5.jpg)
CSPExamples
![Page 6: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/6.jpg)
Example:MapColoring
§ Variables:
§ Domains:
§ Constraints:adjacentregionsmusthavedifferentcolors
§ Solu+onsareassignmentssa+sfyingallconstraints,e.g.:
Implicit:
Explicit:
![Page 7: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/7.jpg)
Example:N-Queens
§ Formula+on1:§ Variables:§ Domains:§ Constraints
![Page 8: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/8.jpg)
Example:N-Queens
§ Formula+on2:§ Variables:
§ Domains:
§ Constraints:Implicit:
Explicit:
![Page 9: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/9.jpg)
ConstraintGraphs
![Page 10: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/10.jpg)
ConstraintGraphs
§ BinaryCSP:eachconstraintrelates(atmost)twovariables
§ Binaryconstraintgraph:nodesarevariables,arcsshowconstraints
§ General-purposeCSPalgorithmsusethegraphstructuretospeedupsearch.E.g.,Tasmaniaisanindependentsubproblem!
[Demo:CSPapplet(madeavailablebyaispace.org)--n-queens]
![Page 11: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/11.jpg)
ScreenshotofDemoN-Queens
![Page 12: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/12.jpg)
Example:Cryptarithme+c
§ Variables:
§ Domains:
§ Constraints:
![Page 13: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/13.jpg)
Example:Sudoku
§ Variables:§ Each(open)square
§ Domains:§ {1,2,…,9}
§ Constraints:
9-wayalldiffforeachrow
9-wayalldiffforeachcolumn
9-wayalldiffforeachregion
(orcanhaveabunchofpairwiseinequalityconstraints)
![Page 14: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/14.jpg)
Example:TheWaltzAlgorithm
§ TheWaltzalgorithmisforinterpre+nglinedrawingsofsolidpolyhedraas3Dobjects
§ AnearlyexampleofanAIcomputa+onposedasaCSP
? § Approach:
§ Eachintersec+onisavariable§ Adjacentintersec+onsimposeconstraints
oneachother§ Solu+onsarephysicallyrealizable3D
interpreta+ons
![Page 15: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/15.jpg)
Example:TheWaltzAlgorithm
§ TheWaltzalgorithmisforinterpre+nglinedrawingsofsolidpolyhedraas3Dobjects
§ AnearlyexampleofanAIcomputa+onposedasaCSP
§ Approach:§ Eachintersec+onisavariable§ Adjacentintersec+onsimposeconstraints
oneachother§ Solu+onsarephysicallyrealizable3D
interpreta+ons
?
![Page 16: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/16.jpg)
Varie+esofCSPsandConstraints
![Page 17: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/17.jpg)
Varie+esofCSPs
§ DiscreteVariables§ Finitedomains
§ SizedmeansO(dn)completeassignments§ E.g.,BooleanCSPs,includingBooleansa+sfiability(NP-complete)
§ Infinitedomains(integers,strings,etc.)§ E.g.,jobscheduling,variablesarestart/end+mesforeachjob§ Linearconstraintssolvable,nonlinearundecidable
§ Con+nuousvariables§ E.g.,start/end+mesforHubbleTelescopeobserva+ons§ Linearconstraintssolvableinpolynomial+mebyLPmethods
(seecs170forabitofthistheory)
![Page 18: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/18.jpg)
Varie+esofConstraints
§ Varie+esofConstraints§ Unaryconstraintsinvolveasinglevariable(equivalentto
reducingdomains),e.g.:
§ Binaryconstraintsinvolvepairsofvariables,e.g.:
§ Higher-orderconstraintsinvolve3ormorevariables:e.g.,cryptarithme+ccolumnconstraints
§ Preferences(somconstraints):§ E.g.,redisbe@erthangreen§ Omenrepresentablebyacostforeachvariableassignment§ Givesconstrainedop+miza+onproblems§ (We’llignoretheseun+lwegettoBayes’nets)
![Page 19: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/19.jpg)
Real-WorldCSPs
§ Assignmentproblems:e.g.,whoteacheswhatclass§ Timetablingproblems:e.g.,whichclassisofferedwhenandwhere?§ Hardwareconfigura+on§ Transporta+onscheduling§ Factoryscheduling§ Circuitlayout§ Faultdiagnosis§ …lotsmore!
§ Manyreal-worldproblemsinvolvereal-valuedvariables…
![Page 20: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/20.jpg)
SolvingCSPs
![Page 21: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/21.jpg)
StandardSearchFormula+on
§ Standardsearchformula+onofCSPs
§ Statesdefinedbythevaluesassignedsofar(par+alassignments)§ Ini+alstate:theemptyassignment,{}§ Successorfunc+on:assignavaluetoanunassignedvariable
§ Goaltest:thecurrentassignmentiscompleteandsa+sfiesallconstraints
§ We’llstartwiththestraighqorward,naïveapproach,thenimproveit
![Page 22: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/22.jpg)
SearchMethods
§ WhatwouldBFSdo?
§ WhatwouldDFSdo?
§ Whatproblemsdoesnaïvesearchhave?
[Demo:coloring--dfs]
![Page 23: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/23.jpg)
VideoofDemo
Coloring--DFS
![Page 24: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/24.jpg)
BacktrackingSearch
![Page 25: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/25.jpg)
BacktrackingSearch
§ BacktrackingsearchisthebasicuninformedalgorithmforsolvingCSPs
§ Idea1:Onevariableata+me§ Variableassignmentsarecommuta+ve,sofixordering§ I.e.,[WA=redthenNT=green]sameas[NT=greenthenWA=red]§ Onlyneedtoconsiderassignmentstoasinglevariableateachstep
§ Idea2:Checkconstraintsasyougo§ I.e.consideronlyvalueswhichdonotconflictpreviousassignments§ Mighthavetodosomecomputa+ontochecktheconstraints§ “Incrementalgoaltest”
§ Depth-firstsearchwiththesetwoimprovementsiscalledbacktrackingsearch(notthebestname)
§ Cansolven-queensforn≈25
![Page 26: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/26.jpg)
BacktrackingExample
![Page 27: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/27.jpg)
BacktrackingSearch
§ Backtracking=DFS+variable-ordering+fail-on-viola+on§ Whatarethechoicepoints?
[Demo:coloring--backtracking]
![Page 28: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/28.jpg)
VideoofDemo
Coloring–Backtracking
![Page 29: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/29.jpg)
VideoofDemo
Coloring–Backtracking
![Page 30: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/30.jpg)
ImprovingBacktracking
§ General-purposeideasgivehugegainsinspeed§ …butit’salls+llNP-hard
§ Filtering:Canwedetectinevitablefailureearly?
§ Ordering:§ Whichvariableshouldbeassignednext?(MRV)§ Inwhatordershoulditsvaluesbetried?(LCV)
§ Structure:Canweexploittheproblemstructure?
![Page 31: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/31.jpg)
ArcConsistencyandBeyond
![Page 32: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/32.jpg)
ForwardChecking
§ Idea:Keeptrackofremaininglegalvaluesforunassignedvariables(usingimmediateconstraints)
§ Idea:Terminatewhenanyvariablehasnolegalvalues
WA SA NT Q
NSW V
![Page 33: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/33.jpg)
ForwardChecking
![Page 34: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/34.jpg)
AreWeDone?
![Page 35: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/35.jpg)
ConstraintPropaga+on
§ Forwardcheckingpropagatesinforma+onfromassignedtoadjacentunassignedvariables,butdoesn'tdetectmoredistantfailures:
WA SA NT Q
NSW V
§ NT and SA cannot both be blue! § Why didn’t we detect this yet? § Constraint propagation repeatedly enforces constraints (locally)
![Page 36: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/36.jpg)
ArcConsistencyofanEn+reCSP§ Asimpleformofpropaga+onmakessureallarcsaresimultaneouslyconsistent:
§ Arcconsistencydetectsfailureearlierthanforwardchecking§ Important:IfXlosesavalue,neighborsofXneedtoberechecked!§ Mustrerunamereachassignment!
Remember:Deletefromthetail!
WA SA
NT Q
NSW
V
![Page 37: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/37.jpg)
ConstraintPropaga+on
![Page 38: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/38.jpg)
AreWeDone?
![Page 39: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/39.jpg)
Limita+onsofArcConsistency
§ Amerenforcingarcconsistency:§ Canhaveonesolu+onlem§ Canhavemul+plesolu+onslem§ Canhavenosolu+onslem(andnotknowit)
§ Arcconsistencys+llrunsinsideabacktrackingsearch!
Whatwentwronghere?
![Page 40: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/40.jpg)
Ordering:MinimumRemainingValues
§ Minimumremainingvalues(MRV):§ Choosethevariablewiththefewestlegalvalues
§ Whyminratherthanmax?§ Alsocalled“mostconstrainedvariable”§ “Fail-fast”ordering
![Page 41: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/41.jpg)
Ordering:DegreeHeuris+c
§ Tie-breakeramongMRVvariables§ Degreeheuris+c:
§ Choosethevariablepar+cipa+nginthemostconstraintsonremainingvariables
§ Whymostratherthanfewestconstraints?
![Page 42: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/42.jpg)
Ordering:LeastConstrainingValue
§ Givenachoiceofvariable:§ Choosetheleastconstrainingvalue§ Theonethatrulesoutthefewestvaluesinthe
remainingvariables§ Notethatitmaytakesomecomputa+onto
determinethis!
§ Whyleastratherthanmost?
§ Combiningtheseheuris+csmakes1000queensfeasible
![Page 43: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/43.jpg)
Propaga+onwithOrdering
![Page 44: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/44.jpg)
K-Consistency
![Page 45: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/45.jpg)
K-Consistency§ Increasingdegreesofconsistency
§ 1-Consistency(NodeConsistency):Eachsinglenode’sdomainhasavaluewhichmeetsthatnode’sunaryconstraints
§ 2-Consistency(ArcConsistency):Foreachpairofnodes,anyconsistentassignmenttoonecanbeextendedtotheother
§ K-Consistency:Foreachknodes,anyconsistentassignmenttok-1canbeextendedtothekthnode.
§ Higherkmoreexpensivetocompute
§ (Youneedtoknowthek=2case:arcconsistency)
![Page 46: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/46.jpg)
StrongK-Consistency
§ Strongk-consistency:alsok-1,k-2,…1consistent
§ Claim:strongn-consistencymeanswecansolvewithoutbacktracking!
§ Why?§ Chooseanyassignmenttoanyvariable§ Chooseanewvariable§ By2-consistency,thereisachoiceconsistentwiththefirst§ Chooseanewvariable§ By3-consistency,thereisachoiceconsistentwiththefirst2§ …
§ Lotsofmiddlegroundbetweenarcconsistencyandn-consistency!(e.g.k=3,calledpathconsistency)
![Page 47: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/47.jpg)
Structure
![Page 48: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/48.jpg)
ProblemStructure
§ Extremecase:independentsubproblems§ Example:Tasmaniaandmainlanddonotinteract
§ Independentsubproblemsareiden+fiableasconnectedcomponentsofconstraintgraph
§ Supposeagraphofnvariablescanbebrokenintosubproblemsofonlycvariables:§ Worst-casesolu+oncostisO((n/c)(dc)),linearinn§ E.g.,n=80,d=2,c=20§ 280=4billionyearsat10millionnodes/sec§ (4)(220)=0.4secondsat10millionnodes/sec
![Page 49: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/49.jpg)
Tree-StructuredCSPs
§ Theorem:iftheconstraintgraphhasnoloops,theCSPcanbesolvedinO(nd2)+me§ ComparetogeneralCSPs,whereworst-case+meisO(dn)
§ Thispropertyalsoappliestoprobabilis+creasoning(earlier):anexampleoftherela+onbetweensyntac+crestric+onsandthecomplexityofreasoning
![Page 50: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/50.jpg)
Tree-StructuredCSPs§ Algorithmfortree-structuredCSPs:
§ Order:Choosearootvariable,ordervariablessothatparentsprecedechildren
§ Removebackward:Fori=n:2,applyRemoveInconsistent(Parent(Xi),Xi)§ Assignforward:Fori=1:n,assignXiconsistentlywithParent(Xi)
§ Run+me:O(nd2)(why?)
![Page 51: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/51.jpg)
Tree-StructuredCSPs
§ Claim1:Amerbackwardpass,allroot-to-leafarcsareconsistent§ Proof:EachX→YwasmadeconsistentatonepointandY’sdomaincouldnothave
beenreducedthereamer(becauseY’schildrenwereprocessedbeforeY)
§ Claim2:Ifroot-to-leafarcsareconsistent,forwardassignmentwillnotbacktrack§ Proof:Induc+ononposi+on
§ Whydoesn’tthisalgorithmworkwithcyclesintheconstraintgraph?
§ Note:samebasicideaasvariableelimina+oninBayes’nets
![Page 52: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/52.jpg)
ImprovingStructure
![Page 53: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/53.jpg)
NearlyTree-StructuredCSPs
![Page 54: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/54.jpg)
NearlyTree-StructuredCSPs
§ Condi+oning:instan+ateavariable,pruneitsneighbors'domains
§ Cutsetcondi+oning:instan+ate(inallways)asetofvariablessuchthattheremainingconstraintgraphisatree
§ Cutsetsizecgivesrun+meO((dc)(n-c)d2),veryfastforsmallc
![Page 55: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/55.jpg)
CutsetCondi+oning
SA
SA SA SA
Instan+atethecutset(allpossibleways)
ComputeresidualCSPforeachassignment
SolvetheresidualCSPs(treestructured)
Chooseacutset
![Page 56: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/56.jpg)
CutsetQuiz
§ Findthesmallestcutsetforthegraphbelow.
![Page 57: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/57.jpg)
TreeDecomposi+on*§ Idea:createatree-structuredgraphofmega-variables§ Eachmega-variableencodespartoftheoriginalCSP§ Subproblemsoverlaptoensureconsistentsolu+ons
M1 M2 M3 M4
{(WA=r,SA=g,NT=b), (WA=b,SA=r,NT=g), …}
{(NT=r,SA=g,Q=b), (NT=b,SA=g,Q=r), …}
Agree: (M1,M2) ∈ {((WA=g,SA=g,NT=g), (NT=g,SA=g,Q=g)), …}
Agree on shared vars
NT
SA
≠ WA
≠ ≠
Q
SA
≠ NT
≠ ≠
Agree on shared vars
NSW
SA
≠ Q
≠ ≠
Agree on shared vars
V
SA
≠ NSW
≠ ≠
![Page 58: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/58.jpg)
Itera+veImprovement
![Page 59: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/59.jpg)
Itera+veAlgorithmsforCSPs
§ Localsearchmethodstypicallyworkwith“complete”states,i.e.,allvariablesassigned
§ ToapplytoCSPs:§ Takeanassignmentwithunsa+sfiedconstraints§ Operatorsreassignvariablevalues§ Nofringe!Liveontheedge.
§ Algorithm:Whilenotsolved,§ Variableselec+on:randomlyselectanyconflictedvariable§ Valueselec+on:min-conflictsheuris+c:
§ Chooseavaluethatviolatesthefewestconstraints§ I.e.,hillclimbwithh(n)=totalnumberofviolatedconstraints
![Page 60: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/60.jpg)
Example:4-Queens
§ States:4queensin4columns(44=256states)§ Operators:movequeenincolumn§ Goaltest:noa@acks§ Evalua+on:c(n)=numberofa@acks
[Demo:n-queens–itera+veimprovement(L5D1)][Demo:coloring–itera+veimprovement]
![Page 61: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/61.jpg)
VideoofDemoItera+veImprovement–nQueens
![Page 62: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/62.jpg)
VideoofDemoItera+veImprovement–Coloring
![Page 63: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/63.jpg)
PerformanceofMin-Conflicts
§ Givenrandomini+alstate,cansolven-queensinalmostconstant+meforarbitrarynwithhighprobability(e.g.,n=10,000,000)!
§ Thesameappearstobetrueforanyrandomly-generatedCSPexceptinanarrowrangeofthera+o
![Page 64: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/64.jpg)
Summary:CSPs
§ CSPsareaspecialkindofsearchproblem:§ Statesarepar+alassignments§ Goaltestdefinedbyconstraints
§ Basicsolu+on:backtrackingsearch
§ Speed-ups:§ Ordering§ Filtering§ Structure
§ Itera+vemin-conflictsisomeneffec+veinprac+ce
![Page 65: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/65.jpg)
LocalSearch
![Page 66: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/66.jpg)
LocalSearch
§ Treesearchkeepsunexploredalterna+vesonthefringe(ensurescompleteness)
§ Localsearch:improveasingleop+onun+lyoucan’tmakeitbe@er(nofringe!)
§ Newsuccessorfunc+on:localchanges
§ Generallymuchfasterandmorememoryefficient(butincompleteandsubop+mal)
![Page 67: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/67.jpg)
HillClimbing
§ Simple,generalidea:§ Startwherever§ Repeat:movetothebestneighboringstate§ Ifnoneighborsbe@erthancurrent,quit
§ What’sbadaboutthisapproach?§ Complete?§ Op+mal?
§ What’sgoodaboutit?
![Page 68: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/68.jpg)
HillClimbingDiagram
![Page 69: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/69.jpg)
HillClimbingQuiz
Star+ngfromX,wheredoyouendup?
Star+ngfromY,wheredoyouendup?Star+ngfromZ,wheredoyouendup?
![Page 70: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/70.jpg)
SimulatedAnnealing§ Idea:Escapelocalmaximabyallowingdownhillmoves
§ Butmakethemrareras+megoeson
70
![Page 71: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/71.jpg)
SimulatedAnnealing
§ Theore+calguarantee:§ Sta+onarydistribu+on:§ IfTdecreasedslowlyenough,willconvergetoop+malstate!
§ Isthisaninteres+ngguarantee?
§ Soundslikemagic,butrealityisreality:§ Themoredownhillstepsyouneedtoescapealocalop+mum,thelesslikelyyouaretoevermakethemallinarow
§ Peoplethinkhardaboutridgeoperatorswhichletyoujumparoundthespaceinbe@erways
![Page 72: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/72.jpg)
Gene+cAlgorithms
§ Gene+calgorithmsuseanaturalselec+onmetaphor§ KeepbestNhypothesesateachstep(selec+on)basedonafitnessfunc+on§ Alsohavepairwisecrossoveroperators,withop+onalmuta+ontogivevariety
§ Possiblythemostmisunderstood,misapplied(andevenmaligned)techniquearound
![Page 73: CSE 473: Ar+ficial Intelligence - University of Washington · 2018-03-04 · CSE 473: Ar+ficial Intelligence Constraint Sasfac+on Problems Instructor: Luke Ze@lemoyer University](https://reader033.vdocuments.us/reader033/viewer/2022050507/5f9883f3e54572777d630420/html5/thumbnails/73.jpg)
Example:N-Queens
§ Whydoescrossovermakesensehere?§ Whenwouldn’titmakesense?§ Whatwouldmuta+onbe?§ Whatwouldagoodfitnessfunc+onbe?