artificial intelligence - brown university · 2019. 9. 5. · required text artificial...

66
Artificial Intelligence George Konidaris [email protected] Fall 2019

Upload: others

Post on 04-Nov-2020

22 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Artificial Intelligence

George [email protected]

Fall 2019

Page 2: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

1410 TeamInstructor: George Konidaris Hours: Wed 4-5pm, CIT 447

HTAs: Leon Lei and Aansh ShahTAs: Alex Liu Jesus ContrerasAriel Rotter-Aboyoun Kaiqi KiangBerkan Hiziroglu Katie SchollChris Zamarripa Maulik DangDaniel de Castro Megan GessnerDeniz Bayazit Nikhil PantElizabeth Zhao Roelle ThorpeFawn Tong Spencer GreeneHusam Salhab Troy Moo Penn

Page 3: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition
Page 4: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Major Topics Covered

Page 5: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

On LecturesThe textbook contains everything you need to know.

Lectures contain everything you need to know.

Lecture notes do not contain everything you need to know.

Suggested approach:• Come to lectures and pay attention.• Revise via textbook (immediately).• Clarify at office hours.

Page 6: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Required TextArtificial Intelligence, A Modern ApproachRussell & Norvig, 3rd Edition.

Page 7: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

LogisticsCourse webpage:http://cs.brown.edu/courses/cs141/

• Syllabus• Calendar - office hours!• Assignments etc.

Written assignments and grades etc. via Gradescope Comms (Q&A, announcements) via PiazzaMake sure to sign up!

Page 8: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Questions

Piazza: Quick question, or question many people may want to know the answer to.

UTA Hours: Assignment and coding questions, material covered in lectures.

GTA / Professor Hours: conceptual questions, or questions beyond the coursework.

Page 9: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

GradingExams:

• Midterm: 15%, in class.• Final: 15%, finals week. • Closed book.

Six assignments• 50% of grade.• Python programming + report• Generally 1-2 weeks long• First assignment already available.

Extended project: 20%.

Page 10: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Academic HonestyI expect all Brown students to conduct themselves with the highest integrity, according to the Brown Academic Code.

It is OK to:• Have high-level discussions.• Google for definitions and background.

It is NOT OK TO:• Hand in anyone else’s code, or work, in part or in whole.• Google for solutions.

ALWAYS HAND IN YOUR OWN WORK.

Page 11: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition
Page 12: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Academic HonestyConsequences of cheating:• Your case will be reported.• Possible consequences include zeros on the assignment,

suspension, failure to graduate, retraction of job offers.

If I catch you I will refer you to the Office of Student Conduct, and I will push for a hearing with the Standing Committee.

DO NOT CHEAT.

Page 13: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

AI

Page 14: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

AI: The Very Idea

For as long as people have made machines, they have wondered whether machines could be

made intelligent.

(pictures: Wikipedia)

Page 15: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition
Page 16: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

(pictures: Wikipedia)

Page 17: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition
Page 18: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Turing

Computing machinery and intelligence. Mind, October

1950.

“Can machines think?”

(picture: Wikipedia)

Page 19: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Dartmouth, 1956

Page 20: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Trends

1940 202019801960 20001990 201019701950

Hinton

Page 21: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Trends

1940 202019801960 20001990 201019701950

Hinton

Page 22: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Trends

1940 202019801960 20001990 201019701950

Connectionism I

Hinton

Page 23: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Trends

1940 202019801960 20001990 201019701950

Connectionism I

Hinton

Page 24: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Trends

1940 202019801960 20001990 201019701950

Connectionism I

GOFAI

Hinton

Page 25: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Trends

1940 202019801960 20001990 201019701950

Connectionism I

GOFAI

Hinton

Page 26: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Trends

1940 202019801960 20001990 201019701950

Connectionism I

GOFAI

Hinton

Page 27: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Trends

1940 202019801960 20001990 201019701950

Connectionism I

GOFAI

AI Winter

Hinton

Page 28: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Trends

1940 202019801960 20001990 201019701950

Connectionism I

GOFAI

AI Winter

Hinton

Page 29: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Trends

1940 202019801960 20001990 201019701950

Connectionism I

GOFAI

AI Winter

Connectionism II

Hinton

Page 30: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Trends

1940 202019801960 20001990 201019701950

Connectionism I

GOFAI

AI Winter

Connectionism II

Hinton

Page 31: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Trends

1940 202019801960 20001990 201019701950

Connectionism I

GOFAI

AI Winter

Connectionism II

Bayes

Hinton

Page 32: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Trends

1940 202019801960 20001990 201019701950

Connectionism I

GOFAI

AI Winter

Connectionism II

Bayes

Hinton

Page 33: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Trends

1940 202019801960 20001990 201019701950

Connectionism I

GOFAI

AI Winter

Connectionism II

Bayes

Hinton

Page 34: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Trends

1940 202019801960 20001990 201019701950

Connectionism I

GOFAI

AI Winter

Connectionism II

Bayes

Hinton

Page 35: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Trends

1940 202019801960 20001990 201019701950

Connectionism I

GOFAI

AI Winter

Connectionism II

Reinforcement Learning

Bayes

Hinton

Page 36: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Trends

1940 202019801960 20001990 201019701950

Connectionism I

GOFAI

AI Winter

Connectionism II

Reinforcement Learning

Bayes

Hinton

Page 37: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Trends

1940 202019801960 20001990 201019701950

Connectionism I

GOFAI

AI Winter

Connectionism II

Reinforcement Learning

Bayes

Hinton

Deep Learning(C III)

Page 38: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Modern AISubject of intense study:• Nearly every CS department has at least 1 AI researcher.• ~ 700 PhDs a year in the US• Thousands of research papers written every year.

• Heavily funded (NSF, DARPA, EU, etc.).• Pays itself back fast (e.g., DART).

• Most major companies have efforts in this direction• Google,• Amazon• Microsoft, etc.

Page 39: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Modern AI

(picture: Wikipedia)

Page 40: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

What is AI?

Page 41: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Fundamental AssumptionThe brain is a computer.

=

(picture: Wikipedia)

Page 42: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

What is AI?This turns out to be a hard question!

Two dimensions:• “Humanly” vs “Rationally”• “Thinking” vs. “Acting”.

thinking humanly

thinkingrationally

actinghumanly

actingrationally

Page 43: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

What is AI?

thinking humanly

thinkingrationally

actinghumanly

actingrationally

Page 44: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

What is AI?

thinking humanly

thinkingrationally

actinghumanly

actingrationally

cognitive science

Page 45: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

What is AI?

thinking humanly

thinkingrationally

actinghumanly

actingrationally

cognitive science

“emulation”

Page 46: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

What is AI?

thinking humanly

thinkingrationally

actinghumanly

actingrationally

cognitive science

“emulation”

laws ofthought

Page 47: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

What is AI?

thinking humanly

thinkingrationally

actinghumanly

actingrationally

cognitive science

“emulation”

laws ofthought

rationalagents

Page 48: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

What is a Rational Agent?sensors

actuators

Performance measure.

Page 49: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

What is a Rational Agent?sensors

actuators

agentprogram

Performance measure.

Page 50: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Rational Agents

A rational agent:• acts in its environment• according to what is has perceived• in order to maximize • its expected performance measure.

Page 51: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Rational Agents

A rational agent:• acts in its environment• according to what is has perceived• in order to maximize • its expected performance measure.

actuators

Page 52: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Rational Agents

A rational agent:• acts in its environment• according to what is has perceived• in order to maximize • its expected performance measure.

actuators sensors

Page 53: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Rational Agents

A rational agent:• acts in its environment• according to what is has perceived• in order to maximize • its expected performance measure.

actuators sensors

agent program

Page 54: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Rational Agents

A rational agent:• acts in its environment• according to what is has perceived• in order to maximize • its expected performance measure.

actuators sensors

agent program given

Page 55: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Example: Chess

Performance measure?

Environment?

Prior knowledge?

Sensing?

Actions?

(picture: Wikipedia)

Page 56: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

ChessThe chess environment is:

• Fully observable.• Deterministic.• Episodic.• Static.• Discrete.• “Known”.

(picture: Wikipedia)

Page 57: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Example: Mars Rover

Performance measure?

Environment?

Prior knowledge?

Sensing?

Actions?

(picture: Wikipedia)

Page 58: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Mars RoverThe Mars Rover environment is:

• Partially observable.• Stochastic.• Continuing.• Dynamic.• Continuous.• Partially known.

Page 59: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Are We Making Progress?Specific vs. General

Page 60: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Progress

[Mnih et al., 2015] video: Two Minute Papers

Page 61: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Progress

[Mnih et al., 2015] video: Two Minute Papers

Page 62: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Atari[Mnih et al., 2015]

Page 63: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

Structure of the Field

AI is fragmented:• Learning• Planning• Vision• Language• Robotics• Reasoning • Knowledge Representation• Search

Page 64: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

ProgressProgress in AI:

• Clear, precise models of a class of problems• Powerful, general-purpose tools

• A clear understanding of what each model and tool can and cannot do

Page 65: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

ProgressProgress in AI:

• Clear, precise models of a class of problems• Powerful, general-purpose tools

• A clear understanding of what each model and tool can and cannot do

• Occasionally: vividly illustrative applications.• Arduous and slow

Page 66: Artificial Intelligence - Brown University · 2019. 9. 5. · Required Text Artificial Intelligence, A Modern Approach Russell & Norvig, 3rd Edition

ProgressProgress in AI:

• Clear, precise models of a class of problems• Powerful, general-purpose tools

• A clear understanding of what each model and tool can and cannot do

• Occasionally: vividly illustrative applications.• Arduous and slow

• Huge opportunity