lecture 00: introduction · 2018. 9. 6. · cs480/680: intro to ml lecture 00: introduction 1...
TRANSCRIPT
![Page 1: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/1.jpg)
CS480/680: Intro to MLLecture 00: Introduction
9/6/2018 Yao-Liang Yu1
![Page 2: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/2.jpg)
Outl ine
• Course Logistics
• Course Overview
9/6/2018 Yao-Liang Yu2
![Page 3: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/3.jpg)
Outl ine
• Course Logistics
• Course Overview
9/6/2018 Yao-Liang Yu3
![Page 4: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/4.jpg)
Course Info
• Instructor: Yao-Liang Yu ([email protected])• Office hours: DC 3617, TTh 11:30 – 12:30
• TAs: Hamidreza Shahidi (h24shahi), Jingjing Wang (jj27wang),
KaiWen Wu (k77wu), Lian Xin (x9lian)
• Website: cs.uwaterloo.ca/~y328yu/mycourses/480• Syllabus, slides, notes, policy, etc.
• Piazza: piazza.com/uwaterloo.ca/fall2018/cs480cs680/• Announcements, questions, discussions, etc.
• Learn: https://learn.uwaterloo.ca• Assignments, solutions, grades, etc.
9/6/2018 Yao-Liang Yu4
![Page 5: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/5.jpg)
Prerequisi tes
• CS341, CS370/371
• Basic probability, statistics, algorithms, linear algebra, calculus
9/6/2018 Yao-Liang Yu5
• Mathematical maturity
• Programming
![Page 6: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/6.jpg)
What to expect
9/6/2018 Yao-Liang Yu6
![Page 7: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/7.jpg)
Textbook
• No required textbook
• Lecture notes or slides will be posted on course web
• Some fine textbooks:
9/6/2018 Yao-Liang Yu7
![Page 8: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/8.jpg)
Assignments
• 4 assignments with the following tentative plan:
• Submit on LEARN. Submit early and often.• Typeset using LaTeX is recommended
9/6/2018 Yao-Liang Yu8
Out date Due date CS480 CS680
A1 Sep. 11 Sep. 27 10% 10%
A2 Sep. 27 Oct. 16 10% 10%
A3 Oct. 16 Nov. 8 10% 10%
A4 Nov. 8 Nov. 27 10% 10%
Proposal Oct. 23 5% 10%
Report Dec. 3 15% 30%
![Page 9: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/9.jpg)
Exam
• Midterm: 20%, Oct 18, in class
• Final exam: 40%, date TBA• Open book
• No electronics
9/6/2018 Yao-Liang Yu9
![Page 10: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/10.jpg)
Policy
• Do your own work independently and individually• Discussion is fine, but no sharing of text or code
• Explicitly acknowledge any source that helped you
• Ignorance is no excuse!• Good online discussion, more on course website
• Serious offence will result in expulsion…
• NO late submissions!• Except hospitalization, family urgency, …
• Appeal within two weeks, otherwise final
9/6/2018 Yao-Liang Yu10
![Page 11: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/11.jpg)
Project
• Optional: 480/680 can trade for midterm/final, resp.
• You project should• Relate to machine learning (obviously)
• Allow you to learn something new (and hopefully significant)
• Be interesting and nontrivial (publishable)
• 2-page proposal and <= 8 pages report
9/6/2018 Yao-Liang Yu11
![Page 12: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/12.jpg)
Grades
9/6/2018 Yao-Liang Yu12
![Page 13: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/13.jpg)
Enrol lment
• If you already enrolled• Good for you!
• Please take a look at the quiz and decide if you are comfortable with the background
• If you are not enrolled yet• Please complete the quiz and hand in on next Tuesday
• Permission numbers will be based on that
cs.uwaterloo.ca/~y328yu/mycourses/480/quiz.pdf
9/6/2018 Yao-Liang Yu13
![Page 14: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/14.jpg)
Questions?
9/6/2018 Yao-Liang Yu14
![Page 15: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/15.jpg)
Outl ine
• Course Logistics
• Course Overview
9/6/2018 Yao-Liang Yu15
![Page 16: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/16.jpg)
What is Machine Learning (ML)?
• “Machine learning is the field of study that gives computers the ability to learn without being explicitly programmed.” --- Arthur Samuel (1959).
9/6/2018 Yao-Liang Yu16
• “A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P, if its performance at tasks in T, as measured by P, improves with experience E.” --- Tom Mitchell (1998)
![Page 17: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/17.jpg)
Why is ML important for YOU?
• First off, you use ML everyday
9/6/2018 Yao-Liang Yu17
• Lots of cool applications
• Excellent for job-hunting
![Page 18: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/18.jpg)
Learning Categories
9/6/2018 Yao-Liang Yu18
Supervised
• Classification
• Regression
• Ranking
Reinforcement
• Control
• Pricing
• Gaming
Unsupervised
• Clustering
• Visualization
• Representation
Teacher provides answer Teacher provides motivation Surprise, surprise
![Page 19: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/19.jpg)
How do humans learn?
9/6/2018 Yao-Liang Yu19
![Page 20: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/20.jpg)
Supervised learning
9/6/2018 Yao-Liang Yu20
![Page 21: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/21.jpg)
Formally
• Given a training set of pairs of examples (xi, yi)
• Return a function f: X Y
• On an unseen test example x, output f(x)
• The goal is to do well on unseen test data• Usually do not care about performance on training data
9/6/2018 Yao-Liang Yu21
![Page 22: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/22.jpg)
Reinforcement learning
• Not in this course…
9/6/2018 Yao-Liang Yu22
• CS486/686
Silver et al., Nature’16Abbeel et al., NIPS’06
![Page 23: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/23.jpg)
Unsupervised learning
• Let the data speak for itself!
9/6/2018 Yao-Liang Yu23
Le et al., ICML’12
![Page 24: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/24.jpg)
Focus of ML research
• Representation and Interpretation• How to represent the data? How to interpret result?
• Generalization• How well can we do on test data? On a different domain?
• Complexity• How much time and space?
• Efficiency• How many samples?
• Applications
9/6/2018 Yao-Liang Yu24
![Page 25: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/25.jpg)
Course Overview
9/6/2018 Yao-Liang Yu25
![Page 26: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/26.jpg)
Gimme, Gimme more
• Science special issue on AI
• Nature special issue on AI
• As always, google and wikipedia are your friends.
9/6/2018 Yao-Liang Yu26
![Page 27: Lecture 00: Introduction · 2018. 9. 6. · CS480/680: Intro to ML Lecture 00: Introduction 1 9/6/2018 Yao-Liang Yu. Outline](https://reader033.vdocuments.us/reader033/viewer/2022060923/60af1453ac8ea05d3a29d172/html5/thumbnails/27.jpg)
Questions?
9/6/2018 Yao-Liang Yu27