![Page 1: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/1.jpg)
Week 2
RA : Aysun KoçakInstructor : Dr. Aykut Erdem
Department of Computer EngineeringHacettepe University
![Page 2: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/2.jpg)
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Outline
k Nearest Neighbor(k-NN)
Linear Regression
Note for Assignment
![Page 3: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/3.jpg)
22
Week 2
Aysun Koçak
2k NearestNeighbor(k-NN)
Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
k-Nearest Neighbor(k-NN)
I Nonparametric algorithmI To classify a new point, find its K nearest neighbors from the
training data.
credit - Siddharth Deokar slides
![Page 4: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/4.jpg)
22
Week 2
Aysun Koçak
3k NearestNeighbor(k-NN)
Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Code
http://scikit-learn.org/stable/auto_examples/neighbors/plot_classification.html
![Page 5: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/5.jpg)
22
Week 2
Aysun Koçak
4k NearestNeighbor(k-NN)
Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
k-NN Results
![Page 6: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/6.jpg)
22
Week 2
Aysun Koçak
5k NearestNeighbor(k-NN)
Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Drawbacks
I Keep all data to classify a new inputI All neighbors have same importanceI Determining hyper-parameters
I What is the best distance to use?I What is the best value of k to use?
I Distance usually relates to all the attributes and assumes all ofthem have the same effects on distance(curse of dimensionality)
![Page 7: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/7.jpg)
22
Week 2
Aysun Koçak
6k NearestNeighbor(k-NN)
Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Determining Parameters
Credit - Fei-Fei Li & Andrej Karpathy slides
![Page 8: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/8.jpg)
22
Week 2
Aysun Koçak
7k NearestNeighbor(k-NN)
Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Determining Parameters
Accuracy = (# of correctly classified examples / # of examples) X 100Credit - Fei-Fei Li & Andrej Karpathy slides
![Page 9: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/9.jpg)
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
8Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
![Page 10: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/10.jpg)
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
9Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
![Page 11: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/11.jpg)
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
10Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
![Page 12: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/12.jpg)
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
11Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
![Page 13: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/13.jpg)
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
12Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
![Page 14: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/14.jpg)
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
13Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
![Page 15: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/15.jpg)
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
14Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
![Page 16: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/16.jpg)
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
15Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
![Page 17: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/17.jpg)
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
16Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
![Page 18: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/18.jpg)
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
17Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
![Page 19: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/19.jpg)
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
18Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
![Page 20: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/20.jpg)
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
19Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
OR
Credit - Andrew Ng slides
![Page 21: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/21.jpg)
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
20Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
![Page 22: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/22.jpg)
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
21Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
![Page 23: Week 2 - Hacettepe Üniversitesi · Week 2 Aysun Koçak k Nearest 2 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University k-Nearest](https://reader036.vdocuments.us/reader036/viewer/2022062604/5fc3be0722d2c813396f9729/html5/thumbnails/23.jpg)
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
Linear Regression
22Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
PCA