week 2 - hacettepe Üniversitesi · week 2 aysun koçak k nearest 2 neighbor(k-nn) linear...
TRANSCRIPT
Week 2
RA : Aysun KoçakInstructor : Dr. Aykut Erdem
Department of Computer EngineeringHacettepe University
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Outline
k Nearest Neighbor(k-NN)
Linear Regression
Note for Assignment
22
Week 2
Aysun Koçak
2k NearestNeighbor(k-NN)
Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
k-Nearest Neighbor(k-NN)
I Nonparametric algorithmI To classify a new point, find its K nearest neighbors from the
training data.
credit - Siddharth Deokar slides
22
Week 2
Aysun Koçak
3k NearestNeighbor(k-NN)
Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Code
http://scikit-learn.org/stable/auto_examples/neighbors/plot_classification.html
22
Week 2
Aysun Koçak
4k NearestNeighbor(k-NN)
Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
k-NN Results
22
Week 2
Aysun Koçak
5k NearestNeighbor(k-NN)
Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Drawbacks
I Keep all data to classify a new inputI All neighbors have same importanceI Determining hyper-parameters
I What is the best distance to use?I What is the best value of k to use?
I Distance usually relates to all the attributes and assumes all ofthem have the same effects on distance(curse of dimensionality)
22
Week 2
Aysun Koçak
6k NearestNeighbor(k-NN)
Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Determining Parameters
Credit - Fei-Fei Li & Andrej Karpathy slides
22
Week 2
Aysun Koçak
7k NearestNeighbor(k-NN)
Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Determining Parameters
Accuracy = (# of correctly classified examples / # of examples) X 100Credit - Fei-Fei Li & Andrej Karpathy slides
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
8Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
9Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
10Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
11Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
12Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
13Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
14Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
15Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
16Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
17Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
18Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
Credit - Andrew Ng slides
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
19Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
OR
Credit - Andrew Ng slides
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
20Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
21Linear Regression
Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
Linear Regression
22
Week 2
Aysun Koçak
k NearestNeighbor(k-NN)
Linear Regression
22Note for Assignment
Dept. of ComputerEngineering
Hacettepe University
PCA