multiclass and multi-label classification · what color is the cat in this photo? calico orange...
TRANSCRIPT
![Page 1: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/1.jpg)
Multiclass and Multi-label Classification
INFO-4604, Applied Machine LearningUniversity of Colorado Boulder
September 21, 2017Prof. Michael Paul
![Page 2: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/2.jpg)
Today
Beyond binary classification• All classifiers we’ve looked at so far have predicted
one of two classes• We’ll learn two main ways of predicting one of
many classes:• Repurposing binary classifiers• Extending logistic regression
Outputting multiple labels• Sometimes straightforward, but sometimes not• Tricks for better results
![Page 3: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/3.jpg)
Multiclass Classification
What color is the cat in this photo?
Calico Orange Tabby Tuxedo
![Page 4: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/4.jpg)
Multiclass ClassificationMulticlass classification refers to the setting when there are > 2 possible class labels.
• It’s possible to create multiclass classifiers out of binary classifiers.
x1 x2 x3 x4 y
1.01 -‐4.26 7.99 -‐0.03 Calico
2.50 1.00 4.87 5.95 Orange Tabby
-‐2.34 -‐1.24 -‐0.88 -‐1.31 Tuxedo
0.55 0.59 -‐3.08 1.27 Orange Tabby
2.08 -‐3.46 4.62 -‐1.13 Gray Tabby
… … … … …
![Page 5: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/5.jpg)
One versus RestOne vs rest (or one vs all) classification involves training a binary classifier for each class• Each classifier predicts whether the instance
belongs to the target class or not
![Page 6: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/6.jpg)
One versus RestOne vs rest (or one vs all) classification involves training a binary classifier for each class• Each classifier predicts whether the instance
belongs to the target class or not
x1 x2 x3 x4 y
1.01 -‐4.26 7.99 -‐0.03 Calico
2.50 1.00 4.87 5.95 Orange Tabby
-‐2.34 -‐1.24 -‐0.88 -‐1.31 Tuxedo
0.55 0.59 -‐3.08 1.27 Orange Tabby
2.08 -‐3.46 4.62 -‐1.13 Gray Tabby
… … … … …
![Page 7: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/7.jpg)
One versus RestOne vs rest (or one vs all) classification involves training a binary classifier for each class• Each classifier predicts whether the instance
belongs to the target class or not
x1 x2 x3 x4 y
1.01 -‐4.26 7.99 -‐0.03 Yes
2.50 1.00 4.87 5.95 No
-‐2.34 -‐1.24 -‐0.88 -‐1.31 No
0.55 0.59 -‐3.08 1.27 No
2.08 -‐3.46 4.62 -‐1.13 No
… … … … …
“Calico” classifier
![Page 8: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/8.jpg)
One versus RestOne-vs-rest (or one-vs-all) classification involves training a binary classifier for each class• Each classifier predicts whether the instance
belongs to the target class or not
x1 x2 x3 x4 y
1.01 -‐4.26 7.99 -‐0.03 No
2.50 1.00 4.87 5.95 Yes
-‐2.34 -‐1.24 -‐0.88 -‐1.31 No
0.55 0.59 -‐3.08 1.27 Yes
2.08 -‐3.46 4.62 -‐1.13 No
… … … … …
“Orange Tabby” classifier
![Page 9: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/9.jpg)
One versus Rest
What color is the cat in this photo?
Classifier PredictionCalico NoOrange Tabby YesTuxedo NoGray Tabby No… …
![Page 10: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/10.jpg)
One versus Rest
What color is the cat in this photo?
Classifier PredictionCalico NoOrange Tabby YesTuxedo NoGray Tabby No… …
We’ll go with Orange Tabby as the best prediction.
![Page 11: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/11.jpg)
One versus Rest
What color is the cat in this photo?
Classifier PredictionCalico NoOrange Tabby YesTuxedo NoGray Tabby Yes… …
What if multiple classifiers said yes?
![Page 12: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/12.jpg)
One versus Rest
What color is the cat in this photo?
Classifier PredictionCalico NoOrange Tabby NoTuxedo NoGray Tabby No… …
What if none of the classifiers said yes?
![Page 13: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/13.jpg)
One versus RestInstead of only using the final binary prediction of each classifier, consider the score associated with the prediction.
Recall:We defined a classification score for the linear classifiers we’ve seen as the dot product wTxi• Other kinds of classifiers usually have some sort of
score, but it might look different
Go with whichever one-vs-rest classifier has the highest score (highest confidence in prediction)
![Page 14: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/14.jpg)
One versus Rest
What color is the cat in this photo?
Classifier ScoreCalico -‐4.59Orange Tabby 2.18Tuxedo -‐1.80Gray Tabby 0.73… …
![Page 15: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/15.jpg)
One versus Rest
What color is the cat in this photo?
Classifier ScoreCalico -‐4.59Orange Tabby 2.18Tuxedo -‐1.80Gray Tabby 0.73… …
We’ll go with Orange Tabby as the best prediction.
![Page 16: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/16.jpg)
All PairsThe all pairs approach to multiclass classification trains a binary classifier for every pair of classes• Whichever class “wins” more pairwise
classifications will be the final prediction
![Page 17: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/17.jpg)
All PairsThe all pairs approach to multiclass classification trains a binary classifier for every pair of classes• Whichever class “wins” more pairwise
classifications will be the final prediction
x1 x2 x3 x4 y
1.01 -‐4.26 7.99 -‐0.03 Calico
2.50 1.00 4.87 5.95 Orange Tabby
-‐2.34 -‐1.24 -‐0.88 -‐1.31 Tuxedo
0.55 0.59 -‐3.08 1.27 Orange Tabby
2.08 -‐3.46 4.62 -‐1.13 Gray Tabby
… … … … …
![Page 18: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/18.jpg)
All PairsThe all pairs approach to multiclass classification trains a binary classifier for every pair of classes• Whichever class “wins” more pairwise
classifications will be the final prediction
x1 x2 x3 x4 y
1.01 -‐4.26 7.99 -‐0.03 Calico
2.50 1.00 4.87 5.95 Orange Tabby
-‐2.34 -‐1.24 -‐0.88 -‐1.31 Tuxedo
0.55 0.59 -‐3.08 1.27 Orange Tabby
2.08 -‐3.46 4.62 -‐1.13 Gray Tabby
… … … … …
“Calico vs Tuxedo” classifier
![Page 19: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/19.jpg)
All PairsThe all pairs approach to multiclass classification trains a binary classifier for every pair of classes• Whichever class “wins” more pairwise
classifications will be the final prediction
x1 x2 x3 x4 y
1.01 -‐4.26 7.99 -‐0.03 Calico
2.50 1.00 4.87 5.95 Orange Tabby
-‐2.34 -‐1.24 -‐0.88 -‐1.31 Tuxedo
0.55 0.59 -‐3.08 1.27 Orange Tabby
2.08 -‐3.46 4.62 -‐1.13 Gray Tabby
… … … … …
“Calico vs Orange Tabby” classifier
![Page 20: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/20.jpg)
All PairsThe all pairs approach to multiclass classification trains a binary classifier for every pair of classes• Whichever class “wins” more pairwise
classifications will be the final prediction
x1 x2 x3 x4 y
1.01 -‐4.26 7.99 -‐0.03 Calico
2.50 1.00 4.87 5.95 Orange Tabby
-‐2.34 -‐1.24 -‐0.88 -‐1.31 Tuxedo
0.55 0.59 -‐3.08 1.27 Orange Tabby
2.08 -‐3.46 4.62 -‐1.13 Gray Tabby
… … … … …
“Tuxedo vs Orange Tabby” classifier
![Page 21: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/21.jpg)
All Pairs
What color is the cat in this photo?
Classifier PredictionCalico vs Orange OrangeCalico vs Tuxedo TuxedoCalico vs Gray GrayOrange vs Tuxedo OrangeOrange vs Gray Orange… …
![Page 22: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/22.jpg)
All Pairs
What color is the cat in this photo?
Classifier PredictionCalico vs Orange OrangeCalico vs Tuxedo TuxedoCalico vs Gray GrayOrange vs Tuxedo OrangeOrange vs Gray Orange… …
We’ll go with Orange Tabby as the best prediction.
![Page 23: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/23.jpg)
Multiclass Classification• These approaches can work reasonably well• All pairs is faster to train; one-vs-rest is faster
at making predictions• sklearn implements one-vs-rest by default
when you give more than two classes to a binary classifier
Next we’ll see how logistic regression can handle multiple classes without having to combine different binary classifiers
![Page 24: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/24.jpg)
Logistic RegressionBefore:Binary logistic regression used the logistic function to give the probability that an instance belonged to the positive class.
P(yi = 1 | xi) = 11 + exp(-wTxi)
![Page 25: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/25.jpg)
Logistic RegressionMultinomial (or multivariate) logistic regression uses a similar but more general function (the softmax function) for the probability of K classes:
P(yi = k | xi) = exp(wkTxi)
exp(wk’Txi)
k’=1
K
![Page 26: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/26.jpg)
Logistic RegressionBinary Multinomial• One weight vector w • K weight vectors, wk
• Score plugged into logistic function to get value between [0, 1]
• Vector of K scores plugged into softmaxfunction get to vector of K values, each between [0,1] and all values sum to 1
• Probability of negative class is just 1 minus probability of positive class
• Each class probability depends on its own score from its own weight vector
![Page 27: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/27.jpg)
Logistic Regression
What color is the cat in this photo?
Class ProbabilityCalico 0.03Orange Tabby 0.62Tuxedo 0.04Gray Tabby 0.11… …
![Page 28: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/28.jpg)
Logistic Regression
What color is the cat in this photo?
Class ProbabilityCalico 0.03Orange Tabby 0.62Tuxedo 0.04Gray Tabby 0.11… …
Orange Tabby has the highest probability.
![Page 29: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/29.jpg)
Logistic RegressionThe weights can be learned with gradient descent, just like in the binary version.
The loss function is the negative log-likelihood of the training data, as before.
Won’t go into the details in this class, but updates look similar to what you’ve seen.
![Page 30: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/30.jpg)
Logistic RegressionOther names for multinomial logistic regression that you might encounter:
• Multiclass logistic regression• Maximum entropy (MaxEnt) classifier• Softmax regression
![Page 31: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/31.jpg)
Multi-label Classification
What color and sex is the cat in this photo?
CalicoFemale
Orange TabbyMale
TuxedoMale
![Page 32: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/32.jpg)
Multi-label ClassificationMulti-label classification refers to the setting when there > 1 label you want to predict.
x1 x2 x3 x4 y1 y21.01 -‐4.26 7.99 -‐0.03 Calico Female
2.50 1.00 4.87 5.95 Orange Tabby Male
-‐2.34 -‐1.24 -‐0.88 -‐1.31 Tuxedo Male
0.55 0.59 -‐3.08 1.27 Orange Tabby Male
2.08 -‐3.46 4.62 -‐1.13 Gray Tabby Female
… … … … … …
![Page 33: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/33.jpg)
Multi-label ClassificationStarting point: train two separate classifiers• One predicts sex• One predicts color
This might work fine, but there are some things to think about when doing this.
![Page 34: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/34.jpg)
Multi-label ClassificationTwo independent classifiers might output combinations of labels that don’t make sense• Calico cats are almost always female • If your classifiers predict male and calico, this is
probably wrong
There might be correlations between the classes that you could help classification if you had a way to combine the two classifiers• Orange cats are more often male (~80% of the time)• If your classifier(s) believed the cat was orange, this
would increase the belief that it is male (or vice versa)
![Page 35: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/35.jpg)
Multi-label ClassificationOne idea: train one classifier first, use its output as a feature in the other.
![Page 36: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/36.jpg)
x1 x2 x3 x4 y
1.01 -‐4.26 7.99 -‐0.03 Calico
2.50 1.00 4.87 5.95 Orange Tabby
-‐2.34 -‐1.24 -‐0.88 -‐1.31 Tuxedo
0.55 0.59 -‐3.08 1.27 Orange Tabby
2.08 -‐3.46 4.62 -‐1.13 Gray Tabby
… … … … …
x1 x2 x3 x4 x5 y
1.01 -‐4.26 7.99 -‐0.03 Calico? Female
2.50 1.00 4.87 5.95 Orange Tabby? Male
-‐2.34 -‐1.24 -‐0.88 -‐1.31 Tuxedo? Male
0.55 0.59 -‐3.08 1.27 Orange Tabby? Male
2.08 -‐3.46 4.62 -‐1.13 Gray Tabby? Female
… … … … … …
Example:First train a classifier to predict color:
Then train a classifier to predict sex, using the predicted color as an additional feature.
![Page 37: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/37.jpg)
Multi-label ClassificationOne idea: train one classifier first, use its output as a feature in the other.
Limitations:• If the first classifier is wrong, you’ll have an
incorrect feature value.• This is a “pipeline” approach where one
classifier informs the other, rather than both informing each other simultaneously
![Page 38: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/38.jpg)
Multi-label ClassificationAnother idea: treat combinations of classes as their own “classes”, then do single-label classification
x1 x2 x3 x4 y
1.01 -‐4.26 7.99 -‐0.03 Calico + Female
2.50 1.00 4.87 5.95 Orange Tabby + Male
-‐2.34 -‐1.24 -‐0.88 -‐1.31 Tuxedo + Male
0.55 0.59 -‐3.08 1.27 Orange Tabby + Male
2.08 -‐3.46 4.62 -‐1.13 Gray Tabby + Female
… … … … …
![Page 39: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/39.jpg)
Multi-label ClassificationAnother idea: treat combinations of classes as their own “classes”, then do single-label classification
This way you can learn that “Calico + Male” is very unlikely, etc.
Limitations:• All classes are learned independently:
the classifier has no idea that “Tuxedo+Male” and “Tuxedo+Female” are both the same color and therefore probably have similar feature weights
![Page 40: Multiclass and Multi-label Classification · What color is the cat in this photo? Calico Orange Tabby Tuxedo. Multiclass Classification Multiclassclassification refers to the setting](https://reader035.vdocuments.us/reader035/viewer/2022071100/5fd8f6957fde4d11e14a952e/html5/thumbnails/40.jpg)
SummaryMulticlass and multi-label situations arise often.• Some simple solutions exist that are often effective.• More sophisticated solutions exist; some we will see
later in the semester.
Don’t confuse “multiclass” and “multi-label”!• They are independent concepts.• Something can be multiclass but not multi-label, or
vice versa, or both, or neither.