visualization and descriptive...
TRANSCRIPT
![Page 1: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/1.jpg)
Visualization and descriptive statistics
D.A. Forsyth
![Page 2: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/2.jpg)
What’s going on here?
• Most important, most creative scientific question• Getting answers• Make helpful pictures and look at them• Compute numbers in support of making pictures
• Data has types• Continuous • Discrete• Ordinal (can be ordered)• Categorical (no natural order, “cat” vs “hat”)
• Different plots apply
![Page 3: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/3.jpg)
Histograms
Ick!
Categorical data
![Page 4: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/4.jpg)
Bar Charts
Categorical data - counts in category
![Page 5: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/5.jpg)
Histograms
Ick!Continuous data
![Page 6: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/6.jpg)
Histograms
![Page 7: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/7.jpg)
Conditional Histograms
![Page 8: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/8.jpg)
Data example
• Clicks, impressions and ages for NYT website• https://github.com/oreillymedia/doing_data_science• Question: Look at data - what’s going on?
• Example R code on webpage
![Page 9: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/9.jpg)
Why R?
• It’s free• It’s easy to get pictures up and going • from weirdly formatted datasets
• Many, many tools• most of the code I’ll work with is downloaded/copied• that’s the right strategy• work with tools *without* implementing them
![Page 10: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/10.jpg)
Some R
setwd('/users/daf/Current/courses/BigData/Examples')
data1<-read.csv('/users/daf/Current/courses/BigData/doing_data_science-master/dds_datasets/dds_ch2_nyt/nyt1.csv')
data1$agecat<-cut(data1$Age, c(-Inf, 0, 18, 24, 34, 44, 54, 64, 74, 84, Inf))# This breaks the Age column into categories
data1$impcat<-cut(data1$Impressions, c(-Inf, 0, 1, 2, 3, 4, 5, Inf))# This breaks the impression column into categories
summary(data1)
![Page 11: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/11.jpg)
Age Gender Impressions Clicks Signed_In agecat impcat Min. : 0.00 Min. :0.000 Min. : 0.000 Min. :0.00000 Min. :0.0000 (-Inf,0]:137106 (-Inf,0]: 3066
1st Qu.: 0.00 1st Qu.:0.000 1st Qu.: 3.000 1st Qu.:0.00000 1st Qu.:0.0000 (34,44] : 70860 (0,1] : 15483 Median : 31.00 Median :0.000 Median : 5.000 Median :0.00000 Median :1.0000 (44,54] : 64288 (1,2] : 38433
Mean : 29.48 Mean :0.367 Mean : 5.007 Mean :0.09259 Mean :0.7009 (24,34] : 58174 (2,3] : 64121 3rd Qu.: 48.00 3rd Qu.:1.000 3rd Qu.: 6.000 3rd Qu.:0.00000 3rd Qu.:1.0000 (54,64] : 44738 (3,4] : 80303 Max. :108.00 Max. :1.000 Max. :20.000 Max. :4.00000 Max. :1.0000 (18,24] : 35270 (4,5] : 80477
(Other) : 48005 (5, Inf]:176558
![Page 12: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/12.jpg)
Users by age
![Page 13: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/13.jpg)
Impression histogram, faceted by age
![Page 14: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/14.jpg)
Click histogram, faceted by age
![Page 15: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/15.jpg)
Click/Impression histogram, faceted by age
![Page 16: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/16.jpg)
2D Data
![Page 17: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/17.jpg)
Categorical data
Pie charts are deprecated - it’s hard to judge area by eye accurately
![Page 18: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/18.jpg)
Mosaic Plots
![Page 19: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/19.jpg)
The UFO data set
• UFO sighting data• date of sighting; date of report; location; description; some free text• rather messy data• about 15 years of sightings (‘95 - ’08 with some others)• broke into 1000 day blocks• looked at most common shape descriptors• (' disk', ' light', ' circle', ' triangle', ' sphere', ' oval', ' other', ' unknown')• great example of categorical data
• R-code on website• not great code, but informative• building a map, merging datasets, reading datasets, mosaic plots• you should look at this
http://www.infochimps.com/datasets/60000-documented-ufo-sightings-with-text-descriptions-and-metada
![Page 20: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/20.jpg)
Conclusion: UFO shapes haven’t changed over time
![Page 21: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/21.jpg)
Ordinal data
![Page 22: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/22.jpg)
Ordinal data
![Page 23: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/23.jpg)
Series
![Page 24: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/24.jpg)
Scatter plots
• Plot a marker at a location where there is a datapoint• Simplest case - geographic
![Page 25: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/25.jpg)
![Page 26: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/26.jpg)
![Page 27: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/27.jpg)
Arsenic in well water
![Page 28: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/28.jpg)
UFO sightings by state
![Page 29: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/29.jpg)
UFO’s by interval
![Page 30: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/30.jpg)
UFO’s by interval
![Page 31: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/31.jpg)
UFO’s by interval
![Page 32: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/32.jpg)
UFO’s by interval
![Page 33: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/33.jpg)
UFO’s by interval
![Page 34: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/34.jpg)
UFO’s by interval
![Page 35: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/35.jpg)
Interesting analogy
• Blackett’s reasoning about submarine sightings in WWII• can estimate probability of sightings• lead to significantly improved sighting rates, aircraft painting and lighting
strategies (see Korner, “The pleasures of counting” or good histories)
![Page 36: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/36.jpg)
NYT data - remarks
• Many data points lying on top of each other• scatter plot can be deceptive• jitter the points (move by a small random amount)
![Page 37: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/37.jpg)
![Page 38: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/38.jpg)
Age Gender Impressions Clicks Signed_In agecat impcat Min. : 0.00 Min. :0.000 Min. : 0.000 Min. :0.00000 Min. :0.0000 (-Inf,0]:137106 (-Inf,0]: 3066
1st Qu.: 0.00 1st Qu.:0.000 1st Qu.: 3.000 1st Qu.:0.00000 1st Qu.:0.0000 (34,44] : 70860 (0,1] : 15483 Median : 31.00 Median :0.000 Median : 5.000 Median :0.00000 Median :1.0000 (44,54] : 64288 (1,2] : 38433
Mean : 29.48 Mean :0.367 Mean : 5.007 Mean :0.09259 Mean :0.7009 (24,34] : 58174 (2,3] : 64121 3rd Qu.: 48.00 3rd Qu.:1.000 3rd Qu.: 6.000 3rd Qu.:0.00000 3rd Qu.:1.0000 (54,64] : 44738 (3,4] : 80303 Max. :108.00 Max. :1.000 Max. :20.000 Max. :4.00000 Max. :1.0000 (18,24] : 35270 (4,5] : 80477
(Other) : 48005 (5, Inf]:176558
![Page 39: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/39.jpg)
![Page 40: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/40.jpg)
![Page 41: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/41.jpg)
NYT scatters
![Page 42: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/42.jpg)
Scale is an issue
![Page 43: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/43.jpg)
Outliers can set scale
![Page 44: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/44.jpg)
But scale is really a problem
![Page 45: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/45.jpg)
Lynx pelts
![Page 46: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/46.jpg)
Data example
• Housing sales in NYC boroughs• https://github.com/oreillymedia/doing_data_science• Question: Look at real estate sales - what’s going on?
![Page 47: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/47.jpg)
Summary Statistics - mean
The average
The best estimate of the value of a new datapoint in the absence of any other information about it
![Page 48: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/48.jpg)
Summary statistics - Standard deviation
Think of this as a scale
Average distance from mean
Important math properties in notes
![Page 49: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/49.jpg)
Standard deviation
= there are not many points many standard deviations away from the mean
= there is at least one point at least one standard deviation away from the mean
![Page 50: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/50.jpg)
Standard coordinates
![Page 51: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/51.jpg)
Suppressing scale effects
• Do scatter plots in standard coordinates for x, y
![Page 52: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/52.jpg)
![Page 53: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/53.jpg)
Lynx, normalized
![Page 54: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/54.jpg)
x, y don’t really matter
![Page 55: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/55.jpg)
![Page 56: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/56.jpg)
Positive Correlation
![Page 57: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/57.jpg)
Zero Correlation
![Page 58: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/58.jpg)
Negative correlation
![Page 59: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/59.jpg)
The Correlation Coefficient
![Page 60: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/60.jpg)
![Page 61: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/61.jpg)
Correlation isn’t causality
and foot size is positively correlated with reading ability, etc.
![Page 62: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/62.jpg)
but can be used to predict
![Page 63: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/63.jpg)
NYT normalized
• What’s going wrong here?
![Page 64: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/64.jpg)
![Page 65: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/65.jpg)
A Mosaic Plot
![Page 66: Visualization and descriptive statisticsluthuli.cs.uiuc.edu/~daf/courses/cs-199-bd/slides/visslides.pdf · descriptive statistics D.A. Forsyth. What’s going on here? ... • Many,](https://reader034.vdocuments.us/reader034/viewer/2022042406/5f205836c9e80e075e25e75f/html5/thumbnails/66.jpg)