v is for visualization: practical considerations for visualizing "big data"
DESCRIPTION
Presented as part of Big Data Week 2014 in Toronto at Viafoura HQ: http://viafoura.com/blog/big-data-week-2014/TRANSCRIPT
![Page 1: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/1.jpg)
V is for Visualization
@everydayanalyst
Myles Harrison
www.everydayanalytics.ca
Big Data Week 201405-07-14
Practical Considerations for Visualizing “Big Data”
![Page 2: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/2.jpg)
?
![Page 3: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/3.jpg)
01100010 01101001 01100111 00100000 01100100 01100001 01110100 01100001
![Page 4: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/4.jpg)
DATA
![Page 5: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/5.jpg)
DATA
![Page 6: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/6.jpg)
The 3 “V”s of Big Data:Volume
Velocity
Variety
Visualization!
4
![Page 7: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/7.jpg)
i.
![Page 8: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/8.jpg)
DIMENSIONS
MEASURES
![Page 9: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/9.jpg)
attentive processing
![Page 10: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/10.jpg)
attentive processingpre-
![Page 11: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/11.jpg)
1172 / 293 = ?
1172
293
![Page 12: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/12.jpg)
Adapted from Show Me The Numbers, 2nd ed. by Stephen Few. Analytics Press, 2012
![Page 13: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/13.jpg)
orientation length closure size (area)
curvature density estimation colour (hue)
intensity intersection termination depth
![Page 14: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/14.jpg)
![Page 15: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/15.jpg)
![Page 16: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/16.jpg)
![Page 17: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/17.jpg)
![Page 18: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/18.jpg)
f(x) = data-ink
total ink used
![Page 19: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/19.jpg)
![Page 20: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/20.jpg)
ii.
(how filling)
![Page 21: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/21.jpg)
![Page 22: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/22.jpg)
![Page 23: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/23.jpg)
![Page 24: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/24.jpg)
![Page 25: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/25.jpg)
![Page 26: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/26.jpg)
![Page 27: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/27.jpg)
![Page 28: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/28.jpg)
![Page 29: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/29.jpg)
![Page 30: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/30.jpg)
![Page 31: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/31.jpg)
![Page 32: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/32.jpg)
![Page 33: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/33.jpg)
![Page 34: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/34.jpg)
![Page 35: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/35.jpg)
![Page 36: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/36.jpg)
![Page 37: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/37.jpg)
![Page 38: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/38.jpg)
![Page 39: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/39.jpg)
STOP!
![Page 40: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/40.jpg)
![Page 41: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/41.jpg)
![Page 42: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/42.jpg)
quantity of interest
den
sity
![Page 43: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/43.jpg)
![Page 44: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/44.jpg)
![Page 45: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/45.jpg)
![Page 46: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/46.jpg)
![Page 47: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/47.jpg)
iii.
(quickly now)
![Page 48: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/48.jpg)
![Page 49: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/49.jpg)
![Page 50: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/50.jpg)
![Page 51: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/51.jpg)
![Page 52: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/52.jpg)
![Page 53: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/53.jpg)
![Page 54: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/54.jpg)
iv.
(the spice of life)
![Page 55: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/55.jpg)
![Page 56: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/56.jpg)
![Page 57: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/57.jpg)
![Page 58: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/58.jpg)
![Page 59: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/59.jpg)
![Page 60: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/60.jpg)
METADATA
![Page 61: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/61.jpg)
![Page 62: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/62.jpg)
![Page 63: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/63.jpg)
![Page 64: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/64.jpg)
ABC
101010101010101101010110
![Page 65: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/65.jpg)
Natural Language Processing (NLP)
bag o’ words
tf-idf
sentiment analysis
stemming
named-entity recognitionshingling
semantic analysisinformation retrieval
N-grams
![Page 66: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/66.jpg)
1.0
0.0
-1.0
![Page 67: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/67.jpg)
![Page 68: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/68.jpg)
![Page 69: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/69.jpg)
![Page 70: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/70.jpg)
![Page 71: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/71.jpg)
• Dimensionality reduction techniques:– Multi-dimensional scaling (MDS)– Principle Components Analysis (PCA)– Linear Discriminant Analysis (LDA)
• Variable selection (forward & backward)
Problems of High Dimensionality
![Page 72: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/72.jpg)
![Page 73: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/73.jpg)
![Page 74: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/74.jpg)
Credit: Kirk, Andy. In Praise of Slopegraphs.
![Page 75: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/75.jpg)
v.
(no jumping allowed)
![Page 76: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/76.jpg)
Summary
• Keep in mind the basics - understand data & perception in visualization
• Use visualization for what it is good at, and analysis techniques to handle the ‘Big’ part
• Complexity can be handled with analytical techniques and less-common visualization types (where appropriate)
![Page 77: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/77.jpg)
![Page 78: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/78.jpg)
The Spectrum of Data Visualization
ANALYSISDESIGN
Graphs
Data Art Infographics Dashboards
TablesInformation Design
ScienceArt ?
![Page 79: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/79.jpg)
![Page 80: V is for Visualization: Practical Considerations for Visualizing "Big Data"](https://reader036.vdocuments.us/reader036/viewer/2022070302/547050b9af795915318b4643/html5/thumbnails/80.jpg)
gracias