science of culture? computational analysis and visualization of cultural image collections and...
TRANSCRIPT
![Page 1: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/1.jpg)
softwarestudies.com
The Science of Culture?Theory and examples of computational analysisof visual culture
Dr. Lev ManovichProfessor of Computer Science, The Graduate Center, City University of New York | Director, Software Studies Initiative, California Institute for Telecommunication and Information
03/2016
![Page 2: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/2.jpg)
softwarestudies.com 2
[email protected] @manovich instagram: levmanovich facebook: lev.manovich
our lab: www.softwarestudies.com
![Page 3: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/3.jpg)
softwarestudies.com 3
2004 - present: new types / cheaper urban sensors; new ways to capture human behavior / new forms of digital culture
- social media + user generated content - higher resolution satellite photography - location + movement data (phones) - Arduino for interfacing with sensors - data from city bike programs - open data movement - etc.
![Page 4: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/4.jpg)
softwarestudies.com 4
![Page 5: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/5.jpg)
![Page 6: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/6.jpg)
![Page 7: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/7.jpg)
softwarestudies.com 7
2006 - present:
new research fields that use big cultural data (including social media, user generated content and digitized cultural heritage) to study social and cultural patterns and cultural histories
![Page 8: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/8.jpg)
softwarestudies.com 8
-social computing
-computational social science
-other CS fields: computer vision, media computing, web science, NLP
-science of cities, urban analytics
-digital humanities, digital history, digital art history
![Page 9: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/9.jpg)
softwarestudies.com 9
![Page 10: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/10.jpg)
softwarestudies.com 10
We have to always remember that not everybody is using social media. Example: our map of 100 million tweets with images (sampled from 265 million tweets, 2011-2014)
![Page 11: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/11.jpg)
softwarestudies.com 11
Key characteristics of social media relevant for the study of cultural and social patterns:
![Page 12: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/12.jpg)
softwarestudies.com 12
1 very high spatial and temporal resolution in cities (time and location metadata)
2 automatic detection of subjects + styles + sentiment
3connectivity (content propagation, influences, groups, structure of networks)
![Page 13: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/13.jpg)
softwarestudies.com 13
4engagement: likes, comments, shares, web navigation, gameplay, etc. -
for the first time, we can study cultural reception on mass scale
![Page 14: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/14.jpg)
softwarestudies.com 14
data allows us to qualitatively study interactions between -a) people (online and physically) b) people and spaces c) people and cultural software tools d) people and cultural artifacts (“reception,” “engagement”)
![Page 15: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/15.jpg)
softwarestudies.com 15
![Page 16: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/16.jpg)
softwarestudies.com 16
![Page 17: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/17.jpg)
softwarestudies.com 17
![Page 18: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/18.jpg)
softwarestudies.com 18
![Page 19: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/19.jpg)
softwarestudies.com 19
![Page 20: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/20.jpg)
softwarestudies.com 20
social networks as medium and message (using Instagram as the example)
![Page 21: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/21.jpg)
softwarestudies.com 21
message 1 (“surface”): what people who use social networks say, do, capture message 2 (“depth”): what they “really” say, do, and how they live
medium 1: digital vernacular photography as it exists on Instagram medium 2: Instagram as its own visual, narrative and networked media platform
![Page 22: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/22.jpg)
softwarestudies.com 22
![Page 23: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/23.jpg)
![Page 24: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/24.jpg)
softwarestudies.com 24
![Page 25: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/25.jpg)
softwarestudies.com 25
![Page 26: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/26.jpg)
softwarestudies.com 26
![Page 27: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/27.jpg)
softwarestudies.com 27
![Page 28: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/28.jpg)
softwarestudies.com 28
![Page 29: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/29.jpg)
softwarestudies.com 29
![Page 30: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/30.jpg)
softwarestudies.com 30
![Page 31: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/31.jpg)
softwarestudies.com 31
data analysis and visualization as “medium”
Features extracted from content, the available metadata, and data mining techniques determine what we can learn from social media
Visualization layouts and options further influences what patterns we can see, the meanings, and interpretations
![Page 32: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/32.jpg)
softwarestudies.com 32
the general and the particular:
18th-20th centuries: social statistics, social science and data visualization - aggregation, summarization, reduction; focusing on the regular (that can be modeled and predicted)
21st century: from summarization to individualization; from general to focusing on variability and individual
![Page 33: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/33.jpg)
![Page 34: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/34.jpg)
![Page 35: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/35.jpg)
softwarestudies.com 35
![Page 36: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/36.jpg)
softwarestudies.com 36
examples of cultural analysis using large visual data all examples in the following slides are from - projects created in our lab, - collaborative projects with external collaborators - student work from Manovich’s classes 2009 - 2015
![Page 37: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/37.jpg)
softwarestudies.com 37
Visual evolution of news media
(front covers of a single newspapers)
![Page 38: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/38.jpg)
softwarestudies.com 38
![Page 39: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/39.jpg)
softwarestudies.com 39
Visual evolution of news media - longer period
(4535 Time magazine covers, 1923-2009)
![Page 40: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/40.jpg)
softwarestudies.com 40
4535 Time covers 1923-2009.
Organized by date, left to right, top to bottom.
Every pattern we observe is continuous, with changes taking places over years or decades.
![Page 41: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/41.jpg)
softwarestudies.com 41
4535 Time covers 1923-2009.
closeup: 1920s
![Page 42: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/42.jpg)
softwarestudies.com 42
4535 Time covers 1923-2009.
closeup: 1990s-2000s
![Page 43: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/43.jpg)
softwarestudies.com 43
4535 Time covers 1923-2009 (left to right). Each cover is represented by a single vertical line.
![Page 44: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/44.jpg)
softwarestudies.com
Image plots of 4535 Time covers, 1923-2009. X-axis = date; Y-axis = saturation mean.
44
![Page 45: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/45.jpg)
softwarestudies.com 45closeup
![Page 46: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/46.jpg)
softwarestudies.com 46covers that have highest saturation (1960s)
![Page 47: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/47.jpg)
softwarestudies.com 47
History of a cultural medium (photography) as represented by a single institution (MoMA)
![Page 48: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/48.jpg)
softwarestudies.com 48
In 2013 we were invited by MoMA to analyze their whole photo collection and contribute to the OBJECT : PHOTO exhibition website
![Page 49: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/49.jpg)
softwarestudies.com 49
Seeing the museum collection: 20,000 photographs from MoMA,1844-1989.
Organized by year (top to bottom). Each bar shows photographs from a particular year.
![Page 50: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/50.jpg)
softwarestudies.com 50
closeup, 1925-1929
![Page 51: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/51.jpg)
softwarestudies.com 51
Mapping an artistic movement (French Impressionists)
![Page 52: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/52.jpg)
softwarestudies.com 52
Visualization of 5000 paintings of French Impressionist artists
x and y - first two dimensions of PCA using 200 features
The familiar paintings of French impressionists (see closeup on next slide) turn to be only %20-%30 of their whole creative output
![Page 53: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/53.jpg)
softwarestudies.com 53closeup
![Page 54: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/54.jpg)
softwarestudies.com 54
Mapping a cultural field using a large sample (883 manga publications containing 1,074,790 pages)
![Page 55: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/55.jpg)
softwarestudies.com
1 million manga pages x - standard deviation y - entropy
![Page 56: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/56.jpg)
softwarestudies.com 56
Closeups of the bottom left corner and top corner (previous slide). Entropy feature sorts all pages according to low detail/no texture/flat - high detail/texture/3D dimension. Visualization reveals continuos variation on this dimension. This example suggests that our standard concept of "style" may not be appropriate when looking at particular characteristics of big cultural samples (because "style assumes presence of distinct characteristics, not continuos variation across a whole dimension).
![Page 57: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/57.jpg)
softwarestudies.com 57
1 million manga pages plotted as points x - standard deviation y - entropy Some plot areas are densely filled in, while others are almost empty. Why manga visual language developed in this way? Visualization of a large number of samples allows us to map a cultural fields to see what is typical and what is rare, and what kind of clusters (if they exist) are present in this field.
![Page 58: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/58.jpg)
softwarestudies.com 58
Visual signatures of cities: sampling and aggregating images from a social media platform (Instagram)
![Page 59: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/59.jpg)
softwarestudies.com 59
Comparing San Francisco and Tokyo using 50K image samples. Photos are organized by average brightness (distance to plot center) and average hue (angle).
![Page 60: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/60.jpg)
softwarestudies.com 60
![Page 61: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/61.jpg)
softwarestudies.com 61
Comparing NYC and Tokyo using 50K image samples shared over few days (organized by upload date/time.)
![Page 62: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/62.jpg)
softwarestudies.com 62closeup of the visualization from previous slide
![Page 63: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/63.jpg)
softwarestudies.com 63
Example of data aggregation - reducing 2.3M photos to 13 data points (one point per city)
![Page 64: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/64.jpg)
softwarestudies.com 64
Another plot of cities differences (using only color features)
![Page 65: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/65.jpg)
softwarestudies.com 65
How people represent themselves? How they construct themselves in social media?
![Page 66: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/66.jpg)
softwarestudies.com 66
Selfiecity project, 2014: analysis of 3200 Instagram single selfie photos from 5 global cities. http://selfiecity.net
![Page 67: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/67.jpg)
softwarestudies.com 67One of the visualizations from Selfiecity
![Page 68: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/68.jpg)
softwarestudies.com 68
Screenshot from interactive app selfiexploratory: http://selfiecity.net/selfiexploratory/
![Page 69: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/69.jpg)
softwarestudies.com 69
![Page 70: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/70.jpg)
softwarestudies.com 70
SelfieSaoPaolo project, 2014. Views of the animated projection.
![Page 71: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/71.jpg)
softwarestudies.com 71
Interfaces for people to interact with urban social media data + census and government data;
Combining multiple types + resolution of data
![Page 72: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/72.jpg)
softwarestudies.com 72
On Broadway project, 2014. http://http://on-broadway.nyc/
![Page 73: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/73.jpg)
softwarestudies.com 73
On Broadway is an interactive installation shown at New York Public Library, 12/2004-1/2016
![Page 74: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/74.jpg)
softwarestudies.com 74Artists team in front of On Broadway installation
![Page 75: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/75.jpg)
![Page 76: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/76.jpg)
![Page 77: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/77.jpg)
softwarestudies.com 77
Interface uses familiar multi-touch gestures to navigate Broadway street in Manhattan (21 km, 30M data points)
![Page 78: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/78.jpg)
softwarestudies.com 78
Video showing interaction with On Broadway interactive application on a 46-inch touch screen
![Page 79: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/79.jpg)
softwarestudies.com 79
How exceptional events are represented in visual social media? The exceptional vs the everyday Social media sensors vs. pop media coverage
![Page 80: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/80.jpg)
softwarestudies.com 80The Exceptional & The Everyday project, 2014
![Page 81: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/81.jpg)
softwarestudies.com 81
The Exceptional & The Everyday project, 2014 http://www.the-everyday.net/
The visualization shows 13,208 Instagram images shared by 6,165 people in the center of Kiev during 2014 Ukrainian revolution ( February 17 - February 22, 2014). The photos are organized chronologically (left to right, top to bottom). The right column shows summary of the events from Wikipedia page about the revolution.
A single condensed narrative history (Wikipedia text) vs. visual experiences of thousands of people (Instagram)? The second is potentially richer - but also more difficult to interpet.
Can we narrate history without aggregation and summarization? History as timelines of million of people?
![Page 82: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/82.jpg)
softwarestudies.com 82
![Page 83: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/83.jpg)
softwarestudies.com 83
![Page 84: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/84.jpg)
softwarestudies.com 84
![Page 85: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/85.jpg)
softwarestudies.com 85
using visual social media to predict socio-economic indicators
![Page 86: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/86.jpg)
softwarestudies.com 86
Mehrdad Yazdani and Lev Manovich. “Predicting Social Trends from Non-photographic Images on Twitter.” Big Data and the Humanities workshop, IEEE 2015 Big Data conference.
We classified 1 million twitter images shared in 20 US cities in 2013 using Google free Deep Learning Model available to all researchers
![Page 87: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/87.jpg)
softwarestudies.com 87
![Page 88: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/88.jpg)
softwarestudies.com 88
![Page 89: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/89.jpg)
![Page 90: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/90.jpg)
![Page 91: Science of culture? Computational analysis and visualization of cultural image collections and datasets](https://reader031.vdocuments.us/reader031/viewer/2022030215/588a496b1a28abd3088b59e5/html5/thumbnails/91.jpg)
softwarestudies.com 91
our lab: free tools, publications, projects, news:www.softwarestudies.com articles, books, projects:www.manovich.net academia.educontact:www.facebook.com/lev.manovich twitter.com/manovich [email protected]