Page 1
Digital Methods Tool Medley
Crash Course Digital Humanities, Amsterdam, 22 October 2015.
Dr. Anne Helmond @silvertje
Tomás Saraceno, galaxies forming along filaments, Venice Biennial 2009
Page 2
Thanks to
• Erik Borra• Emile den Tex• Bernhard Rieder
Page 3
Medley?
• a diverse assortment or mixture• a musical composition made up of
a series of songs or short pieces
Page 4
Digital Methods Initiative (DMI): new methods and tools for social and cultural research
Page 5
DMI tool database
tools.digitalmethods.net
Page 6
DMI tool database
tools.digitalmethods.net
Page 7
Cablegate
• Research question• Operationalization• Method: often a chain of tools
Page 8
The Response of the Source
Question: Do the sources acknowledge cablegate?
1. Get all links for US embassy websites: http://www.usembassy.gov/
2. Compile list of embassies mentioned in cables: http://wikileaks.ch/cablegate.html
3. Compare lists4. Query mentioned embassies for:
1. Wikileaks2. "Julian Assange”3. Assange4. Cablegate
5. Get number of cables per embassy6. Visualize output
Page 10
Tool: Link ripper
https://tools.digitalmethods.net/beta/linkRipper/
Page 12
Repeat & paste in spreadsheet
Page 13
Tool: Triangulate
https://tools.digitalmethods.net/beta/triangulate/
Page 14
Aim: Acknowledgement of leak?
Page 15
Tool: GoogleScraper
https://tools.digitalmethods.net/beta/scrapeGoogle/
Page 16
Result: tagclouds (starting point for further analysis)
Page 17
The nationality of rights types
https://wiki.digitalmethods.net/Dmi/NationalityofIssues
Page 18
Search as research
[…] the point of departure of search as research, or societal search, may be summarized as follows: we look at Google results and see society, instead of Google. That is to say, including its ‘artifacts,’ engine results put much on display – from source competition and standing to longevity and commitment (Rogers 2013: 110).
Page 19
Research question
Can the search engine Google be repurposed to show which rights are specific per country?
Page 20
Query Google countries
.nl (Dutch), .be (Dutch, French),
.com/.co.uk/.com.au/(English), .it (Italian), .ro (Romanian), .md (Moldavian), .ca (French, English), .fr(French), .de/.at/.lu (German), .fi (Finnish), .se (Swedish), .ee(Estonian), .ru (Russian)
Page 21
“Query design”
“Query design” is the practice of formulating a query so the results can be interpreted as indications and findings (however clue-like), as opposed to mere information retrieved or optimization and manipulation exposed (however fascinating) (Rogers 2013, 111).
Page 22
“rights” in national terminology
• Google.se with query “rattigheter” (13.07.09)• Google.fi with query “oikeudet” (13.07.09)• Google.ee with query “oigused” (15.07.09)• Google.lv with query “tiesibas” (16.07.09)• Google.co.uk with query “rights” (13.07.09)• Google.nl with query “rechten” (13.07.09)• Google.fr with query “droits” (14.07.09)• Google.pt with query “direitos” (14.07.09)• Google.es with query “derechos” (13.07.09)
Page 23
The nationalities of rights types
https://wiki.digitalmethods.net/Dmi/NationalityofIssues
Page 24
The nationalities of rights types
https://wiki.digitalmethods.net/Dmi/NationalityofIssues
Page 25
The nationalities of rights types
https://wiki.digitalmethods.net/Dmi/NationalityofIssues
Page 26
Mapping issue networks
https://www.issuecrawler.net/
Starting points: blogroll from RealClimate.orgTool 1: Linkripper (get all links)Tool 2: IssueCrawler (map issue networks)
Page 27
Mapping issue networks
Climate change blogs network
Page 28
Mapping the Dutch blogosphere
https://www.issuecrawler.net/
Page 29
Tool: IssueCrawler
Page 30
Result: network graph
IssueCrawler -> Gephi
Page 31
The historical Dutch blogosphere
Page 32
Source: Wayback Machine
https://web.archive.org
Page 34
Tool: Harvester
https://tools.digitalmethods.net/beta/harvestUrls/
Page 35
Dutch blogosphere: active blogsTool: Censorship Explorer
https://tools.digitalmethods.net/beta/proxies/
Page 36
Dutch blogosphere (in)active blogs
Page 37
Tool: Censorship explorer
Page 39
Tool: Censorship explorer
https://mappingiranonline.digitalmethods.net/
Page 40
Tool: Dorling map generator
https://tools.digitalmethods.net/beta/dorling/
Page 41
Tool: Instagram scraper
https://tools.digitalmethods.net/beta/instagram/
Page 42
Result: images + (meta)data
Page 43
Tool: DownThemAll!
https://addons.mozilla.org/en-US/firefox/addon/downthemall/
Page 44
Script: download.sh
https://github.com/digitalmethodsinitiative/various/blob/master/download.sh
Page 45
Tool: DMI Twitter Capturing and Analysis Toolset (DMI-TCAT)
https://github.com/digitalmethodsinitiative/dmi-tcathttps://github.com/digitalmethodsinitiative/dmi-tcat/wiki
Page 47
Tool: DMI-TCAT
https://www.youtube.com/watch?v=ex97eoorUeo
Page 48
Tool: YouTube Data Tools
https://tools.digitalmethods.net/netvizz/youtube/
Page 49
Tool: YouTube Data Tools
Page 50
Tool: YouTube Data Tools
Page 51
Tool: Netvizz
https://apps.facebook.com/netvizz/
Page 52
Tool: Tracker Tracker
https://tools.digitalmethods.net/beta/trackerTracker/
Page 54
Open Refine
http://openrefine.org/
Page 55
Open Refine
http://openrefine.org/
Page 56
PalladioPalladio is a web-based platform for the visualization of complex, multi-dimensional data.
http://palladio.designhumanities.org/
Page 57
Tools from our colleagues in Paris
http://tools.medialab.sciences-po.fr/
Page 58
Gephi: The Open Graph Viz Platform
https://gephi.github.io/
Page 59
Tool: Table 2 Net
http://tools.medialab.sciences-po.fr/table2net/
Page 60
Tools from our colleagues in Milan
http://raw.densitydesign.org/
Page 61
Tool: RAW
http://raw.densitydesign.org/
Page 62
Videos and tutorials
https://www.youtube.com/channel/UCEr-xMU78XORzBKII6NGGAQ/videos
Page 63
kthnxbai!
www.digitalmethods.netDr. Anne Helmond @silvertje
Tomás Saraceno, galaxies forming along filaments, Venice Biennial 2009