visualizing digital collections at archive-it - jcdl 2012
DESCRIPTION
TRANSCRIPT
Visualizing Digital Collections at
Archive-It
Kalpesh Padia, Yasmin Alnoamany, Michele C. Weigle Department of Computer Science
Old Dominion University, Norfolk, VA
http://ws-dl.blogspot.com/
Archive-It
6/11/2012
http://archive-it.org
2 JCDL 2012
11 Collections, 2K+ Sites, 70K+ Mementos
6/11/2012 3 JCDL 2012
Data Retrieval & Processing
• Retrieval: Screen scrape
Copy collection hierarchy
Store page content
• Processing: Calculate TF and TF-IDF
Generate screenshots
Generate wordles
Heuristic categorization
Construct JSON
6/11/2012 4 JCDL 2012
Visualizations – Bubble Chart
6/11/2012
Title bar
Visualization
Area
Visualization
Options
5 JCDL 2012
Visualizations – Image Plot with Wordle
6/11/2012 6 JCDL 2012
Visualizations – Image Plot with Wordle
6/11/2012 7 JCDL 2012
Visualizations – Image Plot with Wordle
6/11/2012 8 JCDL 2012
Visualizations - Timeline
6/11/2012 9 JCDL 2012
Visualizations - Timeline
6/11/2012 10 JCDL 2012
Visualizations - Timeline
6/11/2012 11 JCDL 2012
Visualizations - Timeline
6/11/2012 12 JCDL 2012
Visualizations - Timeline
6/11/2012 13 JCDL 2012
No categorization
6/11/2012
http://www.archive-it.org/collections/2836
14 JCDL 2012
Improper Categorization
6/11/2012
http://www.archive-it.org/collections/2323
15 JCDL 2012
Rule based categorization
News Web Sites
6/11/2012
http://www.archive-it.org/collections/2836
Blogs
Social Media
Videos
16 JCDL 2012
Special URI and TLD based categorization
Pakistani news sites
6/11/2012
http://www.archive-it.org/collections/2836
17 JCDL 2012
Comparison
Pakistan Floods Collection
without categorization
Pakistan Floods Collection after
categorization
6/11/2012 18 JCDL 2012
Future Work
• Detailed user evaluation
• Generic system for any digital archive
• Visualization of mementos
6/11/2012 19 JCDL 2012
Conclusion
• Novel visual interface
• Bubble chart
6/11/2012 20 JCDL 2012
Conclusion
• Novel visual interface
• Bubble chart
• Image plot
6/11/2012 21 JCDL 2012
Conclusion
• Novel visual interface
• Bubble chart
• Image plot
• Wordle
6/11/2012 22 JCDL 2012
Conclusion
• Novel visual interface
• Bubble chart
• Image plot
• Wordle
• Timeline
6/11/2012 23 JCDL 2012
Conclusion
• Novel visual interface
• Bubble chart
• Image plot
• Wordle
• Timeline
• Heuristic categorization
6/11/2012 24 JCDL 2012
Extra Info
6/11/2012 25 JCDL 2012
Digital Archives
6/11/2012
http://lcweb2.loc.gov/diglib/lcwa/html/visual/visual-browse.html
http://www.webarchive.org.uk/ukwa/collection/4325386/page/1
26 JCDL 2012
Visualizing Archives
6/11/2012
http://www.webarchive.org.uk/ukwa/wall/Blogs
27 JCDL 2012
Browsing Archive-IT collections
6/11/2012
http://www.archive-it.org/collections/1068
28 JCDL 2012
Time Span
Time span
Small 1 Day - 2 Weeks
Medium 2 Weeks - 4 Months
Large > 4 Months
6/11/2012
http://wayback.archive-it.org/1068/*/http://amigosdemujeres.org/
29 JCDL 2012
Groups
Groups
Small 1
Medium 2 - 5
Large > 5
6/11/2012
http://www.archive-it.org/collections/1068
30 JCDL 2012
URI Domains
URI Domains
Small 1 - 10
Medium 11 - 20
Large > 20
6/11/2012
http://www.archive-it.org/collections/2836
31 JCDL 2012
Sites & Source Types
Sites
Small 1 - 10
Medium 11 - 99
Large > 99
6/11/2012
http://www.archive-it.org/collections/2836
Source Types
Small 1
Medium 2 - 5
Large > 5
32 JCDL 2012