project to production: the web archiving service
DESCRIPTION
Seneca, Tracy. Project to Production: The Web Archiving Service. Digital Library Federation Forum. Palo Alto, CA. 2010.TRANSCRIPT
![Page 1: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/1.jpg)
University of California Curation Center, California Digital Library
Project to Production: The Web Archiving ServiceDLF Fall Forum, 2010
Tracy Seneca
![Page 2: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/2.jpg)
University of California Curation Center, California Digital Library
Web-at-Risk: 2005-2009
![Page 3: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/3.jpg)
University of California Curation Center, California Digital Library
Today:
• Whirlwind tour• Project to production • Current / future work• The DLF community
![Page 4: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/4.jpg)
University of California Curation Center, California Digital Library
Build unique archives for local research communities
Geographically focused archives support local research
• Los Angeles• Monterey Bay• Orange County• San Diego• Santa Barbara
Topical archives support special research collections
• Guantanamo Bay / Tamiment Library
• California Water Districts / Water Resources Center Archives
![Page 5: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/5.jpg)
University of California Curation Center, California Digital Library
Archive Ephemeral Content
![Page 6: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/6.jpg)
University of California Curation Center, California Digital Library
Analyze Site Change
Are there new documents on this site?
Are there documents in my archive that have been removed from the live site?
![Page 7: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/7.jpg)
University of California Curation Center, California Digital Library
Easy to Use : Simple Workflow
![Page 8: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/8.jpg)
University of California Curation Center, California Digital Library
Tailor Capture Settings
Focus on site, directory or page
Set appropriate frequency
![Page 9: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/9.jpg)
University of California Curation Center, California Digital Library
http://was.cdlib.org
![Page 10: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/10.jpg)
University of California Curation Center, California Digital Library
Archive Home Page
![Page 11: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/11.jpg)
University of California Curation Center, California Digital Library
Automatic List of Sites
![Page 12: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/12.jpg)
University of California Curation Center, California Digital Library
Search Across All Sites or Target Just One
![Page 13: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/13.jpg)
University of California Curation Center, California Digital Library
WAS Snapshot: October 2010
Stats: Since January 200717 organizations4,509 sites captured33,619 captures run21.7 terabytes29 archives published
![Page 14: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/14.jpg)
University of California Curation Center, California Digital Library
Project to Production
• Scale– Infrastructure: ensure continuity of service
through server upgrades
• Policy– Setting up service agreements
![Page 15: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/15.jpg)
University of California Curation Center, California Digital Library
Engage the users(Needs assessment doesn’t stop)
![Page 16: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/16.jpg)
University of California Curation Center, California Digital Library
“Production” is not just for us!
• How does WAS fit into existing workflows?• Is there a ‘web archivist’? Student workers?
Friday November 5th 10-11:30 am
Curators from UC San Diego, NYU, University of Michigan and UC Berkeley share their approaches to web archiving.
http://was.cdlib.orgWAS News
![Page 17: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/17.jpg)
University of California Curation Center, California Digital Library
Archiving the State of CaliforniaLearning from the archives
307 sites1363 captures2.7 TBBegan October 2008
47%51%
2%
California State Agency Sites
with robots no robots gone
![Page 18: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/18.jpg)
University of California Curation Center, California Digital Library
Archiving the Gulf oil spillImproving support for collaboration
527 sites9288 + captures1.6 TBBegan May 5
![Page 19: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/19.jpg)
University of California Curation Center, California Digital Library
LSU tags relevant sites in DeliciousCDL imports Delicious JSON feed into WAS
![Page 20: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/20.jpg)
University of California Curation Center, California Digital Library
Interoperability of CDL Services
![Page 21: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/21.jpg)
University of California Curation Center, California Digital Library
![Page 22: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/22.jpg)
DLF Community
Tools• WAS
– UC libraries, NYU, Stanford
• Archive-It– Columbia, Rice, Indiana…
• Other– Library of Congress, North
Texas, Los Alamos
Common issues/developments
• Memento• Policy
– Can / should Facebook block government pages from capture?
• Collection• Collaboration• Imagination
![Page 23: Project to Production: The Web Archiving Service](https://reader036.vdocuments.us/reader036/viewer/2022070315/55540573b4c90577468b4fb6/html5/thumbnails/23.jpg)
University of California Curation Center, California Digital Library
In-depth demos: Nov 8th and 16th
Workflows discussion: Nov 5th
• http://www.facebook.com/webarchiving• http://was.cdlib.org > WAS News