unlocking lockss with apis
TRANSCRIPT
![Page 1: Unlocking LOCKSS with APIs](https://reader036.vdocuments.us/reader036/viewer/2022062900/58e74b781a28ab91558b5103/html5/thumbnails/1.jpg)
LOTS OF COPIES KEEP STUFF SAFE
Unlocking LOCKSS with APIs
Nicholas Taylor (@nullhandle)Program Manager, LOCKSS and Web ArchivingStanford University Libraries
National Symposium on Web Archiving Interoperability22 February 2017
![Page 2: Unlocking LOCKSS with APIs](https://reader036.vdocuments.us/reader036/viewer/2022062900/58e74b781a28ab91558b5103/html5/thumbnails/2.jpg)
a more interoperable LOCKSS• beyond e-resources
• a solution for preserving the digital content your community cares about
• APIs + interoperability• maximize impact by
enabling integration + interconnection• improve sustainability by
leveraging standardized community solutions
“Transparent padlock” by zaphad1 under CC BY 2.0
![Page 3: Unlocking LOCKSS with APIs](https://reader036.vdocuments.us/reader036/viewer/2022062900/58e74b781a28ab91558b5103/html5/thumbnails/3.jpg)
lots of copies keep stuff safe
“Terracotta Warriors” by Pedro Szekely under CC BY-NC-SA 2.0
![Page 4: Unlocking LOCKSS with APIs](https://reader036.vdocuments.us/reader036/viewer/2022062900/58e74b781a28ab91558b5103/html5/thumbnails/4.jpg)
Global LOCKSS Network• subscription e-resources• 150+ institutions• each runs local LOCKSS node• peer-to-peer preservation• publishers opt-in• post-cancellation access
![Page 5: Unlocking LOCKSS with APIs](https://reader036.vdocuments.us/reader036/viewer/2022062900/58e74b781a28ab91558b5103/html5/thumbnails/5.jpg)
lots of LOCKSS• LOCKSS (principle)• LOCKSS (program)• LOCKSS (software)• Global LOCKSS Network• Private LOCKSS Networks• Controlled LOCKSS
(CLOCKSS)
“Cologne Love Padlocks” by orkomedix under CC BY-NC-SA 2.0
![Page 6: Unlocking LOCKSS with APIs](https://reader036.vdocuments.us/reader036/viewer/2022062900/58e74b781a28ab91558b5103/html5/thumbnails/6.jpg)
Private LOCKSS Networks (PLNs)• community of interest• jointly designate content• run distributed nodes• establish governance• preservation via diverse:• technologies• institutions• networks
![Page 7: Unlocking LOCKSS with APIs](https://reader036.vdocuments.us/reader036/viewer/2022062900/58e74b781a28ab91558b5103/html5/thumbnails/7.jpg)
integration opportunities• polling + repair• repository replication• other distributed digital
preservation systems• access• Dockerized Solr indexing
for WARC’ed content• DOI + OpenURL access
to web archives
• metadata extraction “A Different Kind of Weave” by Barbara Courouble under CC BY-NC 2.0
![Page 8: Unlocking LOCKSS with APIs](https://reader036.vdocuments.us/reader036/viewer/2022062900/58e74b781a28ab91558b5103/html5/thumbnails/8.jpg)
why re-architect LOCKSS?• reduce support + operations costs• leverage web-scale open-source software• align w/ web archiving mainstream
• de-silo components + enable external integration• metadata extraction• archive access via DOI + OpenURL• polling + repair protocol
• prepare to evolve w/ the Web• web services architecture as flexible foundation
![Page 9: Unlocking LOCKSS with APIs](https://reader036.vdocuments.us/reader036/viewer/2022062900/58e74b781a28ab91558b5103/html5/thumbnails/9.jpg)
leveraging community components
![Page 10: Unlocking LOCKSS with APIs](https://reader036.vdocuments.us/reader036/viewer/2022062900/58e74b781a28ab91558b5103/html5/thumbnails/10.jpg)
10
aligning with web archiving
Web ARChive (WARC) format compatible technologies• Heritrix• OpenWayback• WarcBase• Web Archiving Proxy
![Page 11: Unlocking LOCKSS with APIs](https://reader036.vdocuments.us/reader036/viewer/2022062900/58e74b781a28ab91558b5103/html5/thumbnails/11.jpg)
API candidates• capture tool/proxy
interconnect• capture tool
management• data import/export• query + extraction• integrity audit + repair• descriptive metadata
• logs + analytics• renderings/derivative
formats• federated data delivery• federated replay• federated full-text
search
![Page 12: Unlocking LOCKSS with APIs](https://reader036.vdocuments.us/reader036/viewer/2022062900/58e74b781a28ab91558b5103/html5/thumbnails/12.jpg)
web archiving system APIs (WASAPI)
![Page 13: Unlocking LOCKSS with APIs](https://reader036.vdocuments.us/reader036/viewer/2022062900/58e74b781a28ab91558b5103/html5/thumbnails/13.jpg)
development roadmap• 2017
• Docker-ize components• web harvest framework• polling + repair web
service
• 2018• IP address + Shibboleth
access via OpenWayback• OpenWayback format
negotiation framework• full-text search web
service “Milestones” by Dheeraj Nagwani under CC BY-NC-ND 2.0
![Page 14: Unlocking LOCKSS with APIs](https://reader036.vdocuments.us/reader036/viewer/2022062900/58e74b781a28ab91558b5103/html5/thumbnails/14.jpg)
Questions?
“stanford dish at sunset” by Dan under CC BY-NC-SA 2.0