digital preservation landscape

7/26/2019 Digital Preservation Landscape

1/60

+

Digital PreservationLandscape

N D

S R


2/60

+What we will talk about

Underlying principles

Tools for digital preservationWorkflow systems

Digital preservation leadership

Engaging with the community


3/60

+

Stages of Automation

Basic tool: improvement, but only a step away frommanual process

Tool refinement: take advantage of automation benefitsto develop basic tool

Production tool : develop stable tool with managedphases of development

Basic workflow: defines basic sequence of toolapplication and actions

Workflow refinement: string tools together

Production workflow : full integration of process


4/60

+OAIS

Open Archival Information System


5/60

+OAIS

Open Archival Information System


6/60

+

PlanningWhere do you start?


7/60

+Preservation planning tools

Can help with planning before

repository development

Can be used to assess current efforts

Can be used to identify gaps


8/60

Plato PreservationPlanning Tool

http://www.ifs.tuwien.ac.at/dp/plato/intro.html
http://www.ifs.tuwien.ac.at/dp/plato/intro.htmlhttp://www.ifs.tuwien.ac.at/dp/plato/intro.htmlhttp://www.ifs.tuwien.ac.at/dp/plato/intro.htmlhttp://www.ifs.tuwien.ac.at/dp/plato/intro.htmlhttp://www.ifs.tuwien.ac.at/dp/plato/intro.html


9/60

+Preservation Planning - plato


10/60

+plato case study

http://youtu.be/K6NnFcSpAh8
http://youtu.be/K6NnFcSpAh8http://youtu.be/K6NnFcSpAh8http://youtu.be/K6NnFcSpAh8


11/60

+SCAPEScalable Preservation

Environments http://www.scape-project.eu
http://www.scape-project.eu/http://www.scape-project.eu/http://www.scape-project.eu/http://www.scape-project.eu/


12/60

+DRAMBORA

Digital Repository Audit Method Based on

Risk Assessment

Online toolkit

Process

Self-Assessment

Identifying and Assessing Risks

Mitigating Risks and Re-assessment

http://www.repositoryaudit.eu
http://www.repositoryaudit.eu/http://www.repositoryaudit.eu/http://www.repositoryaudit.eu/


13/60


14/60

+Trusted Repository Audit Checklist

(TRAC)

Auditing tool

AssessReliability

Commitment

Readiness

Currently under the Center for

Research Libraries (CRL)


15/60

+NDSA Levels of Preservation (LC)

http://www.digitalpreservation.g

ov/ndsa/activities/levels.html

tiered set of recommendations

for how organizations shouldbegin to build or enhance their

digital preservation activities
http://www.digitalpreservation.gov/ndsa/activities/levels.htmlhttp://www.digitalpreservation.gov/ndsa/activities/levels.htmlhttp://www.digitalpreservation.gov/ndsa/activities/levels.htmlhttp://www.digitalpreservation.gov/ndsa/activities/levels.html


16/60

+ Considerations

What decisions has your organizationmade about repository-levelmanagement?

Has your organization explored cloudcomputing options?

How will you anticipate change?

What is your technical capacity?


17/60

+ Administration

Follow key developments

Balance planning and doing

Know yourself

Adjust for your organizational context

Manage human side of technology, too

No on/off switchincremental progress

Anticipate change

Manage technology over time


18/60

+

Tools

What will help you get thejob done?


19/60

+Tools Overview

Often initiated to solve a specific problem

Tools plug into workflows and repositories

Developments began with Ingest Increasing numbers of open source tools

Generic tools suffice in some cases

Projects for most OAIS functions now

Status: emerging and evolving rapidly


20/60

+Ingest Tools (producer)

Prompt/assist producer with:

descriptive data

provenance data

technical data (e.g. creator software)

initial fixity determination


21/60

+Ingest Tools (repository)

Virus checking

File type identification/verification

File validation

Metadata extraction (technical metadata)

File normalization

Fixity verification

Persistent identifiers (assign and manage)


22/60

+BagIt

Protocol for packaging and exchanging

digital content in a generic way

Defined by California Digital Libraryand Library of Congress

Software independent


23/60

+DROID

DROIDDigital Record and Object Identification

Identifies the precise format of all stored digital

objects

links that identification to a central registry

http://www.nationalarchives.gov.uk/information-

management/projects-and-work/droid.htm
http://www.nationalarchives.gov.uk/information-management/projects-and-work/droid.htmhttp://www.nationalarchives.gov.uk/information-management/projects-and-work/droid.htmhttp://www.nationalarchives.gov.uk/information-management/projects-and-work/droid.htmhttp://www.nationalarchives.gov.uk/information-management/projects-and-work/droid.htmhttp://www.nationalarchives.gov.uk/information-management/projects-and-work/droid.htmhttp://www.nationalarchives.gov.uk/information-management/projects-and-work/droid.htmhttp://www.nationalarchives.gov.uk/information-management/projects-and-work/droid.htmhttp://www.nationalarchives.gov.uk/information-management/projects-and-work/droid.htmhttp://www.nationalarchives.gov.uk/information-management/projects-and-work/droid.htm


24/60

+JHOVE2

JHOVE - JSTOR/Harvard Object Validation

Environment

Format aware characterization of digital objects

Functions: What is it? What about it? What is it,

really? So what?

https://bitbucket.org/jhove2/main/wiki/About
https://bitbucket.org/jhove2/main/wiki/Abouthttps://bitbucket.org/jhove2/main/wiki/About


25/60

+Metadata Extraction Tool

Automatically extracts preservation metadata

from files

Outputs that metadata in a standard format

(XML) for use in preservation activities.

http://meta-extractor.sourceforge.net/
http://meta-extractor.sourceforge.net/http://meta-extractor.sourceforge.net/http://meta-extractor.sourceforge.net/http://meta-extractor.sourceforge.net/


26/60

+

Tools for Digital Forensics

http://www.bitcurator.net/

Information and Quick Start on the wiki
http://www.bitcurator.net/http://www.bitcurator.net/


27/60

+PRONOM

File format registry

Online information system about data file

formats and supporting productshttp://www.nationalarchives.gov.uk/PRONO

M/Default.aspx
http://www.nationalarchives.gov.uk/PRONOM/Default.aspxhttp://www.nationalarchives.gov.uk/PRONOM/Default.aspxhttp://www.nationalarchives.gov.uk/PRONOM/Default.aspxhttp://www.nationalarchives.gov.uk/PRONOM/Default.aspx


28/60

+

Registries

GDFRGlobal Digital Format Registry

http://gdfr.info/

UDFRUnified Digital Format Registry

http://udfr.cdlib.org/
http://gdfr.info/http://udfr.cdlib.org/http://udfr.cdlib.org/http://gdfr.info/


29/60

+

FITS Tool Set

FITSFile Information Tool Set

https://code.google.com/p/fits/

Uses a variety of tools
https://code.google.com/p/fits/https://code.google.com/p/fits/


30/60


31/60

+Common Tool Problems

Installation glitches and other bugs

Delays and stoppages

Insufficient documentation / support

Task and data redundancyTool Incompatibility

Learning curve / training requirements

Data independence from toolOrganizational / IT support


32/60

+

Digital Preservation Workflows:

Tools all grown up!


33/60

+

Digital Preservation Systems

Holistic view

Integrated tools

Automated workflow management


34/60

+

Status of DP Workflows

Systems are maturing

Combined - building on one or more tools

Informed by e-science developments

May be:Integrated into repositoriesDefined as a sequence of human/tool steps

Factor in managing at repository levelEncouraged by focus on re-use


35/60


36/60

+


37/60


38/60


39/60


40/60

CDL Micro-Services

Micro-services launched 2010


41/60


42/60

Archivematica

http://www.ifs.tuwien.ac.at/

dp/ipres2010/papers/vanG

arderen28.pdf


43/60


44/60

+ Collaborative Efforts

MetaArchive

Chronopolis

Academic Preservation Trust

(APTrust)

Digital Preservation Network (DPN)


45/60

+ POWRRhttp://digitalpowrr.niu.edu


46/60


47/60

+

Leadership and Training


48/60

+Digital Preservation Management

Follow key developments

Balance planning and doing

Know yourself

Adjust for your organizational context

Manage human side of technology, too

No on/off switchincremental progress

Anticipate change

Manage technology over time

+


49/60

+

Technology Investments

Prioritize: meet essential requirements

Sequence: identify stages to accomplish

Assess: determine when to respond

Fund: decide when to own/share

Anticipate: understand past, look aheadEvaluate: establish ongoing review

+


50/60

+

Considerations

How does technology investment work atyour organization? (understand the system)

What level of support is there for technology

(e.g., direct or indirect, skills, development)?

Are there development plans for humans and

systems in place? (if not, add to to-dos)

How willing is your organization to lead, test,

anticipate, fail?

+


51/60

+Judging Solutions

written in a well-documented languageusable on a wide variety of platformslongevitycommitment, duration of supportmodular in design

support for batch processing and workflowsdesigned for workflow integrationdevelopment by quality stafflicensing options and good access to code

+


52/60

+Digital Preservation Training

DPOEhttp://www.digitalpreservation.gov/educatio

n/

DigCurvhttp://www.digcur-education.org

DigCCurrhttp://www.ils.unc.edu/digccurr/

Digital Preservation Mgt Workshophttp://www.dpworkshop.org/dpm-

eng/eng_index.html
http://www.digitalpreservation.gov/education/http://www.digitalpreservation.gov/education/http://www.digcur-education.org/http://www.ils.unc.edu/digccurr/http://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.dpworkshop.org/dpm-eng/eng_index.htmlhttp://www.ils.unc.edu/digccurr/http://www.ils.unc.edu/digccurr/http://www.ils.unc.edu/digccurr/http://www.digcur-education.org/http://www.digcur-education.org/http://www.digcur-education.org/http://www.digcur-education.org/http://www.digitalpreservation.gov/education/http://www.digitalpreservation.gov/education/http://www.digitalpreservation.gov/education/http://www.digitalpreservation.gov/education/


53/60

+Engaging with the

Community

+


54/60

+

Resources

Organizations

Listservs

Conferences and meetings

Web resources

Webinars

+


55/60

+Organizations

Preservation and Archiving Special Interest Group (PASIG)

ALAALCTSPARSDigital Preservation Interest Group

Association for Information Science and Technology (ASIS&T)

Society for Imaging Science and Technology (IS&T)Archiving

Digital Preservation Coalition

Natl Digital Stewardship Alliance (NDSA)

Society of American Archivists (SAA)

+


56/60

+

National Digital Stewardship

Alliance (NDSA)Mission: establish, maintain, and advance

the capacity to preserve our nation's digital

resources for the benefit of present and

future generations.

Working Groups: Content, Standards,

Infrastructure, Innovation, Outreach

http://www.digitalpreservation.gov/ndsa/

+
http://www.digitalpreservation.gov/ndsa/http://www.digitalpreservation.gov/ndsa/


57/60

+

Conferences

International Digital Curation Conference (IDCC)

PASIG

Open Repositories

iPres

Joint Conference on Digital Libraries (JCDL)

NDSA

+ W b


58/60

+ Web resources

Digital Preservation Outreach & Education (DPOE)http://www.digitalpreservation.gov/education/index.html

Digital Curation Centre (DCC) http://www.dcc.ac.uk/

Digital Preservation Coalition http://www.dpconline.org/

Digital Curation Exchange

http://digitalcurationexchange.org

+
http://www.digitalpreservation.gov/education/index.htmlhttp://www.dcc.ac.uk/http://www.dpconline.org/http://digitalcurationexchange.org/http://digitalcurationexchange.org/http://www.dpconline.org/http://www.dcc.ac.uk/http://www.digitalpreservation.gov/education/index.html


59/60

+

Listservs

[email protected]

[email protected]
mailto:[email protected]:[email protected]:[email protected]:[email protected]:[email protected]:[email protected]


60/60

+

Questions and Discussion

digital preservation landscape

Documents