how long should digital media last? oliver slattery june 07, 2005
TRANSCRIPT
Presentation OutlineGIPWoG:• What is GIPWoG?• Activities.• Participation.
Digital Media Survey:• What and why.• Questions asked.• Results (Government Agencies Only).• Comments/Justifications.• Survey Recommendations.Q and A.
GIPWoGGovernment Information Preservation Working GroupJoint effort between NIST and the DVDA.GIPWoG mission: • To provide government agencies with information to make informed
decisions for using optical storage technologies in digital data storage or preservation strategies.
GIPWoG Goals • Act as a liaison/meeting place between government users and the optical
storage technology industry. • Inform government users of the current state-of-the-art in optical storage
technology. • Highlight optical storage technology research relevant to the needs of
government users. • Serve as a forum for government users to share digital data preservation
issues and strategies.
GIPWoG Activities• Quarterly sessions
– Several agencies meet to hear presentations and discuss digital preservation.
– Introduce agencies to:• Blue Laser technology• Holographic storage• NARA archival guidelines (ERA)• Examples of effective implementation of optical media in
storage/distribution (USGS)• Conceptual solutions for consideration .
– Industry ‘Media Longevity’ Series.– NIST research updates (longevity, compatibility etc).– Identify key issues for agencies and organize the
research to address it (LoC – DVD longevity). – Determine needs of the agencies (Digital Media
Survey).
GIPWoG Agency Participation
Agencies– DoD– GPO– GSA– LoC– NARA– NASA– NGA
Agencies– NIST– U.S. Census Bureau– U.S. Courts– USGS– EPA– NIH– NOAA
Need for Digital Preservation:• ….crucial….critical…essential..• Legally required.• Principle role of agency/central to agency
mission.• Archive distribution and central
requirements of data assets.• Continuity of operations. • The need to stay current.• Records are ‘permanent’.
From: GIPWoG Data Preservation Survey, December 2003. www.itl.nist.gov/div895/gipwog/index.html
Media Issue Importance
0 10 20 30 40 50
Performance
Media S tandards
Media Compatibility
Multiple Media Types
Media Capacity
Media Longevity
Media Technology
Dig
ital
Pre
serv
atio
n I
ssu
es
Score out of 50
From: GIPWoG Data Preservation Survey, December 2003.
www.itl.nist.gov/div895/gipwog/index.html
Digital Media Survey• But how long is long enough?
– A stated longevity requirement will give the industry a solid target to aim for.
• ‘‘Forever’Forever’ is of little practical use to guide the manufacturers.• CommoditizationCommoditization of the CD and DVD recordable market makes it
difficult for higher quality products to compete with poorer (and cheaper) products.
– A stated longevity will give agencies control and certainty over preservation strategies
• Time between migration not too long (save data) and not too short (save money).
• ““Our media lasts UP TO 200 years”Our media lasts UP TO 200 years” is of no use if they MAY also fail after 5 or 10 years.
Knowing helps both the Industry and the Customer!!!
Survey Questions
• Is there a period of time that you consider ideal, required or necessary for the longevity of storage media?Options: 20, 25, 30, 35, 40, and 40+ years.
• Would you specify a label or logo that indicates a product meets this longevity requirement when purchasing for long-term storage applications? Options: Yes, No, Not sure.
Survey Results (Government)
10 10 105
15
50
05
101520253035404550
20 25 30 35 40 40+
Specified Longevity in Years
% o
f V
alid
Res
pons
es
Survey Results (Government)
Would Label be Specified for Purchasing?
% o
f V
alid
Res
pons
es
2.510
87.5
0102030405060708090
100
No Not Sure Yes
So What’s the Message?• Majority want 40+ year longevity.• Vast majority WILL recommend validated
products.• Government regulations a key issue.• Migration not always possible and usually
difficult and costly.• Tone of comments suggest manufacturers
should aim for 100 years. • If a stated longevity is used, it must have
very high certainty.
So Why 40+? Survey Feedback
What If Migration is Not Possible?•Or if it is simply not performed.•Records may be missing for several decades.•Funding for migration not always available.•Legal issues can obstruct migration.
As Long As the Data is Useful.•Dependent on the type of data.•Medical records ~ 75 years for example•75 – 100 years were popular responses.
So Why 40+? Survey Feedback
It is Our Mandate.•Most cost effective method is long lasting media.
•Statutory obligation for some information.
•Again 75 – 100 years were popular responses.
•Dedicated libraries and archives.
Migration is Difficult and Costly.•People fear migration (as it currently is employed).•Time, cost, personal, loss of data/functionality…•Reduce the Dependence On Migration.
Survey Other Observations
Media longevity only one part of the solution.•Think in terms of a system.•Ensure open formats.
High certainty for listed life-span.•Certainty should be > 99%•Are prepared to pay for assurance
Survey Recommendations
To Media Manufacturers:- Aim for 75-100 years with high certainty.- Agencies seem to be prepared to pay for the comfort
of having non-commodity products.
To Industry/Standards Bodies/Government:- Develop very robust method to determine if media
meets this minimum lifetime. - Sponsor a ‘Archival Grade’ logo to be clearly
associated with media that meets this minimum lifetime criteria.
- Archival system should include this type of media as standard
“Thank You”
Interested in GIPWoG?Please email [email protected]
www.itl.nist.gov/div895/gipwog/index.html