preserving digital television
DESCRIPTION
Talk given at the Seminario de Conservación de Obras y Documentos Sobre Soportes Electronicós in at the Centro Nacional de las Artes. More information about the program is available from the Centro Multimedia website, here: http://cmm.cenart.gob.mx/seminario09/index.htmlTRANSCRIPT
![Page 1: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/1.jpg)
THE PRESERVATION
OF DIGITAL TELEVISION:
Challenges, Requirements, and Strategies
Kara Van Malssen New York University
LA PRESERVACION DE LA TELEVISION DIGITAL: Retos, Requerimientos, y EstrategiasSeminario de Conservación de Obras y Documentos Sobre Soprotes Electrónicos
Ciudad de México, 31 de julio 2009
![Page 2: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/2.jpg)
Digital television:1. Born Digital2. Digitized from an analog / physical source
Photo by chrisdlugosz via Flickr http://www.flickr.com/photos/chrisdlugosz/3403751594/
![Page 3: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/3.jpg)
Why is preserving digital television especially CHALLENGING
very large filesvery large filesvery large files
?
![Page 4: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/4.jpg)
Analog formats cannot wait for the cost of uncompressed video storage to drop!
![Page 5: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/5.jpg)
no standard format for
production or archiving
![Page 6: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/6.jpg)
many LARGE files
![Page 7: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/7.jpg)
Static Media Viewed with the naked eyeUtilized without additional componentsVery long useful life if stored properly
Photo from the Library of Congress via Flickr http://www.flickr.com/photos/library_of_congress/3738806589/
![Page 8: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/8.jpg)
Dynamic MediaDependent on machines to view and utilizeMedia are fragileIndustry changes results in format obsolescence
Photo by Martin Deutsch via Flickr http://www.flickr.com/photos/teflon/2352818254/
![Page 9: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/9.jpg)
Digital MediaNot tangibleEven more dependenciesMore frequent obsolescence of various componentsPlayback requirements not obviousMore content than ever before
![Page 10: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/10.jpg)
Preservation of physical media...Primarily required good storage and disaster protection
Photo by vodstrup via Flickr http://www.flickr.com/photos/vodstrup/1486839907/
![Page 11: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/11.jpg)
Preservation of digital mediaMuch more than just good storage and disaster protection
Photo by Scoobay via Flickr http://www.flickr.com/photos/scoobay/3163954667/
![Page 12: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/12.jpg)
Preservation of audiovisual media is an ongoing process
There is no starting and stopping point
No audiovisual format will last forever
We can’t save everything
![Page 13: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/13.jpg)
RISK FACTORS
Photo by kino-eye via Flickr http://www.flickr.com/photos/kino-eye/39529915/
![Page 14: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/14.jpg)
Bit Rot
![Page 15: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/15.jpg)
Photo by damclean via Flickr http://www.flickr.com/photos/damclean/2143598772/
Software Obsolescence+ Upgrades
![Page 16: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/16.jpg)
Hardware Obsolescence
![Page 17: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/17.jpg)
Processor Obsolescence
Photo by huangjiahui via Flickr http://www.flickr.com/photos/huangjiahui/3179858408/
![Page 18: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/18.jpg)
Storage Media Obsolescence
Photo by Ian-S via Flickr http://www.flickr.com/photos/ian-s/2785762687/
![Page 19: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/19.jpg)
Storage Media Failure
Photo by massdistraction via Flickr http://www.flickr.com/photos/sharynmorrow/3718174646
![Page 20: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/20.jpg)
“Despite storing CD-Rs recorded in ideal conditions, tech site TechARP unboxed
300 CDs recorded between 7 to 9 years ago, and found that
they have a failure rate approaching 10 percent for
the first 173 discs--the restoration is still on-going.”Paul Mah, “The Problem of Bit Rot Revisited.”
FierceCIO: Tech Watch, 21 July 2009http://www.fiercecio.com/techwatch/story/problem-cd-bit-rot-revisited/2009-07-21?
utm_medium=nl&utm_source=internal
![Page 21: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/21.jpg)
Lack of METADATA“If a piece of program material is not
correctly placed and identified on a digital system, it might as well not be there - no one will be able to find it or even know it exists.”
Cox, Tadic, Mulder. Descriptive Metadata for Television. Focal Press, 2006. p63.
![Page 22: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/22.jpg)
If we didn’t know that footage of a Harvard Law
student speaking at a protest in 1990
existed at WGBH, would our lives be much different?
![Page 23: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/23.jpg)
But because we do know of its existence
in the archive, and because it can be
ACCESSED, our collective history
is enriched
![Page 24: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/24.jpg)
Lack / loss of organizational support
and resources
Photo by Roby (C) via Flickr http://www.flickr.com/photos/roby72/2401722298/
![Page 25: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/25.jpg)
Photo by wallyg via Flickr http://www.flickr.com/photos/wallyg/2488178506/
REQUIREMENTS
![Page 26: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/26.jpg)
1. Bit PreservationSustaining the 0s and 1s, or ensuring that the video, audio, and ancillary files remain intact over time with no loss or corruption of bits
Photo by adrenalin via Flickr http://www.flickr.com/photos/adrenalin/4250667/
![Page 27: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/27.jpg)
2. Accessibility and Usability of ContentEnsuring that video, audio, and ancillary files can be found, retrieved, interpreted, played back, and delivered to the appropriate users.
Photo by Sunshine Junior via Flickr http://www.flickr.com/photos/sunshinetoday168/1323387457
![Page 28: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/28.jpg)
3. Organizational InfrastructureAn entity (repository) explicitly responsible for keeping the content alive and accessible.
Photo by stefan1024 via Flickr http://www.flickr.com/photos/stefan1024/3682770758
![Page 29: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/29.jpg)
STRATEGIES
![Page 30: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/30.jpg)
RedundancyReplicated, geographically distributed storage
Online StorageIn house
Nearline tape storage In house
Offline tape storage Off site
1. Bit Preservation
![Page 31: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/31.jpg)
Regularly audit files, repair corrupt files with backups
1. Bit Preservation
Photo by Niklas via Flickr http://www.flickr.com/photos/pivic/2829376039/
![Page 32: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/32.jpg)
1. Bit Preservation
Refresh storage media periodically
Photo by TaranRampersad via Flickr http://www.flickr.com/photos/knowprose/111119035/
![Page 33: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/33.jpg)
Where is the content?What is the content?
Who made it?Can I use it?
How can I display it properly?How can I preserve it?
Where did it come from?
Identification & OrganizationDescriptive MetadataDescriptive MetadataRights MetadataTechnical & Structural MetadataPreservation MetadataSource Metadata
Create, update, manage, and maintain good metadata throughout the
life cycle of the digital object
2. Accessibility and Usability of Content
Photo by Sunshine Junior via Flickr http://www.flickr.com/photos/sunshinetoday168/1332297470/
![Page 34: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/34.jpg)
Preservation Version / MasterAccess Versions / Derivatives
Support current and future uses by
preserving the highest quality version to allow for many derivatives
2. Accessibility and Usability of Content
![Page 35: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/35.jpg)
Proprietary or open source?Dependent on specific hardware and/or software?High market saturation?Good documentation / support community?
2. Accessibility and Usability of ContentPhoto by stefan1024 via Flickr http://www.flickr.com/photos/stefan1024/3701790091
Create files using open, standardized, non-proprietary file formats and codecs, high resolution or uncompressed, and avoid transcoding during production
![Page 36: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/36.jpg)
Photo by tochis via Flickr http://www.flickr.com/photos/tochis/3431207670/
Migrate to new file formatwhen necessary
2. Accessibility and Usability of Content
![Page 37: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/37.jpg)
3. Viable Organizational infrastructure
PRESERVATION
Establish a
And ensure sufficient funding, and staffing
Photo by comicbase via Flickr http://www.flickr.com/photos/comicbase/3338358430/
![Page 38: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/38.jpg)
GENERAL REFLECTIONS
Photo by seriykotik1970 via Flickr http://www.flickr.com/photos/seriykotik/195406053/
![Page 39: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/39.jpg)
Refer to the ISO standard OAIS (Open Archival Information System) Reference Model
PRODUCER
CONSUMER
MANAGEMENT
ADMINISTRATION
ACCESSINGEST
PRESERVATION PLANNING
SIP
AIP
DIP
DATAMANAGEMENT
ARCHIVAL STORAGE
AIP
DESCRIPTIVE
INFO
DESCRIPTIVE
INFO
queries
result setsorders
![Page 40: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/40.jpg)
Establish Retention PoliciesWe can’t save everything
by Simon Evans
![Page 41: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/41.jpg)
Establish file and folder naming conventions & workflow procedures
Implement changes during transition to digital production and distribution workflow
![Page 42: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/42.jpg)
Create digital content with the long term in mindNot just the immediate broadcast or distribution needs
Photo by gbaku via Flickr http://www.flickr.com/photos/gbaku/2513320483/
![Page 43: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/43.jpg)
Digital Asset Management
System derivatives
pre-production
production
derivatives
post-production
broadcast
web
legal
titlelocation
names & roles
programming
rightscontract details
formatlogs
IDs
final titleair date(s)
summary
broadcast dates
EDL
summariestranscripts
stills
library / archive
ITbackup dates
checksum
preservationstandardize terms
technical information
locationerrors
user tags
![Page 44: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/44.jpg)
Technology watch
Photo by jacobian via Flickr http://www.flickr.com/photos/jacobian/2385490476/
![Page 45: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/45.jpg)
Investigate cooperative solutions
Photo by quapan via Flickr http://www.flickr.com/photos/hinkelstone/2435823037/
![Page 46: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/46.jpg)
Don’t know what they have
Have incomplete or no catalogs for much of their content
Lack equipment to playback much of their legacy content
Do not know the © status of much of their content
Cannot realize the potential of their collections!
Today, many television stations...
![Page 47: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/47.jpg)
The digital era brings great opportunity to improve discovery, re-use, and cost savings in production,
plus wider access and interaction with audiences
![Page 48: Preserving Digital Television](https://reader033.vdocuments.us/reader033/viewer/2022052410/54c833cc4a7959e8628b461b/html5/thumbnails/48.jpg)
Lets not risk the loss of our collective heritage, or waste the opportunity to take advantage
of the digital transition.
THANK [email protected]