format and file issues for video archiving franz pavuza phonogrammarchiv austrian academy of science
TRANSCRIPT
![Page 1: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/1.jpg)
FORMAT AND FILE ISSUESFOR VIDEO ARCHIVING
Franz Pavuza
Phonogrammarchiv
Austrian Academy of Science
![Page 2: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/2.jpg)
Video footage
• Broadcasting companies
• Professional sources(commercial, industrial or academic institutions)
• Consumer sources
![Page 3: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/3.jpg)
Formats
• 50+ analogue formats(composite, component)
• 15+ digital formats(4:4:4, 4:2:2, 4:1:1, ......)
![Page 4: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/4.jpg)
Analogue formats
• U-Matic (different versions)
• VHS, Betamax, V2000
• Hi-8, S-VHS
• Betacam
• ..............
![Page 5: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/5.jpg)
Digital formats
• D1, D2, .........D11
• Digi-Beta, Beta SX, IMX
• DV (miniDV, Digi8, DVCam, DVC-Pro)
• ...........
![Page 6: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/6.jpg)
Archiving procedure
• Preservation of original media
and/or
• Transfer of content (data)
![Page 7: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/7.jpg)
Original media (mostly tapes)
• Ageing process well known
• Experience in storage procedures
• Original content (?)
![Page 8: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/8.jpg)
New archiving strategy
• Transfer of analogue footage to the digital level
• Check for data integrity• Refreshing• Periodic transfer of content to new
media
![Page 9: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/9.jpg)
Analog to digital conversion
• Loss or distortion of information minimised
• Resolution (RGB from 6 to 16bit)• Accuracy• Linearity
![Page 10: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/10.jpg)
Digital benefits
• Lossless data transfer
• Regeneration
• (Post processing, especially restauration and data extraction)
![Page 11: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/11.jpg)
Technological challenges
• Transfer speed (up to 250 Mb/s - SD)• Storage space (up to 100 GB/h - SD)• Quality control
resulting in
• High costs
![Page 12: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/12.jpg)
Archiving issues
• Compression?
• Storage media?
• File?
![Page 13: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/13.jpg)
Compression
• Popular strategy, widely used(200+ coding schemes)
• Avanced algorithms (MPEG)
• Cost effective
• Constantly improved
however.......
![Page 14: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/14.jpg)
Compression
• NO (or lossless) compression for archiving analogue footage!
issues:artefacts, post-processing, decoding
• Compression OK for browsing, user copies, streaming etc.
![Page 15: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/15.jpg)
Media
• Optical disks (today mostly CD, DVD)
• Magnetic disks (hard disk arrays)with easy access, speed
• Magnetic tapes (durability, extensive know-how in storage methods)
![Page 16: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/16.jpg)
Media
• Optical disks for author copy, browsing
• Hard disks for selected footage, with quick access on different quality levels
• Tapes for long-time archiving
![Page 17: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/17.jpg)
Properties for universal file
• Platform and operating system independent
• Accepts all types of „essence“• Includes extensive metadata support
(both structural and descriptive)• Usable for acquisition, storage and exchange
and....
![Page 18: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/18.jpg)
Properties....
• Expandable (formats, metadata)
• Preferably IT-based (not proprietary)
• Tested, approved, standardised by relevant organisations
• Accepted by manufacturers
• Accepted by users
![Page 19: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/19.jpg)
MXF (Material Exchange Format)
„Filewrapper and packaging format capable of encapsulating video, audio, single pictures etc., plus associated metadata“
![Page 20: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/20.jpg)
MXF
• Developed by Pro-MPEG Forum and G-FORS Group (EU)
• Supported by AAF-Association
• Supported by major AV - vendors and -institutions
• Already standardised (SMPTE, EBU)
• Introduction phase now
![Page 21: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/21.jpg)
MXF features
• Wrapper for multi-media container(e.g. for Video: „Body“ may vary: MPEG, DV, uncompressed......)
• „Mappings“ already available for IMX(D10), HD-CAM (D11);
MPEG2, DV and uncompressed in preparation
![Page 22: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/22.jpg)
MXF features
• KLV (Key/Length/Value) format
Key: defines data type (metadata, system data, video, audio,....)
Length: size of following block
Value: actual content
![Page 23: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/23.jpg)
MXF features
• KLV plus optional index table provides fast (or partial) access without downloading the complete file
• UMID-compatible (Unique Material Identifier), enables remote metadata
• Partial file retrieval possible, random access to clips within a large single file
![Page 24: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/24.jpg)
MXF features
• Interoperability (working between different equipment and different applications)
• More information:www.pro-mpeg.org
www.AAFAssociation.org
(Warning: 600+ pages !)
![Page 25: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/25.jpg)
Video archiving system
• Hardware
• Software
• Workflow
![Page 26: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/26.jpg)
Video archiving system
• Hardware:
Analogue/digital playerCapture stationStorage devices
![Page 27: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/27.jpg)
Video archiving system
• Analogue players:well-serviced used hardware(e.g. surplus of broadcasting institutions)
• Digital players:multi-format players available,camcorders for consumer material
![Page 28: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/28.jpg)
Video archiving system
• Capture station:Reasonable cost/performance ratio with PC-based solutions plus
additional dedicated hardware(high-speed acquisition, harddisk-
array, computer-tape recorder)
![Page 29: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/29.jpg)
Video archiving system
• Storage:Archiving: best quality, computer tapeBrowsing (now): VHS-tapes and DVD,
eventually replaced by file-server,selected files in high quality – 10Mb/s,„all“ files: standard quality – e.g. 1Mb/s,streaming formats (legal matters!)
![Page 30: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/30.jpg)
Video archiving system
• LTO-Tape:IT product (computer backup tape)developed by industry consortiumdefined for 4 generations (compatible)now: 100 GB – 15 MB/sintroduced: 200 GB – 30 MB/s3rd (400 GB) and 4th generations to come within 3 years
![Page 31: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/31.jpg)
Video archiving system
• LTO Tape:highly reliabledesigned for self-checking (n.y. verified)highly acceptedrapidly decreasing costs (50€/100GB)capable: 60 to 75 min uncompressed
or5-6 hours DV on 100 GB
![Page 32: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/32.jpg)
Video archiving system
• Software:Lack of dedicated video archiving software > use of editing software;
if software prepared for and vendorcommitted to MXF: temporary use of proprietary filesand supporting descriptive files
acceptable (?)
![Page 33: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/33.jpg)
Video archiving system
• Essence-related data:Temporary solution: external database, only basic information on descriptive „notes“Final solution: use of MXF-internal
metadata structures, optional UMID-structure (link to external database)
![Page 34: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/34.jpg)
Alternative solution
• „Rent an archiving system“
• For a relatively large number of cassettes with only a few standard formats
• Checking, cleaning, parallel recording and transfer to destination format
• Permanent media-, online system-check
• Reasonable costs, fast (if applicable)
![Page 35: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/35.jpg)
Problems
• Analogue players
• Archiving software (MXF preference forproduction and distribution, see IMX)
• Workflow (1 h video/10 hs archiving)
• Quality control (migration?)
• High definition
![Page 36: FORMAT AND FILE ISSUES FOR VIDEO ARCHIVING Franz Pavuza Phonogrammarchiv Austrian Academy of Science](https://reader030.vdocuments.us/reader030/viewer/2022032607/56649edb5503460f94bea464/html5/thumbnails/36.jpg)
Thank you for your attention!