media analysis tools - archive.fosdem.org
TRANSCRIPT
Media Analysis ToolsHow we check media files
Jérôme Martinez MediaArea.net SARL
Different needsMetadata extraction and reviewFile format (containers, coding) validationFile format investigationLocal policy conformanceMetadata editing/fixingAudiovisual quality control
MediaInfoMetadata extraction and review
Convenient unified displayOf most relevant technical and tag dataFor video / audio / text / ancillary data files6k downloads/day, 40k GUI launches/dayBSD‑2‑Clause license
MediaInfoSupported formats
Most formats used by either individuals orprofessionalsDetects weird transport layers e.g. Dolby E spanned on 2 audio tracks, subtitles in theancillary data, sidecar files...
MediaInfoExport
Classic flat text, XML...Also in professional output formats e.g. PBCore,EBUCore, FIMS...
MediaConchA conformance checker
Implementation checkerPolicy checkerReporterGPLv3+/MPLv2+ license
MediaConchSupported formats
Implementation checker for Matroska, FFV1, PCMnativelyImplementation checker for PDF and TIFF via plugins (veraPDF and DPFManager projects)Policy checker for all formatsOptional server mode (watch folder)Optionaly an ordonancer e.g. FFmpeg transmux / transcode before checks
MediaTraceDeep check of bytes
Provides meaning of each bit in a fileWork in progress (sometimes stalls due to too muchinformation, only first frames displayed)Available in MediaInfo GUI (text mode), MediaConchGUI (Tree mode), MediaInfo and MediaConch CLI(Text, XML)BSD‑2‑Clause license (in MediaInfoLib)
MediaTraceExample with a Matroska file
MediaTraceExample with a TIFF file
BWF MetaEditWAV/BWF Metadata checker and editor
Focused on WAV format, used a lot by archivesDifference between requirements andrecommandationsCan delete/modify/add metadataCan export metadataPublic domain
BWF MetaEditEnforce the guidelines developed by
FADGI (US Federal Agencies Audio‑Visual WorkingGroup)European Broadcasting Union (EBU)BWF (EBU tech 3285)CodingHistory (EBU tech R98‑1999)OriginatorReferencce (EBU tech R99‑1999)
Microsoft (INFO chunk)
QCToolsAudiovisual quality control
On the decoded frameFocused on digitalized contentInitially focused on video artefacts, now checking alsoaudioBSD‑3‑Clause license for UI/new filters, GPLv2+ forFFmpeg libs
QCToolsTied to FFmpeg
Depends on FFmpeg for demux, decode, and checkSome tests were already present in FFmpeg (especiallylibavfilter), we added an UIWe also added some tests to libavfilter upstream
QCToolsList ‑ Video
YUV: MIN, AVG, MAX, LOW, HIGH, DifferenceSaturation, Hue, Temporal Outliers, Vertical LineRepetitionsBroadcast Range, Crop Width/HeightPeak Signal to Noise Ratio (PSNRf), StructuralSImilarity Metric (SSIMf), Mean Square Error (MSEf)Interlacement Detection
Note: tool is focused on field comparison for the moment
QCToolsList ‑ Audio
R.128, Audio Phase Meter, DC Offset, Audio Diffs, RMS
InterfacesNot only one interface: different people, different needs,different technical knowledges
Command lineGraphical interfaceServer (REST API)Web interface
Standardization
Issues:
Checking is good, but compared to what?Lack of open video/audio standardsLot of people work on lossy formats (e.g. VP9, AV1,Opus)Some people need lossless formats
Standardization
CELLAR: IETF workgroup
Container: MatroskaVideo: FFV1Audio: FLAC (not started)
Sponsorships
Lot of work, we need sponsorship
Several compagnies (usually donʹt like to be named :( )European Union (especially )US Federal Agencies Digital Guidelines InitiativeNational Endowment for the HumanitiesThe Knight Foundation
PREFORMA project
Contributions
We need you!
Patch for new featuresPatch for bug fixesParticipation in CELLARDesign (e.g MediaConch new displays)Participation in documentation wri埾�ingTesting...
Stay in touchMediaInfo: h埾�ps://mediaarea.net/MediaInfo
MediaConch: h埾�ps://mediaarea.net/MediaConch
BWF MetaEdit: h埾�ps://mediaarea.net/BWFMetaEdit
QCTools: h埾�ps://mediaarea.net/QCTools
Follow us on Twi埾�er @MediaArea_net
Jérôme Martinez: [email protected]
Slides: h埾�ps://mediaarea.net/Events
License: CC BY