jeg – modeling aspects vqeg, atlanta, nov. 2010 savvas argyropoulos, marcus barkowsky deutsche...
TRANSCRIPT
JEG – Modeling aspectsVQEG, Atlanta, Nov. 2010
Savvas Argyropoulos, Marcus BarkowskyDeutsche Telekom LaboratoriesUniversity of Nantes/IRCCyN
Impairment of pcap files
Tool for the impairment of pcap files based on a trace fileDeveloper: Dr. Bernhard Feiten
PCAPDropPacketsBased on the WpdPack open source software
UsagePCAPDropPackets.exe <InFilename> <IPadr:Port> <TraceFile> <OutFilename>
Usage for retrieving the IP address:PCAPDropPackets.exe <InFilename>
TraceFile is an ASCII file – one line is read for each packetLines starting with ‘d’ result in a packet drop
Towards the hybrid model in JEG
Participants are invited to contribute components that will be combined in the final model
JEG contributors have probably developed their own tools Individual modules could be contributed
Slight modifications may be required for the use of existing modules using the HMIX files
Towards the hybrid model in JEG
Packet loss analysis
Temporal and spatial duration
Error propagationNR end-to-end
distortion tracking
Image/sequence characterisation
Content classification
Motion analysis
Saliency and visual attention
Object detection
Background segmentation
Motion-based algorithms
Texture and luminance masking
Gaze attraction
Perspective estimation
Temporal visual attention
Temporal visibility of degradations
Scene cuts
Behavioural changes across sequence
Image quality
Artefact detection
Blocking
Blur
Ringing
Error concealment effectiveness
MOSEstimation
Texture analysis
MOS
Towards the hybrid model in JEG
Bitstream Quality Indicators
FrameratePicture Size
MB type and QP
MB type and Bitrate
Motion Vectorsand subblock
pattern
DCT coeff.distribution
HMIX
Towards the hybrid model in JEG
Saliency and Visual Attention
Object detectionBackground
segmentation
Texture, Luminance,Color,
Masking Effects
Motion basedalgorithms
Perspectiveestimation
Attraction ofgaze by severedegradations
PVS
Summary ofSpatial
Degradations
HMIXMotion Vectors
Temporal Visual Attention
Towards the hybrid model in JEG
Temporalvisibility of
degradations
Influence ofScene Cuts on
Attention
Behavioralchanges across
sequence
PVS
HMIXMotion Vectors
Image/Sequence Characterization
Towards the hybrid model in JEG
Amount of Motion
Spatial Frequency,e.g. flat regions
Content typeclassification
Detection ofFaces, Persons, ...
PVS
HMIXMotion Vectors
Content typeclassification, e.g.
“Cartoon”
Towards the hybrid model in JEG
Packet Loss Analysis
Discontinuities,Artifacts
Efficiency ofError Concealment
in decoder
Position andlength inbitstream
PVS
HMIX
Towards the hybrid model in JEG
Packet loss analysis
Temporal and spatial duration
Error propagationNR end-to-end
distortion tracking
Image/sequence characterisation
Content classification
Motion analysis
Saliency and visual attention
Object detection
Background segmentation
Motion-based algorithms
Texture and luminance masking
Gaze attraction
Perspective estimation
Temporal visual attention
Temporal visibility of degradations
Scene cuts
Behavioural changes across sequence
Image quality
Artefact detection
Blocking
Blur
Ringing
Error concealment effectiveness
MOSEstimation
Texture analysis
MOS