elis – multimedia lab [email protected] [email protected] hevc in...
TRANSCRIPT
![Page 2: ELIS – Multimedia Lab glenn.vanwallendael@ugent.be nicolas.staelens@intec.ugent.be HEVC in JEG-Hybrid](https://reader030.vdocuments.us/reader030/viewer/2022032415/56649f005503460f94c16bea/html5/thumbnails/2.jpg)
2/10
ELIS – Multimedia Lab
JEG-Hybrid: HEVC
SRC selection
• 10 SRC similar to the AVC experiment within JEG-Hybrid
![Page 3: ELIS – Multimedia Lab glenn.vanwallendael@ugent.be nicolas.staelens@intec.ugent.be HEVC in JEG-Hybrid](https://reader030.vdocuments.us/reader030/viewer/2022032415/56649f005503460f94c16bea/html5/thumbnails/3.jpg)
3/10
ELIS – Multimedia Lab
JEG-Hybrid: HEVC
![Page 4: ELIS – Multimedia Lab glenn.vanwallendael@ugent.be nicolas.staelens@intec.ugent.be HEVC in JEG-Hybrid](https://reader030.vdocuments.us/reader030/viewer/2022032415/56649f005503460f94c16bea/html5/thumbnails/4.jpg)
4/10
ELIS – Multimedia Lab
JEG-Hybrid: HEVC
• Encoding only• HEVC: HM11.1
HRC
Bitrate 500kbps, 1Mbps, 2Mbps, 4Mbps, 8Mbps, 16Mbps
Rate control Picture adaptive, CU adaptive
QP 26, 32, 38, 46
GOP 1, 2, 4, 8
Intra period 8, 16, 32, 64
Random access IDR (closed-GOP intra), CDR (open-GOP intra)
Resolution 1920x1080, 1280x720, 960x544
Slices 0, 2, 4, 1500byte
![Page 5: ELIS – Multimedia Lab glenn.vanwallendael@ugent.be nicolas.staelens@intec.ugent.be HEVC in JEG-Hybrid](https://reader030.vdocuments.us/reader030/viewer/2022032415/56649f005503460f94c16bea/html5/thumbnails/5.jpg)
5/10
ELIS – Multimedia Lab
JEG-Hybrid: HEVC
• 1:
• 2:
• 4:
• 8:
GOP structures
I B B B B
I B B B B
I B B B B B B B B
I B B B B
![Page 6: ELIS – Multimedia Lab glenn.vanwallendael@ugent.be nicolas.staelens@intec.ugent.be HEVC in JEG-Hybrid](https://reader030.vdocuments.us/reader030/viewer/2022032415/56649f005503460f94c16bea/html5/thumbnails/6.jpg)
6/10
ELIS – Multimedia Lab
JEG-Hybrid: HEVC
• 60360 HEVC sequences generated
• Corresponds to 292 GB of sequences
PVS generation status
![Page 7: ELIS – Multimedia Lab glenn.vanwallendael@ugent.be nicolas.staelens@intec.ugent.be HEVC in JEG-Hybrid](https://reader030.vdocuments.us/reader030/viewer/2022032415/56649f005503460f94c16bea/html5/thumbnails/7.jpg)
7/10
ELIS – Multimedia Lab
JEG-Hybrid: HEVC
• In progress:• Peak Signal-to-Noise Ratio (PSNR)• Structural Similarity Index (SSIM)• Video Quality Metric (VQM)• Visual Information Fidelity (VIF)
• Help needed for:• SwissQual’s Metric• Tetra Video Quality Metric (TetraVQM)• MOtion-based Video Integrity Evaluation (MOVIE)
Full-reference metric calculation
![Page 8: ELIS – Multimedia Lab glenn.vanwallendael@ugent.be nicolas.staelens@intec.ugent.be HEVC in JEG-Hybrid](https://reader030.vdocuments.us/reader030/viewer/2022032415/56649f005503460f94c16bea/html5/thumbnails/8.jpg)
8/10
ELIS – Multimedia Lab
JEG-Hybrid: HEVC
• Convert bitstream information in XML format
• HM 11.1 modified to generate HMIX file
• Small differences with JM HMIX
• Needs further improvement
HMIX generation
![Page 9: ELIS – Multimedia Lab glenn.vanwallendael@ugent.be nicolas.staelens@intec.ugent.be HEVC in JEG-Hybrid](https://reader030.vdocuments.us/reader030/viewer/2022032415/56649f005503460f94c16bea/html5/thumbnails/9.jpg)
9/10
ELIS – Multimedia Lab
JEG-Hybrid: HEVC
• NAL type• SliceHeader• SliceType• POC• SliceQP• RPS: RefPOC
• CU• CUQP
• PU• MV• RefPOC• IntraDir
HMIX generation
![Page 10: ELIS – Multimedia Lab glenn.vanwallendael@ugent.be nicolas.staelens@intec.ugent.be HEVC in JEG-Hybrid](https://reader030.vdocuments.us/reader030/viewer/2022032415/56649f005503460f94c16bea/html5/thumbnails/10.jpg)
10/10
ELIS – Multimedia Lab
JEG-Hybrid: HEVC
• Blockiness• Blurriness• Exposure• Noisiness• Flickering• Spatial Activity (Intensity)• Temporal Activity (Intensity)• Spatial Correlation• Energy• Homogeneity• Variance• Contrast• Colour Layout Descriptor• Edge Histogram Descriptor
No-reference indicators
![Page 11: ELIS – Multimedia Lab glenn.vanwallendael@ugent.be nicolas.staelens@intec.ugent.be HEVC in JEG-Hybrid](https://reader030.vdocuments.us/reader030/viewer/2022032415/56649f005503460f94c16bea/html5/thumbnails/11.jpg)
11/10
ELIS – Multimedia Lab
JEG-Hybrid: HEVC
• Further encode HEVC PVS• Further calculate full-reference metrics on PVS as ground
truth
• Start with calculating no-reference indicators on PVS
• Create a common AVC-HEVC model based on previously calculated metrics and HMIX information
Future work