f1 phase 1 picture quality test at sel: 2/12/13 session
TRANSCRIPT
F1 Phase 1 Picture Quality Test at SEL:
2/12/13 Session
Overview
• Double-blind test (moderator did not know the file attributes at the time of the test)
• 84” TV settings as defined by Kuni Takahashi• AV files (same showreel as tested in Tokyo) from Yoshi
Takashima– Eldorado, LoA, Amazing Spiderman & Bad Teacher– Eldorado “sky” scene with banding was skipped
• Player: Phase 0 hardware, MPC.• Subjects were asked to consider from point of view of
target consumer and reviewer.
Showreel Bitrate Aggregate score by 8 observers (lower score = better)
A 25 average 50 max
14
B BD Upscaled 19
C 50 average 100 max
15
Phase 1: Double-Blind Viewing Test Results 2/12/13
A25 avg. 50 max.
3 1 2 3 1 1 1 2
BBD Upscaled
2 3 3 2 2 2 2 3
C50 avg. 100 max.
1 2 1 1 3 3 3 1
Phase 1: Blind Viewing Test Results 2/12/13Actual scores
BD Upscaled score was significantly lower than others, was NOT chosen as “best” by anyone.Results for 25 and 50 were very close, with 25 scoring slightly higher. Results for 25 and 50 were consistent with 2/7/13 test.4 people chose 25 as best, 4 chose 50 as best.
Participants
• Phil Molyneux• Mike Lucas• Ray Stanley• Pablo Espinoza• Klaus Hofrichter• Akira Oba• Taka Miyama• Nick ColseyModerator: Jason Clement
2/7/13 Session
Overview
• Blind test• 84” TV settings as defined by Kuni Takahashi• AV files from Yoshi Takashima• Player: Phase 0 hardware, MPC.
Eldorado Bitrate Encoder Aggregate score by 6 observers (lower = better)
A 300 CBR Main Concept 17
B 60 CBR Main Concept 15
C 50 average 100 max
EyeIO 13
D 25 average 50 max
EyeIO 15
Phase 1: Blind Viewing Test Results 2/7/13
A 4 3 2 3 1 4
B 3 2 1 4 4 1
C 2 1 3 2 3 2
D 1 4 4 1 2 3
Phase 1: Blind Viewing Test Results 2/7/13Actual scores
Every version was chosen as “best” by at least 1 person.Lowest bitrate was chosen as “best” by 2 people.No more than 2 out of 6 people agreed on which was “best”.
Participants
• Yoshi Takahashi• Mike Lucas• Tiger Izaki• Akira Oba• Klaus Hofrichter• Nick Colsey
Moderator: Jason Clement