schubincafe.com, beyond hd, 2012 february 9 1 beyond hd: resolution, frame rate, & dynamic range...
TRANSCRIPT
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 11
Beyond HD:Beyond HD:Resolution, Resolution, Frame Rate, & Frame Rate, & Dynamic RangeDynamic Range
Mark SchubinMark Schubinmultiple Emmy-award-multiple Emmy-award-winning SMPTE Fellowwinning SMPTE Fellow
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 22
Why Go Beyond HD?Why Go Beyond HD? EvolutionEvolution
resolutionresolution started at 8 linesstarted at 8 lines
frame rateframe rate started at 8 fpsstarted at 8 fps
wider screenwider screen started verticalstarted vertical
soundsound colorcolor surround soundsurround sound
Baird 30-line TV 1932Baird 30-line TV 1932
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 33
(Not) (Not) S3DS3D
extra gearextra gear prod. & view.prod. & view.
extra signalsextra signals extra workextra work extra extra
processesprocesses noticeablenoticeable
good when it good when it works wellworks well
bad when it bad when it doesn’tdoesn’t
NEP SS-3D plansNEP SS-3D plans
PaceS3Drig
66 ofof 1616seatsseats
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 44
Good & Bad S3DGood & Bad S3D
GoodGood BadBad
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 55
TerminologyTerminology Higher resolutionHigher resolution
4K: either 4096 or 3840 active pixels per line4K: either 4096 or 3840 active pixels per line nominally 2160 linesnominally 2160 lines
8K: either 8192 or 7680 active pixels per line8K: either 8192 or 7680 active pixels per line nominally 4320 lines nominally 4320 lines 7680 version also called UHDTV or Super Hi-Vision7680 version also called UHDTV or Super Hi-Vision
Higher Frame Rate = HFRHigher Frame Rate = HFR includes 1080 lines at 60 fps progressive scanincludes 1080 lines at 60 fps progressive scan
Higher Dynamic Range = HDRHigher Dynamic Range = HDR range from darkest to brightest in an imagerange from darkest to brightest in an image
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 66
What Is HD?What Is HD?
??
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 77
"The exposition's opening "The exposition's opening on April 30 also marked on April 30 also marked the advent of this the advent of this country's first regular country's first regular schedule of high-schedule of high-definition broadcasts." definition broadcasts."
??
What Is HD?What Is HD?
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 88
"The exposition's opening "The exposition's opening on April 30 also marked on April 30 also marked the advent of this the advent of this country's first regular country's first regular schedule of high-schedule of high-definition broadcasts." definition broadcasts."
- Broadcasting- Broadcasting magazinemagazine
??
What Is HD?What Is HD?
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 99
"The exposition's opening on "The exposition's opening on April 30 also marked the April 30 also marked the advent of advent of this country'sthis country's first first regular schedule of high-regular schedule of high-definition broadcasts." definition broadcasts."
- Broadcasting- Broadcasting magazine, magazine,reporting from the 1939reporting from the 1939
New York World’s Fair onNew York World’s Fair on 441-line (total) television441-line (total) television
What Is HD?What Is HD?
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 1010
“…“…this country’s…” ?this country’s…” ?
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 1111
TV D That Was More HTV D That Was More H
Baird 600-line color 1940Baird 600-line color 1940
French TVFrench TV819-line819-line
1948-19861948-1986
Thousand-lineThousand-linesystems testedsystems testedin the 1940sin the 1940s
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 1212
Human Resolution Theory - Human Resolution Theory - 18621862
Snellen ChartSnellen Chart 20/20 (6/6) optotype20/20 (6/6) optotype
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 1313
Resolution and Viewing Resolution and Viewing DistanceDistance Detail falls with Detail falls with
distancedistance Too close can’t Too close can’t
see picture due see picture due to visible pixelsto visible pixels
Peak where Peak where pixels match pixels match visual acuityvisual acuity 20/2020/20 == 30 cpd30 cpd NTSCNTSC ~~ 480 lines480 lines
88°, 7.15x height°, 7.15x height 1080-line1080-line HDHD
3.16H3.16H
viewing distanceviewing distance
rreezz
cycle = white line & black linecycle = white line & black line
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 1414
Lechner Distance:Lechner Distance:9 feet9 feet
(2.7 m)(2.7 m)
Flat-Panel DisplaysFlat-Panel DisplaysIncreaseIncrease Distance Distance
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 1515
Seeming Lack of Need for Seeming Lack of Need for HDTVHDTV
9 feet (2.7 m)9 feet (2.7 m)
15.115.1inchesinches(38 cm)(38 cm)
1515inchesinches
25-inch (64 cm) TV25-inch (64 cm) TV
CEA: 27-inch (69 cm) averageCEA: 27-inch (69 cm) averagesize sold to U.S. dealers in 2006size sold to U.S. dealers in 2006 Dealer inventory one yearDealer inventory one year 10 years to replace all TVs10 years to replace all TVs 1080 lines visible on 70-inch1080 lines visible on 70-inch
(178 cm) 16:9 HDTV (178 cm) 16:9 HDTV
8°8°
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 1616
July 2011 Lawrence Berkeley National Laboratory ReportJuly 2011 Lawrence Berkeley National Laboratory Reportbased on DisplaySearch data (actual & projected)based on DisplaySearch data (actual & projected)
Home TV Screen Size Home TV Screen Size ShippedShipped
(their typo)
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 1717
Panasonic 150-inch/3.8-m plasma TV atPanasonic 150-inch/3.8-m plasma TV at2008 2008 ConsumerConsumer Electronics Show Electronics Show
4096x21604096x2160
One Heck of a Home TVOne Heck of a Home TV
2006 August 16, 2006 August 16, Stan Glasgow, pres.Stan Glasgow, pres.
Sony Electronics,Sony Electronics,““next big leap” in HDnext big leap” in HD[beyond 1080-line][beyond 1080-line] could be 3-5 yearscould be 3-5 years
70-inch:1080-line::70-inch:1080-line::140-inch:2160-line140-inch:2160-line
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 1818
Changing Theatrical Changing Theatrical ExpectationsExpectations
courtesy Warner Bros. Technical Operationscourtesy Warner Bros. Technical Operations
The tiny-screenThe tiny-screenmovie palace ismovie palace isancient historyancient history
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 1919
based on 20/20 visionbased on 20/20 vision
HDTVHDTV≈≈
““2K”2K”
courtesy of ARRI, used with permissioncourtesy of ARRI, used with permission
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 2020
NHK – Ultra-Definition TVNHK – Ultra-Definition TV
Super Hi-Vision 7680 x 4320 (8K) – 400-inch (10.2-m)Super Hi-Vision 7680 x 4320 (8K) – 400-inch (10.2-m)16x more pixels than 1920 x 1080 HDTV16x more pixels than 1920 x 1080 HDTV
NAB 2007NAB 2007
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 2121
Problems with 30-cpd Problems with 30-cpd TheoryTheory
EdgesEdges 3 chart3 chart lineslines belowbelow 20/2020/20 April 2008 SMPTE April 2008 SMPTE Motion ImagingMotion Imaging Journal:Journal:NHK “Research on Human Factors in UHDTV”NHK “Research on Human Factors in UHDTV”
possible to distinguish between 78 and 156 cpdpossible to distinguish between 78 and 156 cpd 156 cpd is more than five times the 20/20 criterion156 cpd is more than five times the 20/20 criterion
““realness” is a function of image detailrealness” is a function of image detail rises rapidly to 50 cpd rises rapidly to 50 cpd continues rising through 156 cpdcontinues rising through 156 cpd
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 2222
Beyond-HDTV Spatial Beyond-HDTV Spatial ResolutionResolution
Cameras from:Cameras from: ARRI, Astro, ARRI, Astro,
Canon, Canon, Dalsa, Dalsa, Hitachi, Ikegami, Hitachi, Ikegami, JVC, JVC, Lockheed-Lockheed-Martin, Meduza, Martin, Meduza, NHK, Olympus, NHK, Olympus, Red, Sony, Vision Red, Sony, Vision ResearchResearch
Displays from:Displays from: CMO, JVC, LG, CMO, JVC, LG,
Panasonic, Panasonic, Samsung, Sharp, Samsung, Sharp, Sony, ToshibaSony, Toshiba
Other gear:Other gear: codecs, recorders, codecs, recorders,
up- & down-up- & down-convert, convert, productionproduction switchersswitchers
But first…But first…
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 2323
HigherHigherFrameFrameRatesRates
50 Hz50 Hz100 Hz100 Hz
BBC/EBUBBC/EBUsimulationsimulationfrom 300-from 300-fps videofps video
Raw data rate same mult.Raw data rate same mult. Compressed data rate TBDCompressed data rate TBD
less change between framesless change between frames sharper for easier estimationsharper for easier estimation
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 2424
Also Motion StrobingAlso Motion Strobing
Panning-speed tables Panning-speed tables based on frame rate based on frame rate and viewing angleand viewing angle
If higher resolution If higher resolution means greater angle, means greater angle, then higher frame then higher frame raterate
S3D sometimes S3D sometimes halves frame rate per halves frame rate per eyeeye
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 2525
Douglas Trumbull on HFR, Douglas Trumbull on HFR, New York Times,New York Times, 2012 Feb 5 2012 Feb 5
““There are really no words for it in There are really no words for it in English, but it’s a window onto English, but it’s a window onto reality” reality”
Tree of Life, Tree of Life, Fox Searchlight PicturesFox Searchlight Pictures
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 2626
““There are really no words for it in There are really no words for it in English, but it’s a window onto reality” English, but it’s a window onto reality”
““Digital cinematography can Digital cinematography can effortlesslyeffortlessly go to 1,000 frames a second”go to 1,000 frames a second”
???????????? lightlight data data
Douglas Trumbull on HFR, Douglas Trumbull on HFR, New York Times,New York Times, 2012 Feb 5 2012 Feb 5
Bill Huberhttp://www.pbase.com/image/41450051
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 2727
AlternativeAlternative forfor Strobing/FalseStrobing/False
MotionMotion
http://www.tessive.com/
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 2828
Back to Spatial ResolutionBack to Spatial Resolution More detailMore detail Reframing/Reframing/
stabilizationstabilization Single-sensor 3DSingle-sensor 3D
Increased Increased sharpnesssharpness
Desired HDDesired HD
Skewed HDSkewed HD
Resulting HDResulting HD
4k4k
Zepar S3D lens on VR Phantom 65Zepar S3D lens on VR Phantom 65
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 2929
Which Person Looks Which Person Looks Angrier?Angrier?
““Angry Man/Neutral Woman,” 1997Angry Man/Neutral Woman,” 1997copyright Aude Oliva, MIT and copyright Aude Oliva, MIT and
Philippe G. Schyns, University of GlasgowPhilippe G. Schyns, University of Glasgowused with permissionused with permission
in the experiments, LSF<2 cpd, HSF>6 cpdin the experiments, LSF<2 cpd, HSF>6 cpd
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 3030
Introducing ContrastIntroducing Contrastco
ntr
as
contr
as
tt
resolutionresolutionDo you see a curve along the bottom?Do you see a curve along the bottom?
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 3131
Contrast-Sensitivity Contrast-Sensitivity FunctionFunction
contr
as
contr
as
tt
resolutionresolution
curve variescurve varieswith retinalwith retinalangle andangle andobserverobserver
max.max.contrastcontrast
sensitivitysensitivity1-8 cpd1-8 cpd
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 3232
Modulation Transfer Modulation Transfer FunctionFunction
contr
as
contr
as
tt
resolutionresolution
““sharpness” issharpness” isproportional to theproportional to thesquare of the areasquare of the areaunder the curveunder the curve
(ARRI paper differs)(ARRI paper differs)
curve shapecurve shapevaries duevaries due
to such factorsto such factorsas filtering,as filtering,
diffraction, imagerdiffraction, imagerresolution, etc.resolution, etc.
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 3333
HDCAM/DVCPRO HD HDCAM/DVCPRO HD CompromiseCompromise
contr
as
contr
as
tt
resolutionresolution
loss of lotsloss of lotsof resolutionof resolutionbut very littlebut very little
sharpnesssharpness
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 3434
Combining Vision & Combining Vision & TechnologyTechnology
contr
as
contr
as
tt
resolutionresolution
invisib
le
invisib
le
not reproduced
not reproduced
availableavailable& visible& visible
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 3535
Why More Resolution Is Why More Resolution Is GoodGood
SINC Function
0
0.2
0.4
0.6
0.8
1
1.2
1 2 3 4 5 6 7 8 9 10 11
Samples
Contr
astst
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 3636
Why More Resolution Is Why More Resolution Is GoodGood
SINC Function
0
0.2
0.4
0.6
0.8
1
1.2
1 2 3 4 5 6 7 8 9 10 11
Samples
Contr
astst
If this is 1080 lines,If this is 1080 lines,then the contrast ratiothen the contrast ratioat 1080 lines is zeroat 1080 lines is zero
zerozerocontrastcontrast
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 3737
Why More Resolution Is Why More Resolution Is GoodGood
SINC Function
0
0.2
0.4
0.6
0.8
1
1.2
1 2 3 4 5 6 7 8 9 10 11
Samples
Contr
astst
If this is 2160 lines,If this is 2160 lines,
64%64%contrastcontrast
then the contrast atthen the contrast at1080 lines is 64%1080 lines is 64%
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 3838
Real MTF CurvesReal MTF Curves
EOS 10D 3072 x 2048
EOS 20D3504 x 2336
14% linear increase in sensors14% linear increase in sensorscourtesy Bob Atkins www.bobatkins.comcourtesy Bob Atkins www.bobatkins.com
used with permissionused with permission
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 3939
Real-World Sharpness Real-World Sharpness ChangeChange
EOS 10DEOS 10D 3072 x 20483072 x 2048
EOS 20DEOS 20D3504 x 23363504 x 2336
courtesy Bob Atkins www.bobatkins.comcourtesy Bob Atkins www.bobatkins.comused with permissionused with permission
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 4040
What Is Resolution?What Is Resolution? Traditional video definition:Traditional video definition:
1920 x 1080, 1280 x 720, etc.1920 x 1080, 1280 x 720, etc. Optical definition:Optical definition:
line pairs per millimeter (lp/mm)line pairs per millimeter (lp/mm) (video resolution (video resolution ÷ 2) ÷ imager size in ÷ 2) ÷ imager size in
mmmm Imager Width lp/mmImager Width lp/mmS35S35 23.8 40 23.8 40 1-inch1-inch 13.9 69 13.9 692/3-inch 2/3-inch 9.6 9.6 1001001/2-inch 1/2-inch 7.0 1387.0 1381/3-inch 1/3-inch 5.2 1845.2 1841/4-inch 1/4-inch 3.9 2453.9 245
for 1920for 1920pixelspixels
per lineper line
full-widthfull-width16:916:9
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 4141
2020 40 40 60 60 80 80
LP/mmLP/mm
100100
MTFMTF%%
Relative MTF of HDTV 2/3-Inch, 1/2-Inch, and 1/3-Relative MTF of HDTV 2/3-Inch, 1/2-Inch, and 1/3-Inch LensInch Lens
Measured at Picture CenterMeasured at Picture Center
1/3-Inch1/3-Inch
1/2-Inch1/2-Inch2/3-Inch2/3-Inch
(from (from Small Format HD Acquisition,Small Format HD Acquisition, Larry Thorpe, Canon, Larry Thorpe, Canon, 2005 SMPTE Fall Technical Conference)2005 SMPTE Fall Technical Conference)
Red One S35 @ 4520 pels slightly easier than 2/3-inch @ 1920Red One S35 @ 4520 pels slightly easier than 2/3-inch @ 1920
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 4242
But How Should It Be But How Should It Be Measured?Measured?
traditional color videotraditional color video Hitachi, IkegamiHitachi, Ikegami Lockheed-MartinLockheed-Martin NHK, Olympus (diff.)NHK, Olympus (diff.)
ARRIARRI AstroAstro CanonCanon JVCJVC RedRed Sony (different)Sony (different) Vision ResearchVision Research
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 4343
SensitivitySensitivity
Both hi-rez and HFR tend to need larger image sensorsBoth hi-rez and HFR tend to need larger image sensors
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 4444
The Story So FarThe Story So Far Frame-rate increase = data & light increaseFrame-rate increase = data & light increase Linear rez increase = (data & light increase)Linear rez increase = (data & light increase)22
Lenses to match optical rez increaseLenses to match optical rez increase
Single-camera ok; multi-camera not yetSingle-camera ok; multi-camera not yet downconversion usefuldownconversion useful
Astro 4K products (more models plus coders & converters)Astro 4K products (more models plus coders & converters)
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 4545
500-watt halogen light500-watt halogen light
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 4646
High Dynamic RangeHigh Dynamic Range
10,000,000:1 (>23-stop) contrast ratio10,000,000:1 (>23-stop) contrast ratioGrass Valley XensiumGrass Valley Xensium
(also ARRI, Fuji, Red, others)(also ARRI, Fuji, Red, others)
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 4747
Different HDR-Capture Different HDR-Capture MethodsMethods
Areal – Bigger PixelsAreal – Bigger Pixels Fewer pixels (ARRI)Fewer pixels (ARRI)
less resolutionless resolution Larger sensor (Vision Research)Larger sensor (Vision Research)
cost, lens availabilitycost, lens availability
Spatial – Multiple SitesSpatial – Multiple Sites FujiFuji
Temporal – Multi-ReadoutTemporal – Multi-Readout RedRed
short duration for highlightsshort duration for highlightsold Fuji Super CCDold Fuji Super CCD
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 4848
Other Optical SolutionsOther Optical SolutionsRosco ViewRosco View
Live Technologies LiveLensLive Technologies LiveLens
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 4949
HDR Good News & BadHDR Good News & Bad Good: No change after image sensingGood: No change after image sensing Bad: HDR displays before contentBad: HDR displays before content
(also wider color gamut)(also wider color gamut)
Dolby PRM-4200 monitor shot by Bill Bennett, ASCDolby PRM-4200 monitor shot by Bill Bennett, ASChttp://www.mobypicture.com/user/CineBill/view/7473526
used with permissionused with permission
SchubinCafe.com, Beyond HD, 2012 February 9SchubinCafe.com, Beyond HD, 2012 February 9 5050
We’ve come a long wayWe’ve come a long waysince 1888since 1888
Questions?Questions?
Comments?Comments?