“Super Hi-vision” Camera

with 8k x 4k Pixels ~

Hiroshi Shimamoto*

*NHK(Japan Broadcasting Corp.)

Science and Technical Research Lab.

*Stanford University

Stanford Center for Image Systems Engineering

Outline

Our Goal

Camera SystemCamera head

Image sensor

Signal processor

Camera CharacteristicsResolution

Signal-to-noise ratio

Applications

Our Goal

Effects

High sensation of reality as if

we are there

More exciting in live TV

programs

Our objectives

Examine physical and

psychological effects

Enhance sensation for future

TV system

Future TV System with Greater Sensation of Reality

Why 8k?

Viewing angles of displays for HDTV

and 8k x 4k pixel image system

The sensation of reality increases with

the viewing angle and saturates at around

100 deg. Horizontally*1

The spatial resolution of Human vision

perceives 60 pixels per deg.*2

Requirement of 8k pixels

in the horizontal direction

*1:T. Hatada, et al., “Psychophysical Analysis of the Sensation of

Reality Induce by a Visual Wide-Field Display,” SMPTE Journal,

Vol.89, pp.560-569, 1980

*2:High-Definition Television, p.6 Van Nostrand Reinhold, New York,

1992

(Note)Film resolution assuming when distributed (70 pixels per mm.)

Num

ber

of

pix

els

per

fram

e

Temporal resolution (frames per second)

0.1

1

10

100(million)

0 20 40 60 80

35 mm

standard

70 mm

5 perfo.

70 mm

15 perfo.

70 mm

15 perfo.

48 fps

70 mm

5 perfo.

60 fps

NTSC

525p

HDTV 60pHDTV 60i

8KVideo

Digital Cinema

4K

DC

2K

HDTV

24p

Projection Display

Display Theater

“Super Hi-Vision”

Camera Head

Camera Specifications

Newly developed

Year 2004

1.25” CMOS

Zoom lens

Weighs 40kg

Previously developed

Year 2002

2.5” CCD

Fixed focus lens

Weighs 80kg40 kg

300 WPower consumption*

Weight*

8M- pixel CMOS

Four-pickup imaging (GGBR)

(Diagonal pixel offset between green imagers)

5x zoomf = 12 ~ 60 mm

F2.1

approx. 1.25 inch

7680 x 4320 pixels60 frames per sec.

progressive scanning

Image sensor

Color imaging method

Lens

Optical format

System

* Include zoom lens, lens servo system, viewfinder, and optical transmitter.

Camera System (outline)

Camera

Head

E/O

Transmit.

Signal

Processor

O/E

Receiv.

Camera

Control

Unit

Optical

Fiber Cable

Block Diagram (Head)

To

Optical

Receiver

P/S

P/S

P/S

P/S

10-bit digital

G1

G2

B

R

S/P

.

.

.

HD-SDI x 16

LensControlBox Control

DataIrisZoomFocus

Zoom Lens

E/O

E/O

O/E

CWDM...

Power control

Camera Head

OpticalTransmitter SMPTE311

Optical Fiber

Block Diagram (Process)

From

Camera Head

To

Recorder or Projector

.

.

.

O/E

O/E

E/O

CWDM .

.

.

Optical ReceiverHD-SDI

x 16- FPN cancel- Defective pixel / column correction

etc.

Camera Control Unit

Camera Head Power

- Lens aberration correction- Contour compensation- Monitor output

etc.

Signal Processor

4k-LCDMonitor

DVI x 4

8M-pixel CMOS Imager

68%

49.5 MHz

10-bit digital16 parallel

1968 Column parallel

60 frames per sec.Progressive

4.2 μm x 4.2 μm

Effective: 3840 x 2160Total: 3936 x 2196

Pixel aperture

Frequency

Output

ADC

Scanning

Pixel size

Pixel number(Horizontal x Vertical)

8M-pixel CMOS Imager

Block Diagram of the ImagerAnalog-to-Digital

Converter

Reference: I.Takayanagi et al.,”A 1-1/4 inch 8.3M pixel digital output CMOS APS

for UDTV application”, Proceeding of ISSCC2003,12-3,February 2003

Four-pickup Imaging

G1

G2

R

B

Two imagers for Green channel

Diagonal Pixel Offset between G1 G2

R B channel Imagers

Total Pixel Count of 7680 x 4320

(Similar to 32M-pixel Single-Chip Color

Device)

7680

4320

Usual Three-pickup Imaging

G

R

B

Zoom Lens

0 2 4 6 8 10 12 14

- 3

- 2

- 1

0

1

2

3

4

Distance [m]

F11 F2.8F5.6

F11

F2.8

F11f=12mm f=60mm

F4F8

Depth-of-field Calculations

Servo moduleSystem controller

Zoom demandFocus demand

System equipments

Approx. 8 kg (lens only)Weight

67 ~ 15 deg.(Horizontal)41 ~ 8 deg.(Vertical)

Shooting angle

1 m (0.07 m macro)M.O.D.(from front lens)

F2.1Iris

5xZoom

12mm 60mmFocus length

Lateral Chromatic

Aberration Correction

Pattern

Chart

Location

Shooting

Pixel Shift

Filter

Correction

DataLens Parameter

Video Signal

Before After

MTF Characteristics (Calculated)

With

Opt LPF

Without

Opt LPF

Green Blue / Red

2000 4000 6000 8000

20

40

60

80

100

MTF@%D

Pixel Aparture

F8

Spatial Frequency [TV lines]

fs_BR

fn_BR

F2.8

[%]

Total MTF

2000 4000 6000 8000

20

40

60

80

100

MTF@%D

Pixel Aparture

F2.8

F8

Spatial Frequency [TV lines]

fs_G

[%]

Total MTF

F5.6

fn_G

2000 4000 6000 8000

20

40

60

80

100

MTF@%D

Optical LPF

Pixel Aparture

F2.8

F8

Spatial Frequency [TV lines]

fs_G

fn_G

[%]

Total MTF

2000 4000 6000 8000

20

40

60

80

100

MTF@%D

Optical LPF

Pixel Aparture

F8

Spatial Frequency [TV lines]

fs_BR

fn_BR

F2.8

[%]

Total MTF

MTF Characteristics (Measured)

Measured and Calculated at:

• Green Channel

• Vertical Direction

• Fixed Focal Length of f=18mm

• F-stop of F5.6

• MTF from AR by Coltman’s

equation

1000 2000 3000 4000 5000

20

40

60

80

100

MTF@%D

Spatial Frequency [TV lines]

Line: CaliculatedDot: Measured

[%]

Pixel Aperture

Lens

Total

Limiting Resolution was

about 3200 TV Lines

Signal-to-Noise Ratio

HDTV

format

Extracted 1/16 from 8k x 4k pixel video,

and converted into 1080/60i format

200%Dynamic range

2000 lux, F2.8

Approx. 45dB (on HDTV format)

Sensitivity

SNR

Measurement

Result

8k-video

Noise Meter

Location Shooting

Exhibited at EXPO2005

1.56 million people visited

the theatre during 185 days

“Hi-Smile” AttractionAudience are shot in the waiting

area, and the video is then

reproduced on the screen when

they enter the theatre

-

260 Km 24Gbps

Uncompressed

Transmission Test

HDTV (2K-image)

SHV (8K-image)

-

-

Summary

“Super Hi-vision” camera system with 8k x 4k pixelswas developed

We also developed 8M-pixel CMOS digital imager,5x zoom lens, and a lateral chromatic aberrationcorrector

The limiting resolution was 3200 TV lines, and theSNR on HDTV format was approx. 45 dB under2000 Lux, F2.8, Dynamic range of 200 %

Various kinds of “Super Hi-Vision” programs havebeen performed: World Expo theater, livebroadcasting, long distance relaying, electricalzooming for HDTV, etc.