introduction to the stereoscopic player
DESCRIPTION
Introduction to the Stereoscopic Player. 3D Korea International Film Festival November 19th, 2011 Gwangju, South Korea. Overview. Stereoscopic Player Concept Input settings Output settings Supported formats Features Other 3dtv.at applications Stereoscopic Multiplexer - PowerPoint PPT PresentationTRANSCRIPT
3dtv
.at
Introduction to theStereoscopic Player
3D Korea International Film Festival
November 19th, 2011
Gwangju, South Korea
Peter Wimmer - 3dtv.at 2
Overview
Stereoscopic Player
Concept Input settings Output settings Supported formats Features
Other 3dtv.at applications
Stereoscopic Multiplexer MVC to AVI Converter
Peter Wimmer - 3dtv.at 3
About 3dtv.at
Focus
Stereoscopic video playback Stereoscopic video recording
Products
Stereoscopic Player
Stereoscopic Multiplexer
MVC to AVI Converter
Location
Linz, Austria www.3dtv.at
Timeline
Development started 2001
Completed diploma thesis in June 2004
Company founded in 2005
Stereoscopic Player
The Stereoscopic Player is a 3D video playback application for stereoscopic and multi-view videos on the Windows platform
Peter Wimmer - 3dtv.at 4
Peter Wimmer - 3dtv.at 5
3D Video Playback
The questions
Why do we need 3D playback software? Why not use any 2D video player?
The challenges
Many 3D display technologies Many 3D formats
The solution
Real-time format conversion 3D playback software
?!
Peter Wimmer - 3dtv.at 6
Real-Time Format Conversion
Real-time format conversion …
… avoids vast number of files … requires full color left and right views … gives best quality
Suitable source formats
Over/UnderSide-by-Side
Interlaced(Field Sequential)
L RLRLR
Dual Files/Stream
Peter Wimmer - 3dtv.at 7
Dual Files, Dual Streams
Dual files
Efficient use of multi processor systems Circumvent codec limitations (often limited to 1920 x 1080) Playback synchronization is prone to errors Performance problems when located on same media
Dual streams
Avoid performance problem of separate files 2D video players show the left video stream only Supported for Windows Media, MP4 and AVI formats Multi View Coding (MVC) removes redundancy
Stereoscopic Player Menues
Input settings
Stored per file
Different for each file
Output settings
Stored globally
Configured once
Peter Wimmer - 3dtv.at 8
Peter Wimmer - 3dtv.at 9
Format Selection
Stereoscopic Player asks the user to select the format when opening a new video
Stereoscopic Player remembers settings for each file in the built-in video library
Peter Wimmer - 3dtv.at 10
Stereoscopic Metadata
Fundamental idea
It is hard for users to find out the proper layout The content creator knows the proper layout Ship video files + format description (= metadata)
Stereoscopic Player …
… reads embedded metadata in Windows Media files … reads metadata file in same folder as the video file … contacts metadata server (turned off by default)
The official metadata server is maintained by 3dtv.at and provides settings for most commercial 3D-DVDs and some popular video files.
Peter Wimmer - 3dtv.at 11
Creating Stereoscopic Metadata
Use the Windows Media Stereo Attribute Editor to embed metadata in Windows Media files (available for download on the 3dtv.at website)
Click File|Export in Stereoscopic Player to create a separate metadata file (for all other formats than Windows Media)
Improve user experience – deliver your movies with metadata!
Stereoscopic Player Viewing Methods
Peter Wimmer - 3dtv.at 12
Peter Wimmer - 3dtv.at 13
Stereoscopic Player Viewing Methods
Anaglyphs
Shutter glasses
Polarized projection
Native supportAny graphics card, any display
NVIDIA 3D Vision / Quad Buffered OpenGLSoftware Pageflipping (ATI and Intel)
Dual Screen OutputQuad Buffered OpenGL
Peter Wimmer - 3dtv.at 14
Native Dual Screen Output
1. 2.
Peter Wimmer - 3dtv.at 15
Dual Screen Output via OpenGL
Requires professional graphics card (Quadro FX, FireGL) Graphics driver set to clone mode Normal 2D operation possible
Peter Wimmer - 3dtv.at 16
Stereoscopic Player Viewing Methods
HDMI 1.4 frame packing format
Via NVIDIA 3D Vision driverOnly 24 Hz at 1920 x 1080
Squeezed side-by-side format
Squeezed over/under format
View|Aspect Ratio|Half WidthTVs accept up to 60 Hz
View|Aspect Ratio|Half HeightIdeal for polarized TVs
Peter Wimmer - 3dtv.at 17
Stereoscopic Player Viewing Methods
3D-DLP-TVs
LCD displays with micro-polarizer
Checkerboard pattern natively supportViewed with shutter glasses
Interlaced pattern natively supportedViewed with circular polarized glasses
Autostereoscopic Displays
Do not require glasses
Two basic technologies
Lenticular lenses in front of the LCD panel Parallax barrier behind the LCD panel
Lenticular add-on lenses possible
Peter Wimmer - 3dtv.at 18
Types of Autostereoscopic Displays
Narrow viewing angle Only left and right view required
Wider viewing angle More than two views needed Image acquisition difficult Interpolation of images
planned for future player version
Peter Wimmer - 3dtv.at 19
Single Viewer Multi Viewer
Peter Wimmer - 3dtv.at 20
Stereoscopic Player Viewing Methods
Autostereoscopic single-viewer
Column Interlaced Tridelity SL Series 3D Display Sharp 3D Displays Generic Single-Viewer Display
Autostereoscopic multi-viewer
Tridelity MV Series Multi-Viewer Display Generic Multi-Viewer Display
More displays are added on request but are already supported by the generic viewing methods
Stereoscopic Player Viewing Methods
Peter Wimmer - 3dtv.at 21
Peter Wimmer - 3dtv.at 22
Stereoscopic Player Features
General features
File playback 3D-DVD playback Capture device support Intuitive user interface IR remote control support
Integration features
Command line control OLE Automation Serial Sony 9-pin protocol
Windows Media features
Streaming Digital Rights Management Multi-channel audio Multiple audio languages
Professional features
Customization tool Effect control (COM, UDP,
DMX512)
Supported File Formats
Video formats
Video for Windows (*.avi) Windows Media (*.wmv) Quicktime (*.mov) MPEG-1, MPEG-2 (*.mpg) Material Exchange Format (*.mxf) Third party DirectShow decoders
allow playback of additional format
Image formats
Windows Bitmap (*.bmp) JPEG (*.jpg, *.jps, *.mpo) GIF (*.gif), TIFF (*.tif), PNG (*.png)
Peter Wimmer - 3dtv.at 23
AVIAVI
MPGMPG
3D Blu-ray Playback
Stereoscopic Player plays *.ssif files No menu navigation yet (but planned) Third party decryption tool required
Peter Wimmer - 3dtv.at 24
Install AnyDVD HD Click File|Open File Go to the BDMV\
STREAM\SSIF folder Select largest file
MVC Playback
H.264 Multi View Coding (MVC) is the 3D video format of the future
MVC is used by 3D Blu-ray disks and the latest 3D camcorders
Player supports the MVC codec in *.mts (Sony) and *.mp4 (JVC) files
Peter Wimmer - 3dtv.at 25
H.264 Multi View Coding
MVC is an extension of the proven H.264/AVC industry standard
Saves approximately 50% of the right view's data rate
Exploits the correlations between the left and right views
Peter Wimmer - 3dtv.at 26
Effect Control
Control curtains, motion seats, lights, fog, water spray, …
Supports COM, UDP and DMX512 output
Effect data are stored in XML files with *.effx extension
Peter Wimmer - 3dtv.at 27
Effect Control File Example
<?xml version="1.0" encoding="UTF-8" ?>
<EffectStream>
<BytesSamples> <BytesSample sampleTime="00:00:00.000" text="First command" /> <BytesSample sampleTime="00:00:01.000" text="Second command" /> <BytesSample sampleTime="00:00:02.000" text="Third command" /> </BytesSamples>
<DmxChannels> <DmxChannel slotNumber="1" slotCount= "2" name="Sample Channel" /> </DmxChannels> <DmxSamples> <DmxSample sampleTime="00:00:00.000" channelIndex="1" value="x0102" /> <DmxSample sampleTime="00:00:01.000" channelIndex="1" value="x0304" /> <DmxSample sampleTime="00:00:02.000" channelIndex="1" value="x0506" /> </DmxSamples>
</EffectStream>
Peter Wimmer - 3dtv.at 28
Peter Wimmer - 3dtv.at 29
Stereoscopic Multiplexer Concept
Right stream Left stream
R L
Combined video stream
R L
Peter Wimmer - 3dtv.at 30
Fields of Applications
Live preview during recording
Stereoscopic Multiplexer loaded in Stereoscopic Player
Live broadcasts
Stereoscopic Multiplexer selected as capture device in Windows Media Encoder, running on the server
Stereoscopic Player running on the client
Watching 3D recording
Transferring left and right tape to hard disk not required Stereoscopic Multiplexer synchronizes tape drives
Peter Wimmer - 3dtv.at 31
Supported Hardware
Camcorders
DV camcorders HDV camcorders (next version)
Digital cameras
Industrial Firewire cameras Industrial USB cameras Webcams
Others
Analog cameras via frame grabbers Many other WDM-compatible capture devices
MVC to AVI Converter
Batch converter for MP4 (JVC) and MTS (Sony) MVC files
Peter Wimmer - 3dtv.at 32
Peter Wimmer - 3dtv.at 33
Thanks for Your Attention
Q&A
Visit us at http://www.3dtv.at!