clipster 3d/stereoscopy supplement user guide (version 5.5) · 2013-09-20 · 2 1 3 i 4 clipster...

CLIPSTER 3D/Stereoscopy Supplement User Guide (Version 5.5)

CLIPSTER3D/Stereoscopy

Supplement User Guide

Supplement User Guide: CLIPSTER 3D/StereoscopyDocument Version 5.5 for the CLIPSTER Software Version 5.5 and higher

Copyright © 2013 by Rohde & Schwarz DVS GmbH, Hanover. All rights reserved.

The manuals as well as the soft- and/or hardware described here and all their constituent parts are protected by copyright. Without the express permission of Rohde & Schwarz DVS GmbH any form of use which goes beyond the narrow bounds prescribed by copyright legislation is prohibited and liable to prosecution.

This particularly applies to duplication, copying, translation, processing, evaluation, publishing, and storing and/or processing in an electronic system.

Specifications and data may change without notice. We offer no guarantee that this documentation is correct and/or complete. In no event shall Rohde & Schwarz DVS GmbH be liable for any damages whatsoever (including without limitation any special, indirect or consequential damages, and dam-ages resulting from loss of use, data or profits, or business interruption) arising out of the use of or inability to use the hardware, software and/or manual materials.

Those parts of this documentation that describe optional software or hardware features usually con-tain a corresponding note. Anyway, a lack of this note does not mean any commitment from Rohde & Schwarz DVS GmbH.

CLIPSTER and DVS are registered trademarks of Rohde & Schwarz DVS GmbH.

Any other product names mentioned in this documentation may be trademarks or registered trade-marks of their respective owners and as such are subject to the usual statutory provisions.

2

1

3

I

4

CLIPSTER 3D/Stereoscopy Supplement User Guide

Introduction

Getting Started

Working with 3D Material

Generating 3D Material

Index

Headquarters:

Support:

Rohde & Schwarz DVS GmbHKrepenstr. 830165 HannoverGERMANY

Phone: +49-511-67807-0

Fax: +49-511-630070

E-mail: [email protected]

Internet: http://www.dvs.de

Phone: +49-511-67807-125

Fax: +49-511-371985

E-mail: [email protected]

mailto:[email protected]?subject=Followed Link in DVS Documentation

http://www.dvs.de

mailto:[email protected]?subject=Followed Link in DVS Documentation

i

CContents

1 Introduction ...............................................................................1-1

1.1 Overview .................................................................................1-2

1.2 Target Group ...........................................................................1-2

1.3 Conventions Used in this User Guide .....................................1-3

1.4 General Notes .........................................................................1-3

2 Getting Started .........................................................................2-1

2.1 Types of 3D Material ...............................................................2-2

2.2 Preparing the Edit Tool for 3D .................................................2-3

2.2.1 Preparing Two Separate Clips as 3D Material ...................2-3

2.2.2 Preparing Interleaved 3D Material ...................................2-4

3 Working with 3D Material ..................................................3-1

3.1 Merging and Unmerging Video Tracks ...................................3-2

3.1.1 Changing the Track Mode ...............................................3-2

3.1.2 Setting the Track Properties ............................................3-3

3.1.3 Particulars about Merging and Unmerging .......................3-3

3.2 Editing .....................................................................................3-6

3.2.1 Editing of a Stereo Track in the Timeline ..........................3-6

3.2.2 Effects for 3D ................................................................3-6

3.3 Subtitles in 3D .......................................................................3-10

3.3.1 Adding 3D to 2D Subtitles ............................................3-10

3.3.2 Using Depth-animated Subtitles ....................................3-11

3.4 Viewing and Playing Out .......................................................3-12

3.4.1 Configuring the Output Mode .......................................3-12

3.4.2 Configuring the Display ................................................3-13

3.4.3 Configuring the Output ................................................3-14

3.5 3D Tools ................................................................................3-16

3.5.1 Luma Difference ..........................................................3-16

3.5.2 Divergence Safety Area ................................................3-16

ii

Contents

3.5.3 Checkerboard ..............................................................3-18

3.5.4 3D RGB Histogram ......................................................3-18

3.5.5 3D Depth Histogram ....................................................3-19

3.6 Automatic Image Geometry Correction ................................3-21

3.6.1 Basics .........................................................................3-21

3.6.2 3D Auto Correction from the Timeline............................3-22

3.6.3 The Effects Operator for a 3D Auto Correction................3-24

3.7 Keyboard Shortcuts for 3D ....................................................3-26

4 Generating 3D Material ........................................................4-1

4.1 Finalizing 3D Material ..............................................................4-2

4.2 Recording 3D Material ............................................................4-3

I Index ............................................................................................... I-1

1-1

1Introduction

This document describes the 3D/stereoscopic workflow feature of CLIPSTER.

The 3D/stereoscopic workflow feature allows you to work with 3D ma-terial in CLIPSTER. The complete production chain from ingest over ed-iting to output/finalizing is supported.

With this you can easily record or import 3D material, add it to a time-line and then edit it: For example, you can control the depth of stereo-scopic images and mirror, color match or zoom and pan left and right eye streams independently. During all work the end result can be com-fortably controlled either in the video overlay or at the outputs of the DVS system.

Once your work is finished, you can finalize the 3D material in all pop-ular 3D methods (e.g. as separate clips, interleaved, anaglyph, side by side, etc.) or play it out via two separate HD-SDI or DVI outputs to feed two projectors or 3D monitors (also in all popular 3D methods).

1-2

Introduction

1.1 Overview

This user guide describes the possibilities and user interface items of the 3D/stereoscopic workflow feature of CLIPSTER.

The chapters in this user guide contain the following information:

1.2 Target Group

To use this manual and the 3D/stereoscopic workflow feature effective-ly, you should be familiar with the DVS soft- and hardware as well as the manuals delivered with the DVS system.

Chapter 1 Begins with a short introduction to the 3D/ste-reoscopic workflow feature, followed by a note regarding the audience this manual is written for and an explanation of the conventions used in this manual. Additionally, it details some general notes that you should observe.

Chapter 2 Describes the steps to get started using 3D ma-terial in CLIPSTER.

Chapter 3 Describes how to work with 3D material in the Edit Tool, for example, how to merge and un-merge video tracks or how to edit, view and play out 3D clips. Furthermore, it describes the various tools provided by the DVS software for an easy analysis and correction of 3D projects.

Chapter 4 Explains how to generate 3D material, i.e. how to finalize a project in 3D or how to record ma-terial in 3D.

Index This chapter facilitates the search for specific terms.

1-3

Introduction

1.3 Conventions Used in this User Guide

The following typographical conventions will be used in this documen-tation:

Texts preceded by this symbol describe activities that you must per-form in the order indicated.

– Texts preceded by this symbol are parts of a list.

1.4 General Notes

In the following you can find some general notes that may be helpful for your work with the 3D/stereoscopic workflow feature or this user guide:

Texts preceded by this symbol are general notes intended to fa-cilitate work and help avoid errors.

“ ” Texts enclosed by quotation marks are references to other man-uals, guides, chapters, or sections.

’Window’ Text in bold with single quotation marks indi-cates a window name

BUTTON Text in small caps and bold indicates a push but-ton

Menu Text in italic and bold indicates either a menu name or options in a menu list

Menu » Option In the specified menu select the stated item

Item Text in bold only stands for other labeled items of a user interface

Entry Parameters, selections or entries made in the program

For further details about user interface items not described in this document please refer to the other user guides delivered with the DVS system.

For the 3D/stereoscopic workflow there is also a hardware op-tion available allowing you to work, for example, with files in the REDCODE raw format. For further information about this please refer to the “CLIPSTER Edit Tool” user guide.

2-1

2Getting Started

This chapter describes the steps to get started using 3D material in the Edit Tool. First, the different types of 3D material that can be used in the DVS software will be described, followed by a description of how to prepare the Edit Tool for 3D depending on the type of material available to you.

2-2

Getting Started

2.1 Types of 3D Material

Stereoscopic material provides for each human eye a separate video stream (clip), commonly called left eye and right eye clip. They can be stored differently on a storage and the following two types of 3D mate-rial can be used in the DVS software:

– Two separate video clips (one for the left eye and one for the right eye).

– A single video clip that contains both eyes by interleaving the two video streams (interleaved video clip):

Figure 2-1: Interleaving of a 3D video clip

Depending on the type of material that is available to you, the DVS soft-ware has to be prepared differently (see section “Preparing the Edit Tool for 3D” on page 2-3).

The DVS software starts an operation for 3D (such as a finaliz-ing or playout) with the left eye clip as the first frame. However, by setting the right eye clip to be the left eye clip this behavior can be changed (see section “Merging and Unmerging Video Tracks” on page 3-2).

2-3

Getting Started

2.2 Preparing the Edit Tool for 3D

Depending on the type of material that is available to you (see section “Types of 3D Material” on page 2-2) the Edit Tool has to be prepared differently to be able to work in 3D. This section describes how to pre-pare the different types of 3D material.

2.2.1 Preparing Two Separate Clips as 3D Material

If two separate video clips are available as 3D material, you can add them to separate video tracks in the timeline of the Edit Tool and then merged these tracks to a single stereo track. For this perform the fol-lowing:

Add the two clips for the left and right eye to the bin, for example, by dragging them to the contents area of the bin from a file man-ager or by using the menu option Add clip… of the bin’s context menu.

Next configure the timeline to show a second video track, for exam-ple, via the timeline output settings or by using the menu option Track » Add on the context menu of a video track.

Add the video clips from the bin each to a video track in the time-line. It is recommended to add the left eye video clip to the first video track and the right eye video clip to the second video track.

Once this is done, the timeline of the Edit Tool will look similar to the following figure:

Figure 2-2: Left eye and right eye clip in the timeline

Then the two tracks can be merged to a single stereo track:

Either perform a click on one of the items labelled Single track or click on the triangle to the right and select from the drop-down menu the entry Stereoscopic 3D track.

After this the track properties window of the respective track will be displayed on the screen.

For further information about the track properties window and the track mode item see section “Merging and Unmerging Vid-eo Tracks” on page 3-2.

2-4

Getting Started

In this window activate the radio button Stereoscopic 3D track and configure the tracks according to where (in which track) you have added the respective clips.

When finished confirm your settings with the OK button.

This will merge the two video tracks to a single 3D stereo track in the timeline:

Figure 2-3: 3D stereo track in the timeline

Afterwards the preparations for two separate video clips as 3D material are finished and you can now start your work as described in chapter “Working with 3D Material” on page 3-1.

2.2.2 Preparing Interleaved 3D Material

When only a single video clip is available (i.e. an interleaved 3D clip), you have to alter its bin clip properties accordingly. Afterwards it can be added to a stereo track of the Edit Tool. For this perform the following:

Add the interleaved 3D clip to the bin, for example, by dragging it to the contents area of the bin from a file manager or by using the menu option Add clip… of the bin’s context menu.

Afterwards the interleaved clip will be visible in the contents area of the bin. However, because an interleaved clip is registered by the DVS soft-ware just as a normal clip you have to correct its properties to account for its 3D content:

Open the properties of the interleaved video clip in the bin (context menu of bin clip » Properties…).

Then the properties window of the bin clip will be displayed on the screen.

In this window configure the setting Stereoscopic Clip to Inter-leaved Stereo and confirm this with the OK button.

Figure 2-4: Configuring a clip to an interleaved clip

2-5

Getting Started

The clip will now be recognized by the DVS software as interleaved 3D material and, as a result, it can only be added to a 3D stereo track. Thus, you have to provide a 3D stereo track in the Edit Tool for it:

Configure the timeline to show a second video track, for example, via the timeline output settings or by using the menu option Track » Add on the context menu of a video track.


Figure 2-5: Two timeline tracks in the timeline

Then the two tracks can be merged to a single stereo track:

Either perform a click on one of the items labelled Single track or click on the triangle to the right and select from the drop-down menu the entry Stereoscopic 3D track.

After this the track properties window of the respective track will be displayed on the screen.

In this window activate the radio button Stereoscopic 3D track and configure the tracks so that track 1 is set to the left eye and track 2 to the right eye.

When finished confirm your settings with the OK button.

This will merge the two video tracks to a single 3D stereo track in the timeline.

Then add the interleaved video clip from the bin to the stereo track in the timeline.


Figure 2-6: 3D stereo track in the timeline

For further information about the track properties window and the track mode item see section “Merging and Unmerging Vid-eo Tracks” on page 3-2.

2-6

Getting Started

The left eye and right eye video streams interleaved in the clip are now accessible to the DVS software. With this the preparations for an inter-leaved clip as 3D material are finished and you can now start your work as described in chapter “Working with 3D Material” on page 3-1.

3-1

3Working with 3D Material

This chapter describes how to work with 3D material in the Edit Tool af-ter it has been prepared and added correctly to the timeline (see section “Preparing the Edit Tool for 3D” on page 2-3). First the items for merg-ing and unmerging video tracks will be described, followed by some particulars about this. After this it will be explained how to edit 3D clips, how to use subtitles for 3D material and how to view or play out 3D clips. Next the various tools provided by the DVS software will be de-scribed which can be used for an easy analysis and correction of 3D projects. The chapter will be concluded with a list of further keyboard shortcuts especially available for your work with 3D material.

3-2


3.1 Merging and Unmerging Video Tracks

As soon as two or more video tracks are displayed in the timeline (see also section “Preparing the Edit Tool for 3D” on page 2-3), they can be merged to a stereoscopic 3D track (stereo track) as well as unmerged.

3.1.1 Changing the Track Mode

To merge or unmerge two video tracks, you have to change its track mode. For this the track mode item right in front of a video track has to be used:

Figure 3-1: The track mode item

When clicking on the triangle to the right of the track mode item, a drop-down menu will be displayed which can be used to configure the tracks:

When clicking the track mode item directly, the properties window of the respective track will be displayed immediately (see section “Setting the Track Properties” on page 3-3).

Single track Configures the respective track to a standard single video track of the Edit Tool. If a 3D track already, it will be unmerged to two single tracks again, one containing the left eye clip and one the right eye clip. When unmerging a track con-taining an interleaved 3D clip, it will also be split into two separate clips (left and right eye).

Stereoscopic 3D track

Configures the respective track (and its partner track, if it was a 3D track before) to a 3D stereo track again. If the respective track has not been a 3D track yet, the properties window of the re-spective track will be opened (see section “Set-ting the Track Properties” on page 3-3).

3-3


3.1.2 Setting the Track Properties

When configuring a track that has not been a stereo track before to a stereo track or when clicking on the track mode item directly, the prop-erties window of the respective track will be opened:

Figure 3-2: The track properties window

With the track properties window you can set and change the proper-ties of a (stereo) track, for example, by assigning the streams. It pro-vides the following settings items:

Once everything is set correctly, you can confirm your settings by click-ing the OK button. The CANCEL button will close the properties window without altering the states of the track(s).

3.1.3 Particulars about Merging and Unmerging

There are several particulars that you should be aware of when merging and unmerging video tracks:

Single track Same as the option Single track of the track mode item (see section “Changing the Track Mode” on page 3-2).

Stereoscopic 3D track

When this option is activated, the tracks as in-dicated by the items Stream 1 and Stream 2 will be configured to a 3D stereo track. Select the partner track of the first stream (i.e. of the track where the properties window has been invoked) with the Track no. combo box of Stream 2. With the combo boxes to the right you have to assign the streams and determine which of the tracks contains the left and the right eye clip.

The DVS software starts an operation for 3D (such as a finaliz-ing or playout) with the left eye clip as the first frame. However, by configuring the track of the right eye clip to Left Eye this behavior can be changed.

3-4


Automatic Activation of Stereoscopic Output Mode

When video tracks are merged to a 3D stereo track, the stereoscopic output mode is automatically activated (button SETTINGS… of the time-line area, see section “Configuring the Output” on page 3-14) and it will remain activated for this project if not deactivated manually.

Interleaved Video Clips

A clip configured as an interleaved video clip can be added to a 3D ste-reo track only (see section “Preparing the Edit Tool for 3D” on page 2-3). Its two streams are then accessible to the DVS software. By unmerging a stereo track containing an interleaved video clip, the two streams can be accessed separately as two individual clips, one for the left and one for the right eye.

Track Numbers

The (first) number in front of a video track indicates the track number. If a second number is displayed with a plus sign in front, it details the respective partner track of this track (either if currently a 3D track or previously configured to one): <track no.>+<partner track no.>.

Synchronicity

When merging two video tracks to a 3D stereo track, the edit points of the timeline elements in both tracks must coincide, i.e. the timeline el-ements must be synchronous. If they are not synchronous, you will be informed about this and the respective elements will be particularly highlighted in the timeline area:

Figure 3-3: Error marked clips in the timeline area

To reset the highlighting, you can resolve the cause for this error and then merge the two tracks, or call the context menu of a video clip in the timeline and select the menu option Reset error status. After-wards the clips will be displayed with their normal color again.

3-5


No Partner Element

The complementary partner element of a left/right eye clip pair can be left out from the timeline, meaning timeline stretches on one of the tracks to be merged to a 3D track can be left empty. These tracks can still be merged to a 3D stereo track, as long as synchronicity is ob-served (see above). Then the timeline element without a partner will be duplicated and added to the empty track. When unmerging the track again, you will find instead of just one timeline element identical time-line elements in both tracks.

3-6


3.2 Editing

Once 3D material is properly prepared and available in the timeline of the Edit Tool (see section “Preparing the Edit Tool for 3D” on page 2-3), you can start editing it.

3.2.1 Editing of a Stereo Track in the Timeline

A stereo track available in the timeline area of the Edit Tool can be ed-ited the same way as any standard single video track. The timeline ele-ments on 3D stereo tracks can be, for example, cut or trimmed, or transitions can be applied. All editing work will be applied to both streams at the same time. For further information about this please re-fer to the “CLIPSTER Edit Tool” user guide.

3.2.2 Effects for 3D

Effects operators can also be applied to 3D video clips in a stereo track. They can be applied the same way as to clips in single video track.

However, in addition to effects that will provide the same features for single as well as 3D clips, there are some special 3D effects operators available: When applied to a 3D video clip, they will offer you indepen-dent settings for the left and right eye clip:

Figure 3-4: Independent effects settings for left/right eye clip

Via the tabs at the top of the settings pane of a 3D effects operator (timeline element properties) you can switch between the settings for the left and the right eye clip. They can be set independently to your lik-ing or to the same settings when the check box Sync mode is activat-ed. After activating the check box Sync mode the values of the current eye will be copied to the corresponding settings of the other eye. When the Sync mode is deactivated, the eyes can be modified individually.

Settings can also be copied from one eye to the other by using the option Opposite eye on the drop-down menu of the item Modify among the general items (left) of the properties area.

If a general modification affecting both eyes must be made in addition to individual modifications (or vice versa), a further op-erator of the same type can be applied to the clip, then per-forming the general modifications (or the individual ones).

3-7


When merging two video tracks with a different set of settings for a 3D effects operator, the effects operator will retain their individual settings for each eye for the timeline element in the stereo track. When unmerg-ing a stereo track, each timeline element will provide the 3D effects op-erator where the individual settings for each eye can be found.

The following effects are available as 3D effects operators:

– Zoom+pan – Flip+flop – 1st color correction – Operators of the effects group ’RAW’

The following describes the special features offered by 3D effects op-erators when added to a timeline element in a stereo track.

The Operator ’Zoom+pan’

The ’Zoom+pan’ effects operator is by default available for each video clip in the timeline. On a 3D video clip it provides in addition a setting to control the vergence:

Figure 3-5: Vergence settings

With the Vergence settings you can correct the depth of a stereoscop-ic image, i.e. you can adjust the zero parallax. When using the Ver-gence settings both eyes will be modified simultaneously regardless of the state of the Sync mode check box. The setting for vergence can-not be set differently between the two eyes.

The Operator ’Flip+flop’

On 3D video clips the effects operator ’Flip+flop’ is used mostly to cor-rect streams created by special stereo camera rigs. With it you can mir-ror the streams independently.

Some file formats provide metadata information about their arrange-ment on the camera rig when shooting in 3D. Such clips may receive the flip/flop operator automatically according to their metadata.

When merging two video tracks with standard effects opera-tors (not 3D effects operators) applied to the timeline elements, the effects operators will be copied from the elements of the first stream to the elements of the second stream.

The Vergence settings is linked to the Pan settings, i.e. when adjusting the vergence, the settings for panning will be altered as well and vice versa.

3-8


With the check boxes in the settings pane of the flip/flop operator you can mirror either the left or right eye clip according to your needs.

The Operator ’1st color correction’

The effects operator of the primary color correction is also available for 3D video clips.

When shooting in 3D with two cameras, the colorimetry of both eyes can slightly differ, even if the cameras are of the same model. Then it is important to adjust both eyes to an identical look by grading one eye separately from the other. For this you can apply a primary color correc-tion operator and color correct one eye to match it to the other one.

This can also be performed with the automatic color matching feature of CLIPSTER (context menu of timeline element » Color matching). To color correct one stream of a 3D video clip, it provides the setting Op-posite eye (valid for 3D clips only):

Figure 3-6: Window to configure an automatic color matching

Once this setting has been selected and confirmed with the button OK, the automatic color matching will analyze the opposite eye and apply a primary color correction operator to the 3D clip where the currently dis-played eye is color corrected.

After a color matching of the two eyes has been performed, the final look for a scene/clip can be achieved by applying another primary color correction operator on top and using it with Sync mode activated.

Effects Group ’RAW’

Most operators of the effects group ’RAW’ are 3D effects operators, e.g. the ’ALEXA RAW decode’ or ’R3D RAW decode’ operator. They can be used the same way as, for instance, the primary color correction operator, but may not be real-time capable.

Each setting of these effects operators provides the possibility to be copied to the opposite eye (in case of a 3D clip) or to a certain range of

3-9


clips in the timeline. This applies also to the settings of sliders or the states of buttons.

Figure 3-7: Context menu of an operator of the ’RAW’ effects group

To transfer a certain value or button state to the opposite eye or other clips in the timeline, select the corresponding option in the context menu (right-click the element whose value should be transferred).

3-10


3.3 Subtitles in 3D

Subtitles (integral texts or images) can be used in 3D as well. For this you can either equip 2D subtitles with depth information in the DVS software or you can use 3D subtitles, i.e. depth-animated subtitles, which will provide the depth information automatically.

This section describes how to equip subtitles with depth information or how to use depth-animated subtitles.

3.3.1 Adding 3D to 2D Subtitles

The 3D/stereoscopic feature can be used for 2D subtitles (subtitles without any depth information) as well. Once such a subtitle file (XML or MXF) has been added to a 3D stereo track, 3D information can be added to the subtitles.

To facilitate the process of adding depth to subtitles, CLIPSTER can au-tomatically calculate an appropriate parallax for the subtitles. For this perform the following on a subtitle timeline element present in a 3D ste-reo track:

On the subtitle timeline element perform a right-click of the mouse to call up its context menu.

Select in the submenu 3D the menu option Automatic subtitle depth estimation.

Then the automatic subtitle depth estimation performs a rough setup of the parallax of the subtitles. After this it is recommended to check the resulting parallax and to correct it manually if required:

Display the subtitle’s timeline element properties either by double-clicking the subtitle timeline element in the timeline or by selecting Show » Effect properties from its context menu.

Select one or more subtitles and modify the setting items Z position that can be found among the Position settings. They can be used to manually adjust the 3D effect of the selected subti-tle(s):

Figure 3-8: Z-position setting of subtitles

For further information about how to work with and use subti-tles in general see the “CLIPSTER DCI Mastering” supplement user guide.

3-11


3.3.2 Using Depth-animated Subtitles

Depth-animated subtitles are also supported in the CLIPSTER software. These subtitle files already contain the required depth information via a variable z-position that determines the position of the subtitles along the z-axis and the DVS software accurately moves the subtitles. This enables the subtitles to flow back and forth in the depth of the 3D im-ages together with the scene.

To use such a subtitle file, you have to add it to a 3D stereo track in the timeline. Afterwards it can be used same as any normal subtitle file.

However, the settings items for the z-position among the Position set-tings (see section “Adding 3D to 2D Subtitles” on page 3-10) will be different for a depth-animated subtitle. After one or more subtitles have been selected you will see the Z offset settings items instead of the Z position items:

Figure 3-9: Z-animation settings of subtitles

They and the settings items below them offer you the following possi-bilities:

Every time the parallax of the 3D material or the position of the subtitle changes, the z-position of the subtitle must be checked and readjusted if necessary.

Z offset These items determine the offset that will be added to the variable z-position specified in the subtitle file.

Use Z animation Turns on or of the variable z-position. When turned off you can set the Z position items will be displayed again instead of the Z offset items.

Inverse behaviour Reverses the effect of the variable z-position.

Z offset unit Allows you to specify the unit of the Z offset items (pixel or percent). However, for internal reasons pixel values cannot be translated di-rectly to percent and back, they have to be di-vided by 100: For example, a value of 19.2 pixels (for a clip in 1920 × 1080) is the same as 20% when the unit is set to percent.

3-12


3.4 Viewing and Playing Out

Your work on 3D material can be easily controlled via the video overlay or a monitor connected to the outputs of the DVS system. For example, an anaglyph emulation mode allows you to control the 3D depth of the material on the fly in the video overlay, and afterwards it can be played out in all common 3D methods.

This section explains how to configure and set up the display of the 3D material in the DVS software as well as at the outputs of the DVS sys-tem.

3.4.1 Configuring the Output Mode

To determine what will be displayed in the video overlay and at the out-puts of the DVS system, the output mode combo box has to be used:

Figure 3-10: The output mode combo box

The output mode combo box provides the following options:

This item will be available when the stereoscopic output mode is activated (see section “Configuring the Output” on page 3-14) and/or video tracks are merged to a 3D stereo track in the timeline.

Single stream When this option is selected, the 3D track in the timeline will be displayed as if it were a standard single video track. The video overlay as well as the outputs show all one stream of the 3D track only. You can select the stream that should be displayed with the left eye/right eye combo box (see section “Configuring the Display” on page 3-13).

output mode

3-13


3.4.2 Configuring the Display

What to display in the user interface of the DVS software can be con-figured with the left eye/right eye combo box:

Figure 3-11: The left eye/right eye combo box

Anaglyph red-cyan 0% saturation

Anaglyph red-cyan 100% saturation

These options combine the two streams of the 3D track to a single anaglyph stream for red/cyan glasses and display it in the video overlay as well as at the outputs of the system. You can choose between two saturations (0 or 100%) for the color of the 3D material.

Anaglyph red-green…

Same as Anaglyph red-cyan…, but the ana-glyph stream is for red/green glasses.

Side - by - side

Top - bottom

Interlaced

Blending

Checker board

Luma difference

These options combine the two streams of the 3D track to a single stream and display it in the video overlay as well as at the system’s outputs (e.g. for special 3D displays). You can choose between displaying the two images side by side, top/bottom, interlaced, blended together (left eye 75%, right eye 25%), in a checker-board pattern, or with their differences in lumi-nance shown. The Checker board and Luma difference options are available for an analysis of the two 3D streams (see section “3D Tools” on page 3-16).

Dual stream Displays the two streams of the 3D track inde-pendently at two different output ports of the system. The output ports can be configured with the timeline output settings (see section “Configuring the Output” on page 3-14). With this the control area (video overlay) shows both streams next to each other in two separate overlays.

left eye/right eye

3-14


With the left eye/right eye combo box you can select, depending on the setting for the output mode (see section “Configuring the Output Mode” on page 3-12), which of the streams to view in the video over-lay. Additionally, it controls whether the left eye or right eye stream/clip should be displayed by the representations of the video clips in the 3D track.

Furthermore, in the Single stream output mode it effects the signal displayed at the output ports of the DVS system (see section “Config-uring the Output Mode” on page 3-12).

3.4.3 Configuring the Output

Via the SETTINGS… button you can set up and configure the output of stereoscopic material as well as the output ports that should be used for this. It is located at the top left side of the timeline area.

After pressing this button the ’Timeline output settings’ window will be displayed on the screen. At the bottom of this window you can find the Options area where further optional settings are provided. To the right you can find the settings items for a configuration of the stereo-scopic output.

Figure 3-12: Configuring the stereoscopic output

With the check box of the Stereoscopic output settings you can turn on or off the stereoscopic output mode of the DVS system. It will be automatically activated when tracks are merged to a 3D stereo track in the timeline. When deactivated manually, a single stream of a 3D track will be shown in the video overlay as well as at the outputs of the DVS system only (same as the setting Single stream of the output mode combo box, see section “Configuring the Output Mode” on page 3-12).

By clicking the button 3D OUTPUT PORTS… the HD-SDI output ports of the DVS system can be configured. It opens the following window:

This item will be available when the stereoscopic output mode is activated (see section “Configuring the Output” on page 3-14) and/or video tracks are merged to a 3D stereo track in the timeline.

3-15


Figure 3-13: Configuring the output ports

In this window you determine on which of the HD-SDI output ports of the DVS system to give out the left eye and right eye stream of a 3D stereo track in the timeline when the output mode combo box is set to Dual stream (see section “Configuring the Output Mode” on page 3-12).

Once everything is set as wanted, the configuration of the stereoscopic output is complete and you can view the 3D material as configured via the HD-SDI outputs of the DVS system.

3-16


3.5 3D Tools

The DVS software provides a comprehensive tool set especially avail-able for 3D to analyze the effects of a stereoscopic project. All issues found can be easily resolved with, for example, the zoom and pan set-tings or the effects available for color correction (see section “Effects for 3D” on page 3-6). This section describes the various tools provided for the analysis of a 3D project.

3.5.1 Luma Difference

The luma difference view is one of the output modes of the DVS soft-ware (see Luma difference option in section “Configuring the Output Mode” on page 3-12). It shows you the differences between the lumi-nance of the two video streams (left and right eye) and can be used to examine the 3D effect of your project without additional glasses.

Figure 3-14: Luma difference output mode

The zero parallax or screen plane can be found where no elements ap-pear, i.e. those parts of the image that are uniformly grey. The elements of the images that can be seen in the luma difference view will appear either in front or behind the screen plane. By shifting the images of the two streams horizontally with the Vergence settings of the zoom and pan operator (see section “Effects for 3D” on page 3-6) you can relo-cate the screen plane and the elements of the images.

3.5.2 Divergence Safety Area

Depending on the width of the source image and the size of the display, a depth value can be calculated wherein all 3D objects of your project

3-17


should be located: the so called depth volume or depth budget. To check the depth budget, the DVS software provides the divergence safety. It can be activated/deactivated with the menu option Show di-vergence safety area on the context menu of the video overlay:

Figure 3-15: Activating the divergence safety area

Once activated, a grid will be displayed on the video overlay:

Figure 3-16: Divergence safety area

The distance between the lines indicates the safe parallax that should not be exceeded in order to avoid negative 3D effects for the audience. The safe parallax varies depending on horizontal image resolution and screen size. It can be calculated as follows:

Horizontal image resolution (px) / Screen size (in) × 2.5

3-18


You can set up the color and distance between the lines (in percent of the horizontal image resolution) via the Configuration Tool (group Over-lay).

3.5.3 Checkerboard

The checkerboard view is also one of the output modes of the DVS soft-ware (see Checker board option in section “Configuring the Output Mode” on page 3-12). It enables you to check possible color mismatch-es or vertical misalignments of two images of a 3D clip easily:

Figure 3-17: Checkerboard output mode

You can specify the square size (in pixels) via the Configuration Tool (group 3D output mode).

3.5.4 3D RGB Histogram

The 3D RGB histogram can be used to color correct stereo images. The 3D histogram overlaps the RGB histogram of both streams in a single diagram and clearly shows whether there is a color mismatch in the stereo images:

The setting for the divergence safety area must be adapted when either the timeline output resolution is changed or the size of the target screen that the 3D material is intended for.

3-19


Figure 3-18: 3D RGB histogram showing color mismatches

The 3D RGB histogram can be activated/deactivated via the context menu of the video overlay by selecting Analyzer » 3D RGB histogram. To use it, the output mode should be set to Dual stream (see section “Configuring the Output Mode” on page 3-12).

3.5.5 3D Depth Histogram

The 3D depth histogram can be used to monitor the compliance of depth limits for specific applications. It delivers a reliable visual repre-sentation of the 3D depth:

Figure 3-19: 3D depth histogram

3-20


The 3D depth histogram can be activated/deactivated via the context menu of the video overlay by selecting Analyzer » 3D depth histo-gram. To use it, the output mode should be set to Dual stream (see section “Configuring the Output Mode” on page 3-12). A graph in the left half of the diagram (negative values) means that objects are located in front of the screen plane, and a graph in the right half of the diagram shows that objects are behind the screen plane.

You can configure the depth histogram (e.g. the minimum/maximum threshold) via the Configuration Tool (group Overlay).

3-21


3.6 Automatic Image Geometry Correction

When shooting in 3D with two separate cameras, it can be difficult to set up the two cameras properly. To cope with such issues later, the DVS software provides an integrated tool that is able to analyze the ste-reoscopic content available in the timeline and correct geometry issues automatically. The 3D auto correction (also known as the stereoscopic analyzer STAN) will deal with problems such as scale mismatches, ver-tical offsets, rotation issues, or keystone distortions.

3.6.1 Basics

A 3D auto correction consists of two steps: First the analysis of the ste-reo material and then the rectification.

When a 3D auto correction is started, it will begin with an analysis where the key frames for the material are chosen and evaluated. If re-quired, this is followed by an automatic correction of most geometry is-sues. You will be informed about the progress of all this via a progress bar on the screen. Afterwards the key frames will be visually marked on the clip(s) of the timeline:

Figure 3-20: Key frames on clip in timeline

The geometry issues that have been corrected during this step (e.g. for scale mismatches and vertical offsets) have been virtually applied to the clip(s) via internally adjusted zoom and pan settings. During playout they will be applied to the clip(s) on the fly in real time.

When performing a 3D auto correction that should correct warping (keystone distortions) as well, the material must be prerendered after the 3D auto correction to finally apply the corrections.

At any time after an analysis you can adapt the basis for the corrections, i.e. the key frames that will be taken as a basis. Each analyzed video clip in the timeline receives during an analysis an additional effects operator for the key frames and the corrections that should be performed:

3-22


Figure 3-21: Effects operator for 3D auto correction

With its effects settings the basis for the corrections can be changed easily. However, if keystone distortions were corrected as well, a new prerendering is required.

3.6.2 3D Auto Correction from the Timeline

For an analysis of one or more clips in a 3D stereo track you can start the 3D auto correction from the timeline:

Select the clips that should be corrected directly from the timeline.

Then select from the context menu of a clip in the submenu of the menu option 3D the option Auto correction.

Then, a dialog window will be displayed on the screen:

Alternatively, with the menu option 3D auto correction on the context menu of the timeline scale you can start an analysis of all clips on the timeline. It will use the uppermost unlocked vid-eo track of the timeline and can be limited to a range of the timeline by setting the timeline’s in- and outpoint.

3-23


Figure 3-22: Automatic correction of 3D geometry issues

For the analysis of the stereo material you have to define a number of frames that should be analyzed per clip (Number of key frames). The higher the number of key frames, the longer the analysis will take.

By activating the check box Perform scene detection of the Analysis settings you can initiate a scene detection prior to the analysis. If this is performed with an automatic splitting at scene markers, you will get a more accurate analysis, because the number of key frames will be ap-plied to each split scene.

For the Rectification type you can select between Static and Dynam-ic. When Static is selected, the correction will be performed on the av-erage of all existing key frames. With Dynamic selected, it will be made either by using the first and last key frame or by using all key frames separately as a basis. The dynamic rectification is recommended if there is a tracking shot in the scene.

With the settings under Rectification mode you determine what to correct for the stereo clip. For simple geometry issues such as scale or rotation the setting 3D geometry correction only can be used. The set-ting with warping correction will rectify keystone distortions as well. However, this setting is comparatively slow because to finally apply the keystone correction, a prerendering is required.

Once the settings of this window are confirmed with the button OK, the analysis will be started. When finished, each analyzed clip will provide the effects operator for 3D auto correction in the effects list of its time-

3-24


line element properties. If required, the simple geometry issues have been corrected as well.

3.6.3 The Effects Operator for a 3D Auto Correction

Each video clip analyzed for a 3D auto correction receives the effects operator ’3D auto correction’ (see section “Basics” on page 3-21). It can be used to specify the basis of the analysis further.

Figure 3-23: The settings of the 3D auto correction effects operator

The settings provided by the operator ’3D auto correction’ are almost the same as the ones of the window to set up the automatic correction from the timeline (see section “3D Auto Correction from the Timeline” on page 3-22). The following details the settings that are provided by the effects operator in addition:

By clicking the button ANALYZE at the bottom of the Analysis settings you can start an analysis of the clip. Alternatively, it also provides a drop-down menu (triangle to the right) that can be used to apply the analysis to all clips of the timeline (All clips), to all that are located pre-

With Dynamic selected good key frames will be visually marked on the clip in blue and bad ones in red (see also section “The Effects Operator for a 3D Auto Correction” on page 3-24).

To initially start a 3D auto correction, you can also apply the ef-fects operator for a 3D auto correction to a clip in the timeline directly. An analysis can then be started with the button ANA-LYZE as described below.

Only one 3D auto correction operator can be added to the ef-fects list of a clip.

The item Modify below the effects list just copies the effects operator including the key frames to other clips.

3-25


viously on the timeline (All before) or to all clips that succeed it on the timeline (All after).

The setting Rectification based on the customized key frames of a Dynamic rectification (right of the settings pane) allows you to perform a correction based on manually defined key frames. The list below this setting lists all the key frames that have been chosen for the clip, their position and quality.

The quality of the key frames depends on the source material. In some cases, the information delivered by the analysis are not sufficient for a rectification. Such low-quality key frames are then labelled ’Bad’ in the list and can lead to a wrong correction. For a dynamic rectification it is recommended to remove the low-quality key frames by selecting and deleting them with the button DEACTIVATE. Then they will not be eval-uated during rectification.

To use the settings for a rectification, an analysis must have been per-formed earlier (key frames must be available). Then, as soon as you se-lect a setting of the group Rectification settings, it will be immediately applied to the clip. No confirmation or further analysis is needed. This way you can easily adjust the basis for the corrections (key frames) to your needs.

3-26


3.7 Keyboard Shortcuts for 3D

When working with 3D material in the Edit Tool, there are several spe-cial keyboard shortcuts available:

Action Shortcut

Slip left eye one (1) frame forward [Ctrl + .]

Slip left eye one (1) frame backward [Ctrl + ,]

Slip left eye ten (10) frames forward [Ctrl + /]

Slip left eye ten (10) frames backward [Ctrl + M]

Slip right eye one (1) frame forward [Alt + .]

Slip right eye one (1) frame backward [Alt + ,]

Slip right eye ten (10) frames forward [Alt + /]

Slip right eye ten (10) frames backward [Alt + M]

Merge/unmerge 3D stereo tracks (when such tracks have been created)

[Shift + E]

Toggle between left/right eye in Single stream mode (does not affect the output)

[Shift + W]

Activate Single stream output mode for left eye

[Shift + A]

Activate Single stream output mode for right eye

[Shift + S]

Activate Dual stream output mode [Shift + D]

4-1

4Generating 3D Material

In this chapter it is explained how to generate 3D material with the DVS system and its software. It will be explained how to finalize a project in 3D and how to record material in 3D.

4-2


4.1 Finalizing 3D Material

3D material can be created via a finalizing. For this your content must be appropriately prepared with the video data in 3D stereo tracks (see section “Preparing the Edit Tool for 3D” on page 2-3). Then it can be fi-nalized in 3D.

In the finalize dialog you can find among the optional items for a video output the setting Stereoscopic output:

Figure 4-1: Configuring the stereoscopic output for a finalizing

To create stereoscopic content via finalizing, the check box of the Ste-reoscopic output setting must be activated. With the combo box to the right you can then configure the output format of the 3D material. The following settings are available:

With the Stereoscopic output setting activated the material will be fi-nalized according to your configurations once the finalizing is initial-ized.

3D Interleaved stream

The 3D stereo track will be finalized into an in-terleaved clip (see section “Types of 3D Materi-al” on page 2-2).

3D Dual stream Two separate clips, one for the left eye and one for the right eye, will be created.

3D Anaglyph R/C stream...

The two streams of the 3D track will be com-bined to a single anaglyph stream for red/cyan glasses and then finalized to a clip. There are two settings available for this that can be used to select the saturation of the images’ colors (0 or 100%).

3D Anaglyph R/G stream...

Same as 3D Anaglyph R/C stream..., but the anaglyph stream is for red/green glasses.

3D Single stream...

The two streams of the 3D track will be com-bined to a single stream and then finalized to a clip. You can choose between finalizing the two images side by side, top/bottom or interlaced.

4-3


4.2 Recording 3D Material

With the DVS software you can also capture 3D material. This has to be performed in the I/O Tool software module of the DVS software. When configuring the input format, you can find sorted under the video for-mat type ’Other’ (button OTHER) several rasters tagged with ’STEREO’ in the column ’Group’:

Figure 4-2: Configuring an input

These video rasters can be used to record a 3D dual stream. The two streams must be available at the input ports of the DVS system (HD-SDI input ports A/B and C/4 (dual link; in single link ports A and B only)). The left eye will be captured at the ports A/B and the right eye at C/4 (dual link; in single link ports A and B only). Once the video format set-tings are confirmed the combo box Stereoscopic output among the general settings for the record operation (storage information) will be available:

Figure 4-3: Configuring the stereoscopic output for a record

With it you can configure the format of the recorded 3D material (i.e. interleaved vs. dual stream, see section “Finalizing 3D Material” on page 4-2 and section “Types of 3D Material” on page 2-2).

4-4


With this the two streams will be captured according to your settings as soon as the record operation is started.

I-1

IIndex

Numerics

2D subtitle .....................................3-103D anaglyph R/C stream ......... 3-13, 4-23D anaglyph R/G stream ......... 3-13, 4-23D auto correction ..........................3-21

effect ............................. 3-21, 3-24from timeline ............................3-22

3D depth histogram ........................3-193D dual stream ................ 3-13, 4-2, 4-33D effects ........................................3-63D interleaved clip 2-2, 2-4, 3-4, 4-2, 4-33D RGB histogram .........................3-183D single stream .................... 3-13, 4-23D subtitle .....................................3-103D tools .........................................3-163D track ................................... 3-2, 3-3

configuration ..............................3-2editing .......................................3-6empty timeline stretch ................3-5merging ............................. 3-2, 3-3properties ..................................3-3synchronicity ..............................3-4track number ..............................3-4unmerging ......................... 3-2, 3-3

3D/stereoscopic workflow .................1-1

A-C

ALEXA RAW decode ........................3-8anaglyph red/cyan .................. 3-13, 4-2anaglyph red/green ................. 3-13, 4-2analysis ............................... 3-21, 3-23animated subtitle ............................3-11auto correction (3D) ........................3-21

effect ............................. 3-21, 3-24from timeline ............................3-22

automatic color matching .................3-8automatic subtitle depth estimation .3-10blending ........................................3-13

button3D Output ports .......................3-14Analyze ....................................3-24Deactivate ................................3-25Other .........................................4-3Settings ...................................3-14

capturing .........................................4-3chapter overview ..............................1-2checkerboard ........................3-13, 3-18clip

effect .........................................3-6interleaved .... 2-2, 2-4, 3-4, 4-2, 4-3left eye/right eye . 2-2, 2-3, 3-13, 4-3preparation .........................2-3, 2-4separate ............... 2-2, 2-3, 4-2, 4-3

color correction ................................3-8automatic ..................................3-8histogram ................................3-18

color matching .................................3-8configuring

capturing ...................................4-3display .....................................3-13finalizing ....................................4-2output .....................................3-14output mode ............................3-12tracks ........................................3-2

conventions of user guide .................1-3

D-F

depth budget .................................3-17depth histogram .............................3-19depth volume .................................3-17depth-animated subtitle ..................3-11display configuration ......................3-13divergence safety area ....................3-17dual stream ...........................3-13, 3-15

capturing ...................................4-3finalizing ....................................4-2

editing .............................................3-6

I-2

Index

effect ...............................................3-63D auto correction .......... 3-21, 3-24for 3D ........................................3-6left eye .......................................3-6right eye ....................................3-6sync mode .................................3-6

empty timeline stretch ......................3-5error status ......................................3-4

reset ..........................................3-4finalizing ..........................................4-2flip/flop ............................................3-7

metadata ...................................3-7

G-I

geometry .......................................3-21HD-SDI .................................. 3-14, 4-3I/O Tool ...........................................4-3input format .....................................4-3interlaced ............................... 3-13, 4-2interleaved clip .................. 2-2, 2-4, 3-4


J-L

key frame ............................ 3-21, 3-23customized ..............................3-25good/bad ....................... 3-24, 3-25

keyboard shortcuts .........................3-26keystone distortion ............... 3-21, 3-23left eye .................... 2-2, 2-3, 3-13, 4-3

effect .........................................3-6mirror ........................................3-7output ......................................3-12

luma difference .................... 3-13, 3-16

M-O

merging tracks ......................... 3-2, 3-3metadata (flip/flop) ...........................3-7mirror left/right eye ...........................3-7Modify .............................................3-6monitor .........................................3-12MXF (subtitle) ................................3-10notes ...............................................1-3number of track ...............................3-4operation (start of) .................... 2-2, 3-3opposite eye ............................ 3-6, 3-8output ................................. 3-12, 3-14

HD-SDI ....................................3-14left eye .....................................3-12right eye ..................................3-12

output configuration .......................3-14output mode ...........................3-4, 3-14

configuration ............................3-12overview of chapters ........................1-2

P-R

pan .................................................3-7preparing

interleaved clip ...........................2-4separate clips .............................2-3

primary color correction ....................3-8automatic ..................................3-8

properties of track ............................3-3R3D RAW decode ............................3-8raster (STEREO) ...............................4-3raw (effects group) ...........................3-8rectification ...........................3-21, 3-23resetting error status ........................3-4right eye .................. 2-2, 2-3, 3-13, 4-3

effect .........................................3-6mirror ........................................3-7output .....................................3-12

rotation ..........................................3-21

S-T

safe parallax ...................................3-17saturation (anaglyph) ...............3-13, 4-2scale mismatch ..............................3-21screen plane .........................3-16, 3-20separate clips ............................2-2, 2-3


shortcuts .......................................3-26side by side .............................3-13, 4-2single stream .................................3-12

3D ....................................3-13, 4-2single track ...............................3-2, 3-3STAN ............................................3-21start of operation (3D) ................2-2, 3-3STEREO (raster) ...............................4-3stereo track ......................................3-2

see 3D trackstereoscopic 3D track ................3-2, 3-3stereoscopic output mode .......3-4, 3-14subtitle ..........................................3-10

2D to 3D ..................................3-10automatic depth estimation .......3-10depth-animated ........................3-11z-offset ....................................3-11z-position .................................3-10

sync mode (effect) ............................3-6synchronicity ...................................3-4

I-3

Index

target group .....................................1-2timeline output settings ........ 3-13, 3-14tools (3D) .......................................3-16top/bottom ............................ 3-13, 4-2track mode item ....................... 3-2, 3-3track number ...................................3-4track properties window ...................3-3typographical conventions ................1-3

U-Z

unmerging tracks ..................... 3-2, 3-3variable z-position ..........................3-11

vergence ................................3-7, 3-16vertical offset .................................3-21video input format ............................4-3video overlay ........................3-12, 3-14warping .........................................3-23XML (subtitle) ................................3-10z-animation ....................................3-11zero parallax

see screen planez-offset (subtitle) ............................3-11zoom and pan .........................3-7, 3-21z-position (subtitle) .........................3-10

variable ....................................3-11

clipster 3d/stereoscopy supplement user guide (version 5.5) · 2013-09-20 · 2 1 3 i 4 clipster...

Documents