PISAProduction, Indexing and Search

of Audio-visual Material

Multi-touch 3D-set modelerPhilippe Bekaert, IBBT – EDM – UHasselt

28

PISA - Overview

Abstract

Information

Footage

Concept

Virtual

Model

Model Driven Development:

• Setting (Stage properties, light)

• Character

• Synthetic Speech

• Sound effects

• Character animation

• Virtual camera

VirtualModelling

AutomatedProductionRealisation

• Ingest

• Editing

• Mastering

• Reproduction to alternative distribution channels

Computer Assisted Design

Computer Assisted Manufacturing

Script Editing

• Parse scenario

• Shooting script editor

• Storyboard

Script Editing

Reverse Engineering

• Shot segmentation

• Video footprint and reuse detection

• Biometric face detection

• Background analysis

• Speech-to-text

Interpretation

• Character identification

• Background categorisation

and identification

• Topic and eventdetection

Intelligent Analysis and

Quantization

Quantization

Analysis

Indexing

Retrieval

• Timecode based indexing

• Geo-temporal reference

• Taxonomy based indexing and search

• Facetted search

Search Engine

Multi-Touch 3D Modeler

• Create and Manipulate

3D Shot descriptions:

• Setting, actors, props

• Cameras

• Microphones

• Lights

Animated

• Time-line

• MoCap character anim.

EyeTronics

• Text-to-Speech

Nuance

Export EDL/snapshots

AutoDesk 3DStudio Max

PowerProduction StoryBoard Artist

MovieSoft FrameForge3D

Antics

Unique Feature #1

SCOOP = Integrated System

Unique Feature #2

Multi-Touch Table Interaction

VIDEO