informatikdienste / it-services 24/12/2015: terena 2008, olaf a. schulte, multimedia services eth...
TRANSCRIPT
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
Informatikdienste / IT-Services
REPLAY - Enhancing audiovisual recordings towards multimedia learning objectson a large scale
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
REPLAY - Enhancing audiovisual recordings towards multimedia learning objectson a large scale
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
Outline
• Status quo in lecture recording
• REPLAY – key features
• Future developments
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
Outline
• Status quo in lecture recording
• REPLAY – key features
• Future developments
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
Production: Content
• 12 lectures / week à 90 minutes 70%
• events (speeches, conferences etc.) 20%• promotional/informative films, misc. <5%• legacy, digitization (VHS, DVD, others) <5%
• > 500 objects in 2007
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
• audio & video (“classic”)• audio & content (“podcast”)
>80%• audio & video & content (“custom-made”)• audio (mp3, ogg)
Production: Formats
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
Production: Classroom setting
Webcam (Backup)
AMX (irrelevant)
Beamer
PlayMac
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
Production: PlayMac
power supply
audio levellerEpiphan
XLR
Mac mini
Géri Engler
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
Production: Signals
XLR audio
VGA out
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
Distribution: podcast.ethz.ch
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
Status quo: Shortcomings, limitations
• manual work• designed for podcast• no content-based access• no searchability• no standardization• no scalability• …
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
Solutions?
• Mediasite/SonicFoundry• Echo360 (Apreso Classroom/Anystream)• Lecturnity• PLAY (SWITCH)• Podcast Producer (Apple)• …
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
REPLAY: Overview
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
REPLAY: Workflow
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
REPLAY: Key features
• Providing access to the intellectual content of audiovisual material
• Freedom of choice in distribution formats and devices
• Possibility to access content many years from now
• Make audiovisual content learning objects
• Allow for academic citation of audiovisual content
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
REPLAY: Key technical features
• Scalability through distributed architecture
• Uses Java J2EE, mostly platform independent
• Plays well with external components, e. g. encoding engines
• Provides easily customizable workflows
• Employs standards (Dublin Core, MPEG-7, ...) wherever possible
• Adjusts to your needs through plugin architecture
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
REPLAY: Classroom
• Automated capture of VGA/ DVI- VESA modes- cross platform
• (Levelled) Audio • Automated camera tracking (DynaPel)
• No user interface• Scheduling via iCalender (rfc 2445)
• Non-contact recording
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
REPLAY: Classroom setting “PLAYMOBIL”
• GNU-/linux-based• Python• Unigraf capture
card• 4xvideo-in (Chipset
BT848)
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
REPLAY: User Interface
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
REPLAY: User Interface
Search
Static Metadata(Dublin Core)& Annotations
Timeline / isochronic
Search results(timeline-
based)
Player &Interactivecomponents
metadata (MPEG-7)
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
End-to-end solution
Automated production
Indexation
Archival
Searchability of objects
Interactive usage
Open
Scalable
Standardized Extensible
Platform-agnostic
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
Podcast Producer vs. REPLAY
Podcast Producer• production• encoding• publishing / distribution
• “archival” (H.264)
REPLAY• production• encoding• publishing / distribution
• long-term archival (H.264, DV)
• persistent identification (DOI)
• indexation• searchability
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
Podcast Producer vs. REPLAY
Podcast Producer• player
• proprietary
• Apple HW
REPLAY• user-interface
• open• standard-oriented
• Platform agnostic
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
REPLAY and e-learning
• Creation of teaching knowledge pool
• From TV-style consumption to interactive usage
• Personalized/customized learning experience• Collective enrichment (Wiki, Web 2.0)
• Turn audiovisual into learning object
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
REPLAY – the project
• REPLAY 0.3 released in April 2008
• REPLAY 1.0 will be operative at ETH by the end of 2008
• Lesser GNU General Public License (LGPL)
• replay.origo.ethz.ch (development platfform)
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
Further developments
• Integration of speech recognition• Isochronic tagging• Online editing• Ontology support• Accessibility
21/04/23: Terena 2008, Olaf A. Schulte, Multimedia Services ETH Zurich
• www.replay.ethz.ch
• replay.origo.ethz.ch