hands on: multimedia methods for large scale video analysis …fractor/fall2012/cs294-6-2012.pdf ·...
TRANSCRIPT
Hands On: Multimedia Methods for Large Scale Video Analysis (Project Meeting)
Dr. Gerald Friedland, [email protected]
1
Today
2
Today
2
• Quick Update
Today
2
• Quick Update• Answers to Questions
Today
2
• Quick Update• Answers to Questions• More on ICSI
Today
2
• Quick Update• Answers to Questions• More on ICSI• Some frameworks and tools to work
with sound
Today
2
• Quick Update• Answers to Questions• More on ICSI• Some frameworks and tools to work
with sound• Project discussion
Update: Amazon Glazier
3
More information:http://aws.amazon.com/glacier/
Q&A
4
Q&A
4
Why are we learning about audio in a VIDEO analysis class?
Q&A
4
Why are we learning about audio in a VIDEO analysis class?
- Video = Acoustic + Visual + Temporal Information
Q&A
4
Why are we learning about audio in a VIDEO analysis class?
- Video = Acoustic + Visual + Temporal InformationWhat to use depends on task, see example
Video Navigation
• Record• Store• Play• Random Seek• Annotate Manually
5
Navigation Capabilities: 1985
Video Navigation
• Record• Store• Stream• Play• Random Seek• Annotate Manually
6
Navigation Capabilities: 2010
Motivation
7
Yahoo! Video Segmentation Task of ACM Multimedia Grand Challenge 2009:
“Create navigation based on narrative elements”
Joke-O-Mat: Demo
8
More on ICSI
9
More on ICSI
9
DEMO
Audacity
10
Open Source wave editor and filter:http://audacity.sourceforge.net/
Wavesurfer
11
Open Source wave editor and filter, specialized for speech:http://www.speech.kth.se/wavesurfer/
Praat
12
Open Source speech experimental toolkithttp://www.fon.hum.uva.nl/praat/
Other useful tools
13
•sox -- command-line based audio filter and converter: http://sox.sourceforge.net/
•ffmpeg -- command-line based audio and videoconverter http://ffmpeg.org/
•MPlayer (mencoder) -- open source video player and converter: http://www.mplayerhq.hu/
More Tools: HTK
14
Open Source Speech Recognition Toolkit: http://htk.eng.cam.ac.uk/
More Tools: A nice collection of them
15
Princeton SoundLab:http://soundlab.cs.princeton.edu/software/
More Tools: BeamformIT
16
Open Source Beamformer: http://beamformit.sourceforge.net/
Project Discussion
17