music information retrieval(mir) - audiolabs-erlangen.de · music processing analysis (mpa) lecture...
TRANSCRIPT
Music Processing Analysis (MPA)Lecture
Meinard Müller
Overview
International Audio Laboratories [email protected]
Music
Music Information Retrieval (MIR)
Sheet Music (Image) CD / MP3 (Audio) MusicXML (Text)
Music Film (Video)
Dance / Motion (Mocap) MIDI
Music Literature (Text)Singing / Voice (Audio)
Music
Music Information Retrieval (MIR)
MusicMusicology
LibrarySciences
User Interfaces
Signal Processing
MachineLearning
Information Retrieval
Piano Roll Representation Player Piano (1900)
Time
Pitch
J.S. Bach, C-Major Fuge
(Well Tempered Piano, BWV 846)
Piano Roll Representation (MIDI)
Query:
Goal: Find all occurrences of the query
Piano Roll Representation (MIDI)
Matches:
Piano Roll Representation (MIDI)
Query:
Goal: Find all occurrences of the query
Music Retrieval
Query
Database
Hit
Bernstein (1962) Beethoven, Symphony No. 5
Beethoven, Symphony No. 5: Bernstein (1962) Karajan (1982) Gould (1992)
Beethoven, Symphony No. 9 Beethoven, Symphony No. 3 Haydn Symphony No. 94
Audio-ID
Version-ID
Category-ID
Music Synchronization: Audio-Audio
Beethoven’s Fifth
Music Synchronization: Audio-Audio
Time (seconds)
Beethoven’s Fifth
Orchester(Karajan)
Piano(Scherbakov)
Music Synchronization: Audio-Audio
Time (seconds)
Beethoven’s Fifth
Orchester(Karajan)
Piano(Scherbakov)
Application: Interpretation Switcher
Music Synchronization: Image-Audio
Imag
eAu
dio
Music Synchronization: Image-AudioIm
age
Audi
o
How to make the data comparable?
Imag
eAu
dio
How to make the data comparable?
Imag
eAu
dio
Image Processing: Optical Music Recognition
How to make the data comparable?
Imag
eAu
dio
Audio Processing: Fourier Analysis
Image Processing: Optical Music Recognition
How to make the data comparable?
Imag
eAu
dio
Audio Processing: Fourier Analysis
Image Processing: Optical Music Recognition
Application: Score Viewer Music Structure AnalysisExample: Zager & Evans “In The Year 2525”
Time (seconds)
Music Structure Analysis
Time (seconds)
Example: Zager & Evans “In The Year 2525”
Music Structure Analysis
V1 V2 V3 V4 V5 V6 V7 V8 OBI
Example: Zager & Evans “In The Year 2525”
Tempo Estimation and Beat Tracking
Time (seconds)
Example: Queen – Another One Bites The Dust
Basic task: “Tapping the foot when listening to music’’
Time (seconds)
Tempo Estimation and Beat Tracking
Example: Queen – Another One Bites The Dust
Basic task: “Tapping the foot when listening to music’’
Tempo Estimation and Beat Tracking
Light effects
Music recommendation
DJ
Audio editing
Audio Fingerprinting
Structure Analysis
Tempo and Beat Tracking
Fourier TransformAudio Features
Music ProcessingMusic Synchronization
Chord Recognition
Book: Fundamentals of Music Processing
Meinard MüllerFundamentals of Music ProcessingAudio, Analysis, Algorithms, Applications483 p., 249 illus., hardcoverISBN: 978-3-319-21944-8Springer, 2015
Accompanying website: www.music-processing.de
Book: Fundamentals of Music Processing
Meinard MüllerFundamentals of Music ProcessingAudio, Analysis, Algorithms, Applications483 p., 249 illus., hardcoverISBN: 978-3-319-21944-8Springer, 2015
Accompanying website: www.music-processing.de