fundamentals of music processing - audiolabs - home
TRANSCRIPT
![Page 1: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/1.jpg)
Fundamentals of Music Processing
Chapter 3: Music Synchronization
Meinard Müller International Audio Laboratories Erlangen
www.music-processing.de
![Page 2: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/2.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 2
Book: Fundamentals of Music Processing
Meinard Müller Fundamentals of Music Processing Audio, Analysis, Algorithms, Applications 483 p., 249 illus., 30 illus. in color, hardcover ISBN: 978-3-319-21944-8 Springer, 2015
Accompanying website: www.music-processing.de
![Page 3: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/3.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 3
Chapter 3: Music Synchronization
3.1 Audio Features 3.2 Dynamic Time Warping 3.3 Applications 3.4 Further Notes
As a first music processing task, we study in Chapter 3 the problem of music synchronization. The objective is to temporally align compatible representations of the same piece of music. Considering this scenario, we explain the need for musically informed audio features. In particular, we introduce the concept of chroma-based music features, which capture properties that are related to harmony and melody. Furthermore, we study an alignment technique known as dynamic time warping (DTW), a concept that is applicable for the analysis of general time series. For its efficient computation, we discuss an algorithm based on dynamic programming—a widely used method for solving a complex problem by breaking it down into a collection of simpler subproblems.
![Page 4: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/4.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 4
3 Music Synchronization Teaser
![Page 5: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/5.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 5
3 Music Synchronization Fig. 3.1
![Page 6: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/6.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 6
3 Music Synchronization Fig. 3.1
![Page 7: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/7.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 7
3 Music Synchronization Fig. 3.2
![Page 8: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/8.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 8
3.1 Audio Features Fig. 3.3
![Page 9: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/9.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 9
3.1 Audio Features Fig. 3.3
Time (seconds)
Freq
uenc
y (H
z)
![Page 10: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/10.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 10
3.1 Audio Features Fig. 3.3
Freq
uenc
y (p
itch)
Time (seconds)
![Page 11: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/11.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 11
3.1 Audio Features Fig. 3.3
Chr
oma
Time (seconds)
![Page 12: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/12.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 12
3.1 Audio Features Table 3.1
![Page 13: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/13.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 13
3.1 Audio Features Fig. 3.4
![Page 14: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/14.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 14
3.1 Audio Features Fig. 3.5
![Page 15: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/15.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 15
3.1 Audio Features Fig. 3.6
![Page 16: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/16.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 16
3.1 Audio Features Fig. 3.7
![Page 17: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/17.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 17
3.1 Audio Features Fig. 3.8
![Page 18: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/18.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 18
3.1 Audio Features Fig. 3.9
Time (seconds)
![Page 19: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/19.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 19
3.1 Audio Features Fig. 3.9
Time (seconds)
![Page 20: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/20.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 20
3.2 Dynamic Time Warping Fig. 3.10
![Page 21: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/21.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 21
3.2 Dynamic Time Warping Fig. 3.11
![Page 22: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/22.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 22
3.2 Dynamic Time Warping Fig. 3.11
![Page 23: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/23.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 23
3.2 Dynamic Time Warping Fig. 3.12
![Page 24: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/24.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 24
3.2 Dynamic Time Warping Fig. 3.13
![Page 25: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/25.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 25
3.2 Dynamic Time Warping Fig. 3.14
![Page 26: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/26.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 26
3.2 Dynamic Time Warping Fig. 3.15
![Page 27: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/27.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 27
3.2 Dynamic Time Warping Table 3.2
![Page 28: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/28.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 28
3.2 Dynamic Time Warping Fig. 3.16
![Page 29: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/29.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 29
3.2 Dynamic Time Warping Fig. 3.17
![Page 30: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/30.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 30
3.2 Dynamic Time Warping Fig. 3.18
![Page 31: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/31.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 31
3.2 Dynamic Time Warping Fig. 3.19
![Page 32: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/32.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 32
3.3 Applications Fig. 3.20
![Page 33: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/33.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 33
3.3 Applications Fig. 3.21
![Page 34: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/34.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 34
3.3 Applications Fig. 3.22
![Page 35: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/35.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 35
3.3 Applications Fig. 3.23
![Page 36: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/36.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 36
3.3 Applications Fig. 3.24
![Page 37: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/37.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 37
3.4 Further Notes Fig. 3.25
![Page 38: Fundamentals of Music Processing - AudioLabs - Home](https://reader030.vdocuments.us/reader030/viewer/2022012100/6169e07911a7b741a34c5a76/html5/thumbnails/38.jpg)
Meinard Müller: Fundamentals of Music Processing
© Springer International Publishing Switzerland, 2015
Chapter 3: Music Synchronization
Slide 38
3.4 Further Notes Fig. 3.26