tools rhythm compmusicseminar · 14 dec, 2013 ajay srinivasamurthy akshay anantapadmanabhan,...
TRANSCRIPT
![Page 1: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/1.jpg)
Computational Tools for Rhythm Analysis
CompMusic Seminar, IIT Madras, Chennai, India 14 Dec, 2013
Ajay Srinivasamurthy
Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar
![Page 2: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/2.jpg)
Computational rhythm analysis
§ Rhythm § Musical events in time that group into patterns
§ Computational Tools § Understand temporal aspects of music
Patterns Structures
![Page 3: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/3.jpg)
Tasks
Onset Detection
Tāla Tracking
Segmentation
Rhythmic pattern extraction
Rhythmic similarity
Simple
Complex
![Page 4: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/4.jpg)
Tasks
Onset Detection
Tāla Tracking
Segmentation
Rhythmic pattern extraction
Rhythmic similarity
Simple
Complex
![Page 5: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/5.jpg)
Onset Detection
![Page 6: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/6.jpg)
Onset Detection
§ Many sources § Different spectral characteristics
![Page 7: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/7.jpg)
Onset Detection
§ Mridangam stroke onsets § Right and Left
![Page 8: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/8.jpg)
Pre-processing: Melody Suppression Original
Melody Suppressed
Jagadanandakaraka, Pure Expressions by Aneesh Vidyashankar
![Page 9: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/9.jpg)
Mridangam Onsets: Right
Jagadanandakaraka, Pure Expressions by Aneesh Vidyashankar
![Page 10: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/10.jpg)
Mridangam Onsets: Left
Jagadanandakaraka, Pure Expressions by Aneesh Vidyashankar
![Page 11: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/11.jpg)
Tāla Tracking
![Page 12: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/12.jpg)
Tāla recognition
![Page 13: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/13.jpg)
Tāla tracking
§ Tracking events in the tāla cycle § Akshara, beats, sama, edupu (of a composition)
§ Supervised
![Page 14: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/14.jpg)
Akshara period
§ Periodicity in onsets § Correct metrical level – aksharas
Aksharas
Onsets Tempogram
Ajay Srinivasamurthy, Xavier Serra, “A Supervised Approach to Hierarchical Metrical Cycle Tracking from Audio Music Recordings”, submiHed to ICASSP 2014.
Prior knowledge about Akshara
period
![Page 15: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/15.jpg)
Akshara tracking
Jagadanandakaraka, Pure Expressions by Aneesh Vidyashankar
![Page 16: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/16.jpg)
Where are the sama ?
Jagadanandakaraka, Pure Expressions by Aneesh Vidyashankar
![Page 17: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/17.jpg)
Tracking the sama
Jagadanandakaraka, Pure Expressions by Aneesh Vidyashankar
Model for tāla structure
Model for sama characteristics
![Page 18: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/18.jpg)
Learning the sama
Jagadanandakaraka, Pure Expressions by Aneesh Vidyashankar
Model for tāla structure
Need an audio collec,on with expert annota,ons
Model for sama characteristics
![Page 19: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/19.jpg)
Tāla tracking in Dunya
![Page 20: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/20.jpg)
The goal !
Svara raga sudha, Rendezvous with Legends, ChiRbabu (Veena) 2 kalai
![Page 21: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/21.jpg)
The goal !
Jaya Jaya, Maestro in Concert, Dr. M L Vasanthakumari
![Page 22: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/22.jpg)
Rhythm based similarity: Tāla
§ Listener participation § Structural Similarity
§ Based on components of a tāla
User feedback
Identify tāla components
Compute similarity measures
![Page 23: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/23.jpg)
Segmentation
![Page 24: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/24.jpg)
Structural segmentation: Concert
A part of a concert
Kriti
Tani āvartanam
Padi Sarala and Hema A Murthy, “Inter and intra segmentaWon of CarnaWc music recordings for archival,” in Proc. ISMIR 2013, Brazil.
![Page 25: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/25.jpg)
Structural segmentation: Kriti
Pallavi, Anupallavi, Charanam, Swaram, Niraval
![Page 26: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/26.jpg)
Rhythmogram
![Page 27: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/27.jpg)
Ragam-Tanam-Pallavi
![Page 28: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/28.jpg)
Percussion solo – Tabla
![Page 29: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/29.jpg)
Percussion solo
![Page 30: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/30.jpg)
Tani āvartanam transcription
Machine Learning Stroke Models
Thom
Tha Dheem
Strokes
Stroke Sequences Transcribed Strokes
Training Testing
![Page 31: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/31.jpg)
Akshay Anantapadmanabhan, Ashwin Bellur, Hema Murthy, “Modal Analysis and TranscripWon of Strokes of the Mridangam using Non-‐negaWve Matrix FactorizaWon”, in Proc. of 38th InternaWonal Conference on AcousWcs, Speech, and Signal Processing (ICASSP), 2013.
![Page 32: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/32.jpg)
Rhythmic patterns and similarity
![Page 33: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/33.jpg)
Discovery and representation
![Page 34: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/34.jpg)
Rhythm Similarity – Patterns
![Page 35: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/35.jpg)
In the future…
From Ninne NammiW, December Season 2007, Gayathri Girish
![Page 36: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/36.jpg)
From Ninne NammiW, PaddhaR -‐ K V Narayanaswamy & N Ramani, by K V Narayanaswamy & N Ramani, 2003
From Ninne Nammi Nanu, December Season 2003, O.S. Thyagarajan
![Page 37: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/37.jpg)
The question
From Ninne NammiW, PaddhaR -‐ K V Narayanaswamy & N Ramani, by K V Narayanaswamy & N Ramani, 2003
From Ninne Nammi Nanu, December Season 2003, O.S. Thyagarajan
?
![Page 38: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/38.jpg)
Carnatic Music Beat Station
Thank you!
![Page 39: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/39.jpg)
Extra slides
![Page 40: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/40.jpg)
Periodicity and Continuity
Sama tracking
§ Knowledge-based
Ajay Srinivasamurthy, Xavier Serra, “A Supervised Approach to Hierarchical Metrical Cycle Tracking from Audio Music Recordings”, submiHed to ICASSP 2014.
Onsets
Model for Tala structure
Audio features
Cycle Period
Possible locations
Sama Tracking
![Page 41: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/41.jpg)
Annotated Test Corpus
Ajay Srinivasamurthy, Xavier Serra, “A Supervised Approach to Hierarchical Metrical Cycle Tracking from Audio Music Recordings”, submiHed to ICASSP 2014.
Model for Tala structure
Audio features
Sama Candidates
Onsets
Sama Period
Sama Tracking
Need a test corpus with expert annota,ons
![Page 42: Tools Rhythm CompMusicSeminar · 14 Dec, 2013 Ajay Srinivasamurthy Akshay Anantapadmanabhan, Vinutha T Prasad, Vignesh Ishwar . ... Carnatic Music Beat Station Thank you! Extra slides](https://reader035.vdocuments.us/reader035/viewer/2022071405/60f9c2cee3a97722e669fc3c/html5/thumbnails/42.jpg)
Rhythm Similarity