a survey of tools for sonic and music visualization
DESCRIPTION
A Survey of Tools for Sonic and Music Visualization. Janet G. Lazar. Data Conveyed by Music. Pitch Dynamics Key Tempo Intellectual content Emotional content. Metadata About Music. Style Context Description of work Details about recording Details about collection. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/1.jpg)
A Survey of Tools for Sonic and Music Visualization
Janet G. Lazar
![Page 2: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/2.jpg)
Data Conveyed by Music
• Pitch• Dynamics• Key• Tempo• Intellectual content• Emotional content
![Page 3: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/3.jpg)
Metadata About Music
• Style• Context• Description of work• Details about recording• Details about collection
![Page 4: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/4.jpg)
Clusters of Visualization Tools
• Pitch rendering• Music transcription• Music analysis• Music illustration• Music discovery
![Page 5: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/5.jpg)
Pitch Rendering Tools
• AP Tuner (pitch matching for tuning)• Tarsos (pitch rendering for analysis)• Theta Music Trainer (vocal pitch matching)
![Page 6: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/6.jpg)
AP Tuner for Windows
• Frequency meter simulation
• Harmonics graph
![Page 7: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/7.jpg)
AP Tuner (more)
• Meter simulation: position, orientation, motion
• Harmonics graph: shape, color, continuity• Both: Good data-ink ratio, direct
manipulation, immediate feedback, linked displays
• Overall: Above-average visualization
![Page 8: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/8.jpg)
Music Transcription Tools
• Finale (commercial)• Finale Notepad (free)• Sibelius (commerical)• Noteflight (free, hosted online)• Noteflight Crescendo (commercial, online)
![Page 9: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/9.jpg)
Noteflight
![Page 10: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/10.jpg)
Noteflight (more)
• Music notation: position, orientation, shape, shading, stereo, proximity, similarity, continuity, connectedness, closure, containment; data-ink ratio maximized.
• Noteflight: motion, direct manipulation, immediate feedback, animate shift of focus, dynamic sliders
• Overall: excellent visualization
![Page 11: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/11.jpg)
Music Analysis Tools
• Hooktheory Analyzer (composing/learning)• Audacity (free music editor)• Melodyne (commercial music editor)• CLAM Chordata (chord structure analysis)
![Page 12: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/12.jpg)
CLAM Chordata
![Page 13: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/13.jpg)
CLAM Chordata (more)
• Uses every tool in the box except zoom, focus, and details on demand
• High data density, perhaps too high• Overall: very good tool
![Page 14: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/14.jpg)
Music Illustration Tools
• Music Animation Machine (clear, stable)• WhiteCap (customizable)• MAGIC (new, customizable)• Infinite Jukebox (beat relationship maps)• Baroque.me (harp-string emulation)
![Page 15: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/15.jpg)
Baroque.me
![Page 16: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/16.jpg)
Baroque.me (more)
• Uses position, size, shape, motion, and continuity
• Data-ink ratio high, data density low• Simplicity is appealing• Overall: good visualization
![Page 17: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/17.jpg)
Music Discovery Tools
• Affecticon (proposed sorting by emotion)• LivePlasma (node-link map for Amazon data)• TuneGlue (node-link map for last.fm data)• MusicBox (prototype scatterplot)• Hitlantis (interactive bubble map)• Tamas’s map (last.fm network representation)
![Page 18: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/18.jpg)
Tamas’s network map
![Page 19: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/19.jpg)
Tamas (more)
• Uses position, size, color, depth cues, proximity, and connectedness
• Provides direct manipulation, immediate feedback, animated focus shift, zoom, focus plus context, and details on demand
• Data density much too high to be useful• Nevertheless, a good beginning
![Page 20: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/20.jpg)
Conclusion
• Music visualization: a lively, growing field with a promising future
![Page 21: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/21.jpg)
Pitch Rendering Tools• AP Tuner for Windows (Version 3.08) [Software]. Available from
http://www.aptuner.com• Tarsos (2012) (Version 1.0) [Software]. Available from
http://tarsos.0110.be• Six, J. and Cornelis, O. (2011) Tarsos - A platform to explore pitch
scales in non-western and western music. 12th International Society for Music Information Retrieval Conference. Retrieved from http://ismir2011.ismir.net/papers/OS2-4.pdf
• Vocal Match [Online application]. Theta Music Trainer. Retrieved from http://trainer.thetamusic.com/en/content/vocal-match
![Page 22: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/22.jpg)
Music Transcription Tools
• Finale (2012) [Software]. Available from http://www.finalemusic.com
• Sibelius 7 [Software]. Available from http://www.sibelius.com
• Noteflight and Noteflight Crescendo [Online applications]. Retrieved from http://www.noteflight.com
![Page 23: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/23.jpg)
Music Analysis Tools
• CLAM Chordata 1.0 (2010) [Software]. Available from http://clam-project.org
• Hooktheory Editor [Online application]. Retrieved from http://www.hooktheory.com
• Audacity (2012) (Version 2.0.2) [Software]. Available from http://audacity.sourceforge.net
• Melodyne (Version 2) [Software]. Available from http://www.celemony.com
![Page 24: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/24.jpg)
Music Illustration Tools• Music Animation Machine Music Player (2006) [Software].
Available from http://www.musanim.com/player• WhiteCap (2011) [Software]. Available from
http://www.soundspectrum.com/whitecap• MAGIC: Multitrack Audio & Graphics Interactive Composer (2012)
[Software] Available from http://colorandmusic.com/home/• Lamere, P. (2012, November 11). The infinite jukebox [Web log
entry and online application]. Retrieved from http://musicmachinery.com/2012/11/12/the-infinite-jukebox
• Chen, A. (2011, October 26). Baroque.me: Bach Cello Suites No. 1, Prelude [Web log entry and online demonstration]. Retrieved from http://blog.chenalexander.com/2011/baroque-bach-cello
![Page 25: A Survey of Tools for Sonic and Music Visualization](https://reader035.vdocuments.us/reader035/viewer/2022062521/56816934550346895de089b4/html5/thumbnails/25.jpg)
Music Discovery Tools• Yoo, M. and Lee, I. (2011). Affecticon: Emotion-based icons for music
retrieval. IEEE Computer Graphics and Applications, 31(3), 89-95. doi:10.1109/MCG.2011.36
• LivePlasma [Online interactive map]. Retrieved from http://www.liveplasma.com
• TuneGlue [Online interactive map]. Retrieved from http://audiomap.tuneglue.net
• Lillie, A. (2008). MusicBox: mapping and visualizing music collections. Retrieved from http://thesis.flyingpudding.com
• Hitlantis [Online interactive map]. Retrieved from http://hitlantis.com• Tamas, N. (2008) [Web page and online interactive map]. Reconstructing
the structure of the world-wide music scene with Last.fm. Retrieved from http://sixdegrees.hu/last.fm