the sight-reading tutor =&=4=c=d=f===9== - home |...
TRANSCRIPT
![Page 1: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/1.jpg)
The Sight-Reading Tutor
=&=4=C=D=f===9==Diane Hu, Jie Cheng, Lawrence Saul
![Page 2: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/2.jpg)
The Sight-Reading Tutor
=&=4=C=D=f===9==An Automatic Sight-Reading Tutor
For Solo Instrumental Music
![Page 3: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/3.jpg)
What is sight-reading?
Sight-reading is:
the ability to play unfamiliar music from a score
a learned skill, independent of technique and theory
rarely addressed in music education...
![Page 4: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/4.jpg)
What is sight-reading? ... but is an integral part of musicianship!
If you can sight-read, you can:
easily tackle new music pieces
participate in ensembles
accompany other musicians
perform on the fly!
![Page 5: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/5.jpg)
The Sight-Reading TutorLearning to sight-read is hard!
What would the ideal “sight-reading tutor” look like?
Provide immediate feedback
Work at your own pace and level
Monitor and quantify progress
Fun!
![Page 6: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/6.jpg)
The Sight-Reading Tutor
Using The Sight-Reading Tutor
1. Put machine near tuned instrument
2. Select a song based on difficulty, adjust tempo
3. Play notes as the score scrolls across the screen
4. Earn points for every note that is played correctly
![Page 7: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/7.jpg)
![Page 8: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/8.jpg)
![Page 9: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/9.jpg)
![Page 10: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/10.jpg)
![Page 11: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/11.jpg)
![Page 12: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/12.jpg)
![Page 13: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/13.jpg)
![Page 14: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/14.jpg)
Behind The Scenes
Formulate pitch recognition as a learning problem
Train system to recognize mono/polyphonic music:
Compute templates from audio clips of isolated notes
Use templates for real-time pattern matching
![Page 15: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/15.jpg)
Behind The Scenes
Non-negative Matrix Factorization (NMF):
An unsupervised learning algorithm for discovering constituent parts of complex objects
![Page 16: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/16.jpg)
Behind The ScenesOriginal application: modeling faces as a superposition of eyes, noses, mouths, and other features
Our application: modeling chords as a superposition of individual notes
![Page 17: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/17.jpg)
Reaching The Masses
Related (working) systems:
Automatic music transcription
Auto-accompaniment
Music classification
These are harder problems, but relevant only to a subset of musicians with specific needs
![Page 18: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/18.jpg)
Reaching The Masses
The Sight-Reading Tutor is needed by, and useful to a much larger population, from:
beginners to advanced
pianists to flutists
classical musicians to jazz musicians
![Page 19: The Sight-Reading Tutor =&=4=C=D=f===9== - Home | …cseweb.ucsd.edu/~dhu/docs/cosmal07_talk.pdf · What is sight-reading? Sight-reading is: the ability to play unfamiliar music from](https://reader031.vdocuments.us/reader031/viewer/2022022518/5b0cb5127f8b9ab7658b58dd/html5/thumbnails/19.jpg)
Impact & ContributionsIn music education:
Fulfills the criteria of an “ideal sight-reading tutor”
Getting good at the game = getting good at sight-reading
In computer audition:
Showcase a system with real-time capabilities
Apply NMF in a novel way