teaching ai to compose video game music · teaching ai to compose video game music. i am valerio...
TRANSCRIPT
![Page 1: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and](https://reader030.vdocuments.us/reader030/viewer/2022040917/5e91f67abbf1c2490d586e58/html5/thumbnails/1.jpg)
Teaching AI to compose video game music
![Page 3: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and](https://reader030.vdocuments.us/reader030/viewer/2022040917/5e91f67abbf1c2490d586e58/html5/thumbnails/3.jpg)
![Page 4: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and](https://reader030.vdocuments.us/reader030/viewer/2022040917/5e91f67abbf1c2490d586e58/html5/thumbnails/4.jpg)
![Page 5: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and](https://reader030.vdocuments.us/reader030/viewer/2022040917/5e91f67abbf1c2490d586e58/html5/thumbnails/5.jpg)
◍ Constrained and finite
◍ Visuals can’t be tightly scored
◍ Laborious composition and integration
Issues with human-composed VGM
![Page 6: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and](https://reader030.vdocuments.us/reader030/viewer/2022040917/5e91f67abbf1c2490d586e58/html5/thumbnails/6.jpg)
Video game music
![Page 8: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and](https://reader030.vdocuments.us/reader030/viewer/2022040917/5e91f67abbf1c2490d586e58/html5/thumbnails/8.jpg)
What does the Melodrive engine do?
Composition Performance ProductionEmotional
API MusicGame params
User input
![Page 9: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and](https://reader030.vdocuments.us/reader030/viewer/2022040917/5e91f67abbf1c2490d586e58/html5/thumbnails/9.jpg)
What doesn’t work
![Page 10: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and](https://reader030.vdocuments.us/reader030/viewer/2022040917/5e91f67abbf1c2490d586e58/html5/thumbnails/10.jpg)
![Page 11: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and](https://reader030.vdocuments.us/reader030/viewer/2022040917/5e91f67abbf1c2490d586e58/html5/thumbnails/11.jpg)
Challenges building Melodrive
◍ Music is ill-defined
◍ No ground truth
◍ Subjective assessment
![Page 12: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and](https://reader030.vdocuments.us/reader030/viewer/2022040917/5e91f67abbf1c2490d586e58/html5/thumbnails/12.jpg)
Reproducing the compositional process
![Page 13: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and](https://reader030.vdocuments.us/reader030/viewer/2022040917/5e91f67abbf1c2490d586e58/html5/thumbnails/13.jpg)
Modular AI approach
![Page 14: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and](https://reader030.vdocuments.us/reader030/viewer/2022040917/5e91f67abbf1c2490d586e58/html5/thumbnails/14.jpg)
Hybrid AI approach
![Page 15: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and](https://reader030.vdocuments.us/reader030/viewer/2022040917/5e91f67abbf1c2490d586e58/html5/thumbnails/15.jpg)
Takeaway lessons
● Deep learning isn’t always the solution
● Complex problems benefit from domain-rich representations
● Modular architectures work well with ill-defined problems
![Page 16: Teaching AI to compose video game music · Teaching AI to compose video game music. I am Valerio Velardo, PhD Cofounder & CEO @ Melodrive Hello!valerio@melodrive.com Constrained and](https://reader030.vdocuments.us/reader030/viewer/2022040917/5e91f67abbf1c2490d586e58/html5/thumbnails/16.jpg)
https://medium.com/the-sound-of-ai
@musikalkemist
valerio_velardo