voxeljs & web audio

6
VOXELJS & WEB AUDIO Janessa Det | @jandet

Upload: janessa-det

Post on 07-Jul-2015

509 views

Category:

Technology


1 download

DESCRIPTION

BrooklynJS lightning talk on adventures with VoxelJS & Web Audio and other Web Audio-related thoughts

TRANSCRIPT

Page 1: VoxelJS & Web Audio

VOXELJS & WEB AUDIOJanessa Det | @jandet

Page 2: VoxelJS & Web Audio

ZOMBIE-BATTLEPOCALYPSEHTTP://NODEKNOCKOUT.COM/TEAMS/SPACE-INVADERSHTTP://SPACE-INVADERS.2013.NODEKNOCKOUT.COM/

Page 3: VoxelJS & Web Audio

VOXEL-AUDIOHTTPS://GITHUB.COM/RYANRAMAGE/VOXEL-AUDIO

• positional audio

• configurable upon init

• no obvious exposure for movement of sound

• orientation was flipped (up vector should match voxel’s coord system)

AudioBufferNode PannerNode Destination

Page 4: VoxelJS & Web Audio

VOXEL-AUDIO FORKHTTPS://GITHUB.COM/JANDET/VOXEL-AUDIO/TREE/INTERACTIVE

• moveTo method to alter position upon avatar update

• orientation up vector fix (0, -1, 0) to (0, 1, 0)

• spec and compatibility updates

• make Gain configurable

NICE TO HAVE:

• exposure of raw node and context would enable more complex audio graph building

• auto bind position to voxel item w/ listeners on position movement

Page 5: VoxelJS & Web Audio

POSITIONAL-AUDIOHTTPS://NPMJS.ORG/PACKAGE/POSITIONAL-AUDIO

• Wrappers to make working with audio graphs and nodes easier (2D)

• Context

• Panning Sound

• Listener

• Directional Mixin

FUTURE IDEAS:

• Incorporate 3D properly

• Environmental convolution

• More clear how to build custom audio graphs upon it

• Format for transitioning “sheet music” to web audio nodes

Page 6: VoxelJS & Web Audio

THANKS!

caniuse: http://caniuse.com/audio-apispec: http://www.w3.org/TR/webaudio/

improvements?https://github.com/w3ctag/spec-reviews/blob/master/2013/07/WebAudio.md