Spatial Audio implementation
I think there is a chance to create novel, immersive experiences through spatial audio. while the APIs are limited (yet) we might approximate a 3D-audio environment (in headphones) by arranging the audio sources relative to the listener in binaural setups. gyro-data from a smart phone of the listener could trigger changes to the web-audio-API like https://webaudioapi.com/samples/spatialized/
We could offer different sound-scapes
- stage: audio feeds are arranged next to each other facing the same direction. audio coming from the audience is arranged in front of the stage, facing it
- conversation: audio feeds are arranged in a circle, the recipient is part of the circle
now, head movement is currently not available via API (fingers crossed for headphone data) but turning around with your phone in your pocket might already create a much more immersive feeling. close your eyes, stand still and you are standing in a virtual room. it has to be tested, how far the immersion remains in this workaround, but preliminary studies suggest a profound effect with actual psychological benefits to reducing stress in computer mediated communication.