Noctvrnal: audio in AR/VR is 51% of the experience
I had the amazing pleasure of interviewing Helena McGill and Anna Wozniewicz of
When I develop a VR experience, I usually give a lot of attention to the visual aspect, while I often leave the sound and music always
In this interview, you will discover why audio is so important and you will get also various insights on audio in immersive experiences and on the problems of being a woman working in XR. Have a nice reading!
What does your company
Noctvrnal do? What are you currently working on?
Currently, we are working on a number of VR experiences, a permanent public works installation in Denver, some experimental immersive theater pieces, a series of audio pod-plays, and a sensor-activated audio-reactive installation.
You are an audio designer… why do you think that audio design in an AR/VR application is important?
Audio in AR/VR is 51% of the experience. As in real life, when you look around, your field of view is limited, but you’re still hearing the full 360
Is it also important for enterprise applications or only for games and movies? Why?
Spatial audio is important for all AR/VR experiences. Research has shown that spatial audio keeps users in
We pull a lot from our research background in psychoacoustics in order to design effective auditory UX/UI for enterprise. This is especially important in the military, training, and therapy realms, and we draw from our background in psychoacoustics in order to design these systems.
So, how the audio for an AR/VR training experience should be designed? What pieces of advice can you give to us?
For any AR/VR experience, you want to keep psychoacoustics in mind – placing sounds in a way that will draw viewers’ attention, or making sure the sound effect’s duration is enough to hold their attention and allow them to locate the source. For example, sound sources are more easily located along a horizontal axis, but our brains have a harder time perceiving variations in height. Use each experience as R&D for the next one – every experience is different, so figure out what worked (and why), what didn’t, and how you can improve for the next one.
And what are the differences of designing the audio for an AR experience from designing it for a VR one?
Depends on the experience itself. The main difference in
Are you excited about the HoloLens 2? Why?
Very excited! We work a lot with enterprise and training, so the Hololens 2 is going to open up a lot of opportunities and potential for advancement in that sector.
How do you perform your work?
We like to be involved as early as possible in the script development process. That way, we can include audio triggers as part of the story and use them to direct the viewer’s attention. We capture audio on set for cinematic VR, create sound objects for game engine-based experiences, and work with ambisonics (sound fields). Our primary tools are DAWs, spatial audio plugins
What in your opinion still lacks from current AR/VR technology to make the audio fully realistic?
Biggest issue: many experiences are still not using spatial audio; it’s just in stereo. We’ve also found that spatial audio isn’t fully understood by the creative teams, or isn’t utilized to its fullest potential, i.e. to engage the user with the full 360-degree space.
Spatial audio SDKs are rapidly improving in terms of realism. However, the next step will be headsets that measure HRTFs in real time.
What is your opinion on the recent audio AR glasses like the ones by Bose?
They’re a great start and a huge step forward for spatial audio applications. They’re making spatial audio more accessible to everyone, and putting an emphasis on the audio side of things, rather than focusing on visuals first.
What is in your opinion the best AR and VR headset for what concerns the audio quality?
It really depends on the headphones you’re using with that headset. Standalone headsets, like the Oculus Go, have decent speakers built in, but oftentimes for demo purposes at crowded events, the noise floor isn’t taken into account.
There is a lot of buzz about diversity in augmented and virtual reality. You are a woman in XR. What do you want to say about the topic?
Being on the crossroads between three male-dominated industries (tech, entertainment, and audio) definitely isn’t easy.
We’ve had to expend a lot of energy on simply proving our worth before we’re taken seriously as audio engineers and treated as equals and collaborators. One of the biggest problems for women in XR, too, is access – most of the funding comes from men, so fewer women are getting funded than men, which creates a vicious cycle. We’ve found that our biggest projects and repeat clients come from fellow women in the XR space. Whether intentionally or not, women supporting women has been the biggest support system in immersive tech.
How do you envision the future for audio in XR?
The future of immersive tech and spatial audio lies in location
What about your future instead?
We’d like to continue pushing the boundaries of spatial audio and finding new ways to incorporate audio into experiences, whether they’re AR/VR, location-based, or completely experimental content. We are storytellers at heart, so we’re always looking for ways to challenge current techniques and use sound to convey stories in new, engaging ways.
I hope that you have loved this interview and that it has helped you in getting more insights on audio in Augmented and Virtual Reality experiences. And if you want to get to know better the fantastic girls at
Disclaimer: this blog contains advertisement and affiliate links to sustain itself. If you click on an affiliate link, I’ll be very happy because I’ll earn a small commission on your purchase. You can find my boring full disclosure here.