Spatial Audio format support for 360° Video Player VR Apps

More and more possibilities for an immersive audio experience mode can be seen – or better heard. Since different platforms sometimes require different spatial audio file formats, I want to give a brief overview of the current situation in terms of virtual reality sound.\ If you want to know more details, read my article about the pros and cons.

Be informed about new 360° audio formats

Updates

Update 2024/03

• Meta Quest 3: Works just like Meta Quest 2 and Oculus Quest, BUT with v62 to v63 Meta crashed something so I recommend not updating the device yet.

• Pico G3: Although I had big hopes, it didn’t show any sign of spatial audio with the files I tested. But it does have a feature to upmix stereo, just like Apple’s Spatialize Stereo, which is useless for 360 videos thought

• Apple Vision Pro: I was able to play back a Dolby Atmos File with the Gallery. Also the Spatial Video recorded with the devices contain multiple audio-tracks. More on that soon

Update 2021/12

• Pico Neo 2 and Pico Neo 3 Pro still don’t work, unfortunately. Currently testing with several devices and in contact with the team. Investigating workaround with surround sound instead of ambisonics.

• HTC Vive Focus 3 and Vide Flow also don’t work, but market the headset with “immersive spatial audio straight out of the box”, what the hell?

Update 2021/03:

• Pico Interactive does currently not support spatial audio. The playback of mkv is not smooth. Support for Pico G2 4k, Pico Neo 2, and Pico Neo 3 to be announced.

Update 2020:

• Support Oculus Quest and Oculus Quest 2 added to the Oculus Go section.

Update 2019/10:

• JauntVR and LittlstarVR who supported Dolby Atmos VR are now marked as offline

Update 2019/04:

• Due to popular requests, I added a headline for iOS devices, such as iPhone, iPad and iMac. Also: VeeR VR added to iOS devices for VR.

Update 2018/11:

• YouTube now supports an optional Head-Locked Stereo track similar to Facebook, but mapped to channel 5+6 while channel 1-4 remain First Order Ambisonic (FOA), Ambix

Update 2018/06:

• Oculus Go added. Oculus Video Player and Oculus Gallery allow watching videos made for YouTubeVR and FacebookVR offline as mp4 before uploading. SamsungVR Video works similarly to GearVR. Thanks to Angelo Farina for testing.

Update 2018/05:

• Samsung Gallery for GearVR claims to have “3D spacial sound”. You get a feel of head-tracked sound, but even if you load a stereo, it will create two sound objects in space which will rarely correspond with the visual.

• Oculus Video Player for GearVR both Two Big Ears and ambiX

Update 2018/04:

• Windows Mixed Reality Headsets (e.q. Samsung Odyssey) are supported by Vive Cinema via Viveport. Credits to GRID Lab at Ohio University. Vive Cinema is also supported by Oculus.

Update 2018/01:

• VideoLAN VLC Media Player (VLC 3.0 Vetinari) now supports higher order ambisonics

Update 2017/11:

• GoPro VR Player (former: Kolor 360° Video Player) now supports spatial audio!

• Mach1 Spatial Audio added to SamsungVR for GearVR and Android

Update 2017/10:

• HTC Vive Cinema supports a great variety of surround sound formats!

Update 2017/09:

• YouTube now supports iOS devices for spatial audio playback

• YouTube also enables stereoscopic VR180 Videos

• The Desktop Version of Oculus Video for Oculus Rift now supports the “Two Big Ears” Format.

If you know about any updates, please let me know:\ write me a message

360° Video Players and Audio Formats: Why Sound Makes the Difference

360° videos are a fantastic way to experience immersive movies and content – whether it’s through VR headsets like the Oculus Rift or simply on a desktop. The various options for video playback and the unique experience of 360° videos offer a wide range of possibilities. However, while video playback is becoming easier, one aspect often gets overlooked or underestimated: audio formats.

Unfortunately, many 360° video players and platforms don’t clearly specify which audio formats they support. Especially if you want to enjoy 3D audio, things can quickly get complicated. As an expert in 360° videos and audio, I want to provide some guidance and show you how to ensure that sound and visuals align perfectly for an amazing experience.

Why Audio Formats Matter

In the world of 360° videos and standalone vr devices , 3D audio makes all the difference. It allows you not only to see but also to “hear” where a sound is coming from. Whether it’s a car passing behind you or a bird chirping above your head – the right audio format makes the experience much more realistic.

Here’s the problem:

• Lack of transparency: Many video players or devices don’t clearly state which audio formats they support.

• Incompatible formats: Not all players can handle Ambisonics or binaural audio, which are typical for 360° content.

• Platform dependence: A format that works on Windows might have issues on iOS or Android.

The Most Common Audio Formats for 360° Videos

1. Ambisonics (B-Format): The standard format for 3D audio in 360° videos. It enables sound positioning in all directions.

   • Tip: Many cameras, like the Insta360 or GoPro Max, record directly in Ambisonics. 3D videos have specific audio format requirements to create an immersive experience. Using headsets and specialized software can greatly enhance the enjoyment of 3D content.

2. Binaural Audio: Perfect for headphone users, as it realistically recreates 3D sound. However, the files must be specially mixed for this.

   • Challenge: Not all players natively support binaural audio.

3. Stereo: The standard for traditional videos. Works everywhere but is less impressive for immersive 360° content.

   • Advantage: Good compatibility but less immersive.

4. 5.1 or 7.1 Surround Sound: Provides great spatial sound depth but requires compatible hardware.

   • Note: Not every system is equipped for these formats.

Major Challenges with Audio Formats for VR Players

1. Lack of clarity: Many users are unsure which formats their devices or players support, and the information is often hard to find.

2. Testing compatibility: It’s not always easy to test whether an audio format is compatible without first converting files. A VR player can help here, as it supports various audio formats and provides high playback quality.

3. Incompatible devices: Some devices or players, like older smartphones or VR headsets, are simply not designed for modern audio formats.

My Tips: How to Stay on Top of Things with a VR Headset

As an expert, I regularly test different devices and formats to find out what works best. Here are my recommendations to help you do the same:

1. Test your setup: Download test videos with different audio formats (e.g., Ambisonics or binaural audio) and try them on your devices.

2. Use specialized tools: Programs like Reaper or Spatial Audio Designer can help you analyze and convert audio formats optimally.

3. Use an app: Utilize an app on your iOS or Android device to test and play 360° videos. Mobile apps provide a superior user experience and offer features like downloading videos for offline viewing or interacting with 360° content in a user-friendly environment.

4. Consult experts: If you get stuck, feel free to contact me for help testing your setup. Just send me the details about your device and video format, and I’ll find the right solution for you.

Conclusion: Audio Formats Make the Difference

360° videos are only truly impressive when the sound is right. Unfortunately, the topic of audio formats is often overlooked, even though it’s just as important as video quality. With a bit of know-how and the right tests, you can ensure that visuals and sound harmonize perfectly – for an unforgettable experience.

If you have any questions or need support, feel free to reach out! I regularly test different setups and am happy to share my experiences.

Online Video Platform

Apps for Android devices that work offline

Samsung GearVR (Oculus Store)

Oculus Go, Oculus Quest, Oculus Quest 2

Oculus / Meta Quest likes to rename the apps (and company, lol). So the video player that was installed natively used to be called Oculus Video Player, or Oculus Gallery. It’s currently named Oculus TV, where you can access your internal storage. Like that you can watch 360 videos with the spatial audio formats listed above.

iOS Devices (iPad, iPhone, iMac, Macbook etc.)

Since Apple is lagging a bit behind, I want to show some possibilities to play back 360° Video with a viewer and spatial sound on those devices due to popular request

Desktop Computer, Oculus Rift or HTC Vive

See more practical use for 360 videos