360 Microphone for 3D Audio Recording in VR

When somebody mentions 360 microphones, most people think of Ambisonics. I must confess, I don’t think that’s too bad actually. This format is quite practical under realistic recording conditions, such as when shooting VR videos with a 360° camera.
That’s why I’d rather call them a 360 microphone in connection with virtual reality and 360 videos, even if 3D microphones would be more appropriate. Historically, 360 audio rather describes surround sound, i.e. no sound from above or below, so only planar.
As a logical consequence, there is also a whole range of recording techniques. To keep the overview, I would like to try to categorize them, as I did with my article Virtual Reality Audio Formats.

• Channel-based (Mono, Stereo, Surround, immersive)
• Binaural (binaural Stereo, Omni-Binaural)
• Soundfield-based (Ambisonic, Higher-Order Ambisonic)
• Object-based (last but not least at all)

First of all, I would like to point out that this overview is not to be understood in a judgmental way since most discussions on 360 microphones and sound recordings tend to forget: Every setup has advantages and disadvantages and these depend less on the microphone, but more on the circumstances under which the recording happens. Furthermore, I was not sponsored by any of the manufacturers and will try to be as objective as possible.

Update 2019/08:

• Added binaural dummy head microphones: DAVINCI HEAD MK2, Sennheiser MKE2002, Headacoustics HMS AACHENHEAD, Gras 45BB Kemar Head and Torso B&K type 4128-D
• Added binaural in-ear microphones: Soundman OKM, Aevox Audio IE, B&K type 4101-B

Channelbased Microphones

Channel-based microphones are commonly used in traditional recording setups to capture audio from specific directions. These microphones, or microphone arrays, were usually thought of for later playback on loudspeakers, which is only relevant for VR Audio in special cases. Nevertheless, it is worth knowing the approaches in the following.

Mono

For this purpose, any microphone can be used, preferably one with an omnidirectional pattern, which records the sound from all directions. As a result, only one channel will be used and the later playback with dynamic head-tracking will not work. At least better than the most sound from 360 cameras and therefore mentioned for the sake of completeness.

Stereo

Here, too, the application for VR does not appear to be entirely clear at first glance. In this respect, the most important representatives, XY, AB, ORTF and Blumlein are mentioned only briefly. However, I would like to refer to a presentation by Schoeps on the topic Microphone technology for VR. As a result, I also like to use stereo recordings for 360 videos, even if they don’t “fill the whole sphere with sound”.

Surround Sound

There are also some interesting applications of surround, which in the classical sense, is also called 360 sound. Hence, no sound can be reproduced above and below the listener, but still may be useful for certain 360 recordings.

Zoom H2n

Is probably one of the most famous representatives among the 360 microphones mentioned here and still has its right to exist. Thanks to a firmware update, it can record in spatial audio mode directly in Ambisonic B-format, only without height information, leaving the third of four tracks in Ambix format empty.

IRT-Cross

This four-channeled by IRT (Institut for Broadcast Technology) shows an alternative to Ambisonics (more on this later). Due to the additional time that sounds needs to travel between the microphone capsules and focus on one plane, the localization can be more accurate than in the case of the Ambisonic A-format microphones. Consequently, it takes up more space and may be crucial to hide on a tripod under a 360-camera.

5.1 Surround, Double MS

Even though I am often asked about Dolby Surround 5.1, 7.1 or similar, these formats are not very relevant. Due to the speaker in the middle, called the center, which is supposed to play mainly speech becomes superfluous. However, in special cases, it may be advisable to amplify more microphones in one direction. Similar approaches, yet more flexible is Schoeps Double MS, Nevaton BPT, Josephson c700s or Antelope Audio edge quadro. With dedicated dencoders, they can be transformed into complex microphone patterns such as M/S, X/Y, Blumlein and combined with each other.

3D Audio

Finally, we get to the really exciting representatives of 360 microphones, which, in contrast to Ambisonic, usually achieve their sound characteristics through differences in running time, as already mentioned with IRT-Cross.

ORTF-3D

Basically, this 360 microphone array is a cuboid with eight microphones pointing into each of the corners. This is available in different versions, for example with super cardioids instead of cardioids for the vertical axis, or additional space for the height layer. Comparable is the ESMA-3D (Equal Segment Microphone Array), which is also interesting for the SPS Mach1 format, even if the conversion is a bit more complex.

More 3D Microphone Arrays

As you can guess, there are microphones in the most different arrangements, which is why the following should be briefly mentioned here, but are by no means all:

• 7.0.2 Andriessens-Hoffmeister-Array, which was built with the Doly Atmos Bed (7.0.2) in mind https://www.hauptmikrofon.de/de/3d/tonundmeister
• 5.0.4 Florian Camerer http://www.aes.org/conferences/2019/immersive/tutorials/tutorial10.cfm

Binaural Microphone Recordings

Binaural describes a playback method that is only suitable for headphones. As a result, it is useless for loudspeakers, but in contrast, it allows a three-dimensional reproduction of sound with only two channels. Binaural microphone recordings replicate the human hearing experience by capturing sound as it’s heard by our ears. When you listen to binaural recordings with headphones, you can perceive sound direction and depth, creating a 3D auditory experience.

Stereo Binaural

Dummy Head Microphone

The most famous representative is probably the Neumann KU100, which is still used as a reference in times of 360 microphones.

But there are many more, like that DAVINCI HEAD MK2, Sennheiser MKE2002, Headacoustics HMS AACHENHEAD, Gras 45BB Kemar Head and Torso. Lastly, not very suitable for binaural recordings but interesting nonetheless: B&K type 4128-D

In-Ear Microphones

If you’re not a fan of in-ear headphones, these microphones might make you enthusiastic about them again. Because these hybrid earphones can record and reproduce sound at the same time. This creates a very personal sound image, which is easy to handle, as the in-ears only have to be plugged into the ears.

Let me briefly mention:

• Roland CS-10 EM, which can be used with the Zoom H2n for instance, as soon as the additional power supply is activated.
• Sennheiser Ambeo Smart Headset due to the combination of acoustic noise-canceling and transparent hearing, also known as “audio awareness”. This allows external noise to be removed or added as desired, making the use of 3D audio particularly interesting for augmented reality.
• Hooke Verse Audio Headset, which works wirelessly with Bluetooth and is not only suitable for iOS devices but also for Android devices.
• Several different models: Soundman OKM, Aevox Audio IE, B&K type 4101-B

Omni-Binaural

In most cases also referred to as quad binaural, these are therefore four pairs of two binaural microphones, i.e. eight ears. Compared to the simple binaural microphones, these enable later playback with head-tracking in VR.

3Dio Omni-Binaural

Probably the most bizarre-looking 360 microphone comes from 3Dio and was often used around 360° videos at the beginning of the VR hype before it was replaced by Ambisonic microphones in the medium term. Even so, it retains its raison d’être.

8Ball Hear360

Very similar in principle to the ears above, but has a sophisticated system, which makes it very easy to attach to the tripod under the VR camera. In addition, the missing ear cups filter the sound less compared to an HRTF (head-related transfer function) and is, therefore, more useful for loudspeaker applications.

Ambisonics

Let us now come to the most famous representative: Ambisonics. This sound field technology is ideal for recording and reproducing spherical sound recordings. For more information just click here.

First Order Ambisonic (FOA)

For this type of recording, a tetrahedral arrangement of the cardioid microphone capsules has established itself, which ideally sit as close together as possible. But there are also other possibilities, like a Trippel-MS setup, or the idea of skipping the A-format and record natively into the B-format with one sphere and three-figure of eights.

Ambisonic A-Format Microphones

Because there are now a number of audio manufacturers who have brought a very similar 360 microphone, sometimes referred to as VR Mic or 3D Microphone, to the market for VR Sound, these are only listed in keywords, in chronological order.

• Soundfield SPS200, Soundfield ST450 and more
• Core Sound TetraMic
• Brahma Ambisonic Standalone
• Reynolds Microphones
• Sennheiser AMBEO VR Mic 3D AUDIO Mikrofon
• Røde NT-SF1 (Rode soundfield)
• Nevaton BPT enhancement with height (Nevaton VR)
• Oktava MK-4012 4-D Ambisonic A-format Mikrofon

It should be mentioned, however, that they are all four-channel, and are mostly used in combination with an external recording device. So the Zoom F8, Zoom F4, Sounddevices MixPre-6 and MixPre-10t, as well as the Tascam DR-701D have their own firmware updates, which allow an easy recording and live preview for headphones.

Some of the 360 microphones mentioned have their own plug-ins, such as the AMBEO A-B converter plugin or DearVR Micro, as well as the SoundField by RØDE plugin. These can convert the Ambisonic A format recording to a first-order B format in Ambix or Fuma. In addition, it is possible to listen to the sound directly via various binaural decoders or even loudspeaker arrangements.

Mobile Handy Recorder

Mobile recording devices that have an Ambisonic arrangement integrated are the following:

• Zoom H3-VR 360° VR Handy Recorder
• Twirling720 VR Audio Recorder

Interesting Ambisonic Modification

• Ricoh TA-1 3D Microphone is a special microphone attachment that can only be used with the Ricoh Theta V 360° Camera.
• Audeze Planar Magnetic Microphones with very large, 100mm diaphragms
• Fraunhofer Uphear is not a microphone but a technology which uses the microphones built into a 360 camera to create a sound field.
• Brahma Microphones (versatile Ambisonic recording systems) has a whole range of individual solutions such as Brahma-in-Zoom H2n, a large capsule Brahma Ambisonic Studio Microphone (picture below) and a mix of both: a tetrahedral large-diaphragm array mounted on a Zoom H2n

For more information on VR cameras suitable (or not) for spatial audio, such as the Sonicam, Nokia Ozo, Kandao Obsidian, GoPro Fusion or Vuze Camera, please click here.

Second Order Ambisonics

The next generation of VR microphones is already on the way, using eight or more instead of four microphone capsules. Advantages include higher localization and better sound field reproduction via loudspeakers. Even though B-Format would require 9 channels, second-order A-format microphones usually use eight to twelve capsules.

• Brahma-8
• Core Sound OctoMic (see image below)

With both 360 microphone versions it is possible to record in the so-called SPS-8 format, but strictly speaking, they are not Mach1 format. One needs an intermediate step to convert the A-format into a P-format, which is possible with a filter matrix of the manufacturer.

Higher Order Ambisonic

As a rule of thumb, if a microphone array contains about 20 microphones, depending on the manufacturer, this is referred to as Higher Order Ambisonic. Even if it still sounds like an incredible number of microphones, the actual number of products is manageable as 360 microphones.

• Zylia ZM-1 has 19 capsules and can, therefore, record third-order Ambisonics, which is only possible, connected with a laptop or tablet via USB. With the 6DOF VR/AR Development Kit there is also the chance to move away from the recording position and use the six degrees of freedom.
• mhacoustics em32 Eigenmike microphone even creates fourth-order Ambisonic and is probably the current king among Ambisonic microphones. In order to handle the number of microphones at all, digital signal processing is necessary.

Objectbased Recording

Even if I don’t really want to start a whole new topic and talk about audio objects like MPEG-H 3D Audio or Dolby Atmos VR, you shouldn’t forget the most important thing:
No matter how good the choice of the 360 microphone is, whether Ambisonic or not, in most cases, it is more important to concentrate on mono microphones. Be it classic supports for 3D orchestral recordings or clip-on microphones for protagonists, mono microphones usually remain the thing at VR recordings, to which I pay the greatest attention. Of course, this also depends on the case and the truth lies somewhere in between, but I find it incredibly helpful if you already think about the immersive audio mix during the 3D sound recording.

Conclusion

So there is a huge and growing selection of 360 microphones that you can use for VR recording or 3D audio. But don’t forget that there is never the perfect microphone for every situation, just one or more best microphones for the situation. I’m happy to help you find the right choice.