Augmented Audio Developers Program

The Sound of AR

Our Vision

What you see in augmented reality is only part of the experience. To create a truly immersive and compelling journey, we believe in augmenting what you hear in addition to what you see.

Sennheiser AMBEO Augmented Audio is “the sound of AR” – blend virtual 3D sound with your real acoustic world and have full control over it.

The Developers Program is aimed at sound designers and game developers who are eager to create augmented audio apps and creatively explore audio interactivity.

 

Watch now to learn more about the AMBEO vision and passion for spatial audio at HackZurich 2018, together with creative developers from all around the world.

Our toolkit

All the creators selected will receive our SDK including the AMBEO 3D binaural audio software library, the application programming interface for the AMBEO Smart Headset, and a fully functional AR demo project using Apple AR Kit as an example, plus a discount code for purchasing the Sennheiser AMBEO Smart Headset for recording immersive binaural audio and featuring Transparent Hearing. They all help to bring Augmented Audio to your augmented reality experiences on iOS devices. If interested, please check out the Extended Developers Program on this page.

AMBEO Smart Headset

Use AMBEO Smart Headset to effortlessly add 3D immersive sound to the AR experience you are developing. These high-fidelity Sennheiser earpieces are fitted with professional quality omnidirectional microphones for binaural recording that capture the sounds of your environment in 3D binaural audio, just like your ears hear them. Your users will be able to listen to the binaural recordings through any pair of headphones to experience 3D sound with lifelike depth and relive the feeling of the original experience. Additionally, these microphones enable the Transparent Hearing and Noise Cancellation features that allow you to blend the sounds of your surroundings with the AR experience you create or tune them out. Explore applications that will benefit from this feature for your users wearing the ASH!

3D Audio Software Library and API

In our Augmented Audio toolkit, we provide developers with our proprietary audio engine for dynamic binaural rendering and virtual acoustics — in other words, a versatile and high-quality 3D audio technology for headphones. Not only we grant complete freedom over virtual 3D acoustic space, but also – exclusively for developers within the program – we give access to the AMBEO Smart Headset API, so that configuration and feature set can be customized to best fit the needs of a user’s application.

Features and sample app

Additionally, the Development Kit comes with the source code for a group of sample iOS apps that demonstrate the available features and possibilities. Most notably among them is an augmented reality experience that brings an entire musical band into your room with immersive 3D audio.

Head-tracker

We might provide developers with an additional piece of hardware: a head-tracker which will sit on your forehead and feed positional information into your AR development workflow. It is available while the stock lasts. The tracker uses a combination of gyroscope, accelerometer and magnetometer to create a full Attitude and Heading Reference System (AHRS). The information is shared using BTLE communication and has an update rate of 12Hz.

Accessory memory foam ear-tips

We suggest the memory foam ear-tips T500 from our supplier Comply™ for our developers. We are in fact firm believers that a perfect seal of the ear canal is the foundation for great Transparent Hearing experiences. More information is available on Comply™ website here.

Extended Developers Program

Though the first round Augmented Audio Developers Program has been fulfilled, AMBEO would always like to encourage new ideas and work with talents. Now we are accepting applications for the Extended Augmented Audio Developers Program. Don’t miss out the chance to explore the future of audio with Sennheiser AMBEO. We are ready to hear your voice.

FAQ

LeiaAU symbols are not found for architecture arm64?

The repository files may not have downloaded properly. Install Git LFS (https://git-lfs.github.com/), then `git clone` the repository again and call `git lfs pull` from the root directory in Terminal.

No signing certificate found?

You may need to change the signing to “Personal Team” for all build targets. From the Navigator, select the Xcode project file. Then, under Target -> General -> Signing -> Team, select “Add an Account”, and sign in with your Apple ID. Also, you may need to set unique bundle identifiers for all build targets (for example, replacing `com.sennheiser-ambeo.leiaauframework` with `com.yourcompany.leiaauframework`).

Can I control the AMBEO Smart Headset via software?

Not yet. We are currently working on an API to provide full programmatic control over Transparent Hearing level and the buttons on the physical Headset controller, and we hope to make it available soon.

Can I access the mono vocal microphone input signal of the AMBEO Smart Headset?

No, the underlying operating system holds complete ownership of that signal for phone call precedence, and as such, it cannot be exposed to a higher-level process such as a 3rd party iOS app.

Is there a Unity plugin for Leia?

For the time being, our team at AMBEO will not officially support a Unity plugin version of the Leia binaural rendering engine, nor the additional low-level framework required to expose binaural stereo microphone access within Unity (the vanilla Unity Microphone supports only mono input, preventing direct integration with the AMBEO Smart Headset). For any developers that strictly require the ability to integrate Augmented Audio with the Unity environment, please reach out to us at Ambeo-Info@sennheiser.com, and we can together devise a solution to get you whatever additional tools you may then need to enable your experience!