Sub-10ms roundtrip audio latency on Android

http://superpowered.com/superpowered-android-media-server

by vlaskovits • 10 years ago

142 46 10 years ago

superpowered.com

omegaworks• 10 years ago

What's iOS' audio latency?

DrJokepu• 10 years ago

http://superpowered.com/latency

Generally around 6-8ms.

niftich2• 10 years ago

About 7-12 ms. Actual benchmarks by an audio SDK maker here: http://superpowered.com/latency

tonyarkles• 10 years ago

And it's been like that for a long time. Last time I did mobile audio programming (2009? 2010?), the Android test devices I had (Galaxy S2?) were operating around 100ms audio latency. Glad to see they've improved!

rectang• 10 years ago

And how about macOS?

bramen2• 10 years ago

Depends on how good your soundcard's drivers are. But I think Mac OS X is capable of something like 48 samples at a bare minimum? Therefore it depends on the sample rate you're using as well. Higher sample rates yield lower latencies but higher CPU usage. At 44.1khz that's about 1ms.

andrewstuart22• 10 years ago

We updated our findings with the recent improvements in Android M (Marshmallow)
opening a market of 1.1 billion devices

Minor nit, but considering that google says Marshmallow is on 10.1% of devices [1], that figure is an order of magnitude too high.

[1] https://developer.android.com/about/dashboards/index.html

szantog2• 10 years ago

"We updated our findings with the recent improvements in Android M (Marshmallow), and recently released a solution for Android’s USB audio and MIDI challenges, opening a market of 1.1 billion devices for pro audio application creators."

Those are two separate things:

1. Updated analysis on the latency with regards to Marshmallow.

2. Superpowered USB Audio and MIDI SDK opens a market of 1.1 billion devices.

andrewstuart22• 10 years ago

A brief skim of the article they link regarding Marshmallow [1] provides this quote:

As readers may recall, 10ms round-trip audio latency is the threshold that must be met by Android to be considered truly 'pro audio'.

This wasn't possible before Marshmallow (per aforementioned article), and therefore pro-quality audio apps are still only truly possible on 10% of Android devices. So the market is opened up for 100 million devices.

I'm not saying it's not a huge number of devices. But it's not as huge as the blog states.

[1] http://superpowered.com/superpowered-android-media-server

vvanders• 10 years ago

Awesome stuff. Solid to see such a nice side-by-side integration without interfering with the existing media server.

vlaskovits6• 10 years ago

Thanks!

nix0n• 10 years ago

How does this compare to the existing audio tunneling in some versions of Android?

(The best writeup of this I've seen is https://github.com/felixpalmer/android-visualizer/issues/5 which details some of the problems that audio tunneling can cause)

whatever_dude2• 10 years ago

A good first step is probably to read Android's own current situation page on the matter and look at the numbers.

http://source.android.com/devices/audio/latency_measurements...

Basically it has been getting and better with new versions of Android and better hardware, but it still has room for improvements.

bitL• 10 years ago

Hooray! Congrats!

Animats• 10 years ago

It often takes over 500ms to get voice through the cellular network. Worrying about 10ms in applications seems excessive.

virtuabhi• 10 years ago

It will be useful for apps, esp. those targeting musicians. Iphone had sub-10ms latency for a long time.

tqkxzugoaupvwqr• 10 years ago

It’s not for phone calls but real-time audio applications, e.g. music creation apps or games.

niftich2• 10 years ago

It's for real-time music/audio apps, like virtual pianos, etc. These can be 100% local, and excessive latency is frustrating to the user.

l1ambda• 10 years ago

This latency mentioned is useful for music and VoIP apps.

vlaskovits6• 10 years ago

Not only is 10ms roundtrip latency critical to the interactive audio type applications mentioned by others -- it is critical for VR too.

whatever_dude2• 10 years ago

It's not used for that. It's used for applications that need audio feedback after a trigger. In those cases 14ms+ is already way too much to the point of being unusable. For example: https://www.youtube.com/watch?v=_eE7NtK4jX8

exDM694• 10 years ago

About 10 ms is the maximum latency that can be tolerated in music applications. Preferably it should be around 5 ms.

If you're a musician, you can easily notice when the sound doesn't come out when you press your finger on the keyboard or sing to a microphone. 5 ms is not noticeable at all, 10 ms feels a bit off but is tolerable, above 25 ms is clearly noticeable and very annoying (ie. it's no longer a musical instrument).

AceJohnny22• 10 years ago

"It can be installed on any Android userdebug build or rooted production build."

"Installing on Samsung Galaxy devices is not recommended"

So, not for apps on devices today.

exDM694• 10 years ago

You're correct. It doesn't seem to be for consumer oriented products today. But it's a start...

I guess they're targetting some professional audio gear that have an Android-based component in it. Or hope to get this sold to phone/tablet vendors who would like to build a music-oriented product. Or get acquired by Google and get integrated into Android proper. Or just make Android a viable backend for their cross-platform audio sdk.

Can anyone from Superpowered chime in and shed some light on who or what you're targetting?

vlaskovits6• 10 years ago

Hi there,

We're licensing the Superpowered Media Server to OEMs who want to differentiate their Android build by bringing latency down to pro audio levels.

As we say in the article, we squeeze latency out of user space with our zero latency SDK as well as out service space with our new server.

sengork• 10 years ago

Does this mean we can finally have an app that'd invert the input from the microphone and play it back on the loudspeaker effectively performing surrounding ambient noise cancellation?

brokenmachine2• 10 years ago

Ambient noise cancellation is more complicated than that. Consider that as you changed your distance from the speaker you would be going into and out of phase with the signal, you would effectively be doubling the ambient noise at some locations, and cancelling it at others.

Also 10ms response time would definitely be too slow for such an application.

If that worked, you could just use an opamp with a sub-microsecond response time with a cheap mic and speaker for a couple of dollars, and I'm sure China would have flooded the market.

I would give anything for a working ambient noise canceller. I would point it at the leafblowers outside while I sip champagne.

aarohmankad• 10 years ago

What about for application in a headphone? You wouldn't have issues with changes in distance, as your ears would always be a set distance away from the drivers.

For example, what is the latency on Bose's QuietComfort 25?

randyrand• 10 years ago

Reflections also make this not work.

bramen2• 10 years ago

So this is kind of like ASIO drivers for Android? I hope it gains wider applicability, it's about time.

TwoBit• 10 years ago

So why is this so hard for Android but seemingly easy for every other OS out there?

Chilinot• 10 years ago

Short answer: abstraction layers.

Because Android has to be able to run on so many devices there are a bunch of abstraction layers between the app and the hardware, all adding delay.

iOs does not have this issue.

qb45• 10 years ago

I bet your iOS also has some abstraction layer, I doubt you get to poke DAC chip registers directly from userspace. Superpowered Media Server is an abstraction layer too and so are desktop OS audio APIs.

And yet, they don't suck as badly.

exDM694• 10 years ago

The article kind of touches that:

"Ultimately, the Android audio tack has fundamental architectural problems stemming from engineering decisions made at Android’s genesis, well before Google’s acquisition of Android."

Much of Android was designed for simple apps written in Java and running on resource-constrained devices. This is quite far from the reality of today. Perhaps it allowed Android to get to the market early and get a thriving app ecosystem, but billions of dollars have been poured to fixing those "mistakes" from the early days.

Audio apps are pretty much the polar opposite from what Android was originally designed for. Audio processing needs to run on native code or at least without ever invoking the garbage collector or any other unpredictable source of latency.

iOS and OSX audio stack is completely different and achieves a very low latency. Many musicians prefer Apple products because the audio works well out of the box. You might be able to achieve similar performance with Windows or Linux, but it's not as easy.

While the Superpowered has a neat improvement on Android's latency figures, 8...24 ms is not good enough for professional music use (and they don't mention any confidence intervals). For music apps, audio latency must be consistently less than 10 ms, preferably less than 5 ms.

It's an improvement but I don't think it inspires enough confidence that you'd see musicians performing in front of an audience using Android devices any time soon.

vlaskovits6• 10 years ago

Doesn't have to be less than 5ms -- ~10ms and below (like iOS demonstrates) is great.

anotheryou2• 10 years ago

can someone explain the practical use case?

- future apps can implement the code for less latency on the current android version?

- future roms can have less latency with this code?

- existent apps can have less latency with a 3rd party app helping?

- I need the loopback dongle?

vlaskovits6• 10 years ago

The practical use case is that you will see commercial Android builds that will have integrated the Superpowered Media Server, allowing Android to become the great music and entertainment platform it should be.

anotheryou2• 10 years ago

thanks. Great!

gravypod• 10 years ago

I'd be interested in seeing what the android devs could do if they included specs for FPGAs into phones.

I think that would be a very fast way to get android to connect any IO to any configuration they need very quickly.

There also seems to be a growing trend to include ARMs inside actual FPGAs.

Sub-10ms roundtrip audio latency on Android

Related Stories