Omnio: First AI model that can natively reason over audio

by lukax • 2 years ago

13 8 2 years ago

Can this get me the lyrics of rap songs or not?

Try it out, you get free credits on signup. Worked surprisingly well for me on this example https://www.youtube.com/watch?v=DxkeOkaVRLo

sharpshadow2• 2 years ago

Yes I saw it thanks and will try it out. On the introduction blog post they said beta only for paid developers but seemingly it’s free for all.

easwee• 2 years ago

I tried Eminem - Rap God with "transcribe word by word" prompt and it did quite good, I just had to set temperature to 0, else it can get creative.

lukax2• 2 years ago

We built Omnio to address the limitations we kept running into with existing audio AI models (we previously built an automatic speech recognition product). Most of them rely heavily on speech-to-text, which strips out a lot of the things like speaker roles, emotions and non-verbal cues that are critical in more complex scenarios. Omnio directly processes audio signals to capture that kind of context. It's designed to understand conversations in a way that feels more "human."

barrenko• 2 years ago

So this is speech-to what? You're kinda missing that in your info. Are you guys based in USA or Ljubljana?

LukaFurlan• 2 years ago

insane release

Omnio: First AI model that can natively reason over audio

Related Stories