GPT‑Live

https://openai.com/index/introducing-gpt-live/

by logickkk1 • 14 days ago

750 516 14 days ago

This solves my biggest annoyance with the current advanced voice: its speech getting interrupted by me setting yup or even background noise if loud enough

piskov• 14 days ago

Now it consistently interrupts you

jrflo3• 14 days ago

Yeah, looking at the waveforms from those sample conversations it looks like it's happening at the exact same interval every time

hirvi74• 14 days ago

I've had some funny interactions with this issue. I sometimes use the voice mode when walking my dogs. I can confirm that ChatGPT responds positively to being told it's a "Good girl!"

OsrsNeedsf2P• 14 days ago

Hoping to use this for natural conversation language learning. Previous iterations of the app kept correcting my words/grammar before it got to the model, causing issues with identifying mistakes in speech

MostlyStable• 14 days ago

I was going to post a comment on a related topic (I couldn't find in the announcement if this is English only or not), but would you mind expanding? I was thinking about doing something very similar, and yeah, if the model isn't hearing the mistakes I'm making, that would dramatically decrease it's usefulness.

haaz• 13 days ago

I tried it for these purposes and it didn't seem any better. I couldn't even tell it was a new model. I tested today, I'm an EU customer so maybe the rollout is delayed

rvz• 14 days ago

With this, human translators have been totally and absolutely a solved problem with this version of real time translation.

This time is the most natural version that exists and it is a natural as a conversation.

To Downvoters: Why aren't you feeling the AGI?

tomasphan• 14 days ago

“I don’t translate, I interpret” - Ahmed the best interpreter there ever was

slekker• 14 days ago

Why aren't you feeling the operating loss? :(

progval• 14 days ago

They most definitely did not solve real time translation yet. The French in the video is barely understandable, both the translation and the pronunciation are the quality of an American who hasn't used French since high-school.

jmarcher• 14 days ago

This. It was shockingly bad. Non-"live" translations are much better.

It's exciting for the future, though!

ygouzerh• 14 days ago

So true! I am not sure if it was on purpose that the model spoke with a so strong accent!

HyperL0gi3• 14 days ago

Very cool. Not cool bringing Brazil’s loss to Norway again. We're already devastated. No need to keep beating someone on the ground. :(

ilaksh2• 14 days ago

Are there any open source full duplex models that are out besides PersonaPlex? There was a chinese open one, maybe Fun Audio chat or something, that said it was going to release a full duplex version but I am not sure if it did.

My dream would be open source full duplex with function calling or some kind of rudimentary text output. PersonaPlex is still interesting although it was looking like we would need to fine tune it to handle outgoing or avoid going off the rails easily.

VladVladikoff• 14 days ago

I want to know this too, as I’m hoping to fabricobble up a “smart speaker” that communicates with my local AI assistant. Right now we do everything via iMessage but it would be nice to be able to tell it to add things to my grocery list by voice while my hands are busy in the kitchen. Also would love if anyone has any advice on what microphone & speaker to pick out, was planning on just reusing a raspberry pi I’ve got around for the brain part.

ilaksh2• 14 days ago

if you don't find that then you could fake it with personaplex possibly but making another ASR/STT model just listen continuously and transcribe then send to an LLM with function calling. at least that would allow one direction easily.

Rebelgecko• 14 days ago

If you're in the Home Assistant ecosystem, I'm intrigued by their voice hw

andersthuesen• 14 days ago

Working on this at https://duplexio.ai which will be open weights and free for non-commercial use. If you want to work on this send an email to anders@duplexio.ai

programjames2• 14 days ago

Standard Intelligence released one two years ago:

https://si.inc/posts/hertz-dev/

It's only 8.5B and doesn't sound like it's quite conversational.

vessenes2• 14 days ago

Oh wow, I'd like this. Our current voice interactions with ChatGPT are on a 4o era model; really terrible. oAI has always been pretty cagey on the architecture of their end to end multimodal models. And RL has basically made them worse since launch. (Check the launch videos where the model sings, is more realtime, has accents, etc). I'd love to try a next gen version.

observationist• 14 days ago

The potential conversational dynamics of people telling each other "quiet!" after they pick up the habit from talking with AI will be interesting. It could lead to people being more assertive and thoughtful, or it could be contentious and rude.

Awesome that they've improved that aspect of voice chat, though.

rane• 14 days ago

Absolutely can't wait to try this for language practice. The advanced voice mode is great but ultimately just doesn't work that well and doesn't have the feel of a natural conversation.

fnikacevic• 14 days ago

Any pricing announced yet?

raychis2• 14 days ago

This looks very cool. An AI that can listen and speak and handle tasks without breaking the flow of conversation would solve some big annoyances with current tools.

The concern is though as these get better will people struggle to distinguish these with real human connections?

bstsb• 14 days ago

people have been mistaking AI conversations with reality since the very first text-based models came into the public view with ChatGPT. i'm sure with each incremental improvement to outputs like this, though, more people will get convinced of its "humanity"

(see https://www.reddit.com/r/MyBoyfriendIsAI/)

ACCount37• 14 days ago

Every time things like this come up, I can't help but think of the ending of Inception.

It's less that you're convinced it's real and more that you no longer care if it is. "Feels real enough" is good enough.

I'm a technical user first, so I'm not sure if models have improved for RP the way they improved for applied STEM tasks and technical brainstorming. But if there is an improvement curve there, I wouldn't be surprised if this only grows in popularity.

OtomotO• 14 days ago

https://en.wikipedia.org/wiki/ELIZA

HyperL0gi3• 14 days ago

I'm very eager to test this for brainstorming!

One thing I noticed is that we lost vision feature for some reason on the live chat?

This was an extremely useful feature. Not sure if it’s a regional thing or that they just removed that from the current live chat.

I imagine it will be even more useful with this new version.

athyuttamre16• 14 days ago

(Atty from OpenAI here)

GPT-Live does not support video at this point, but we're working hard to introduce it soon. In the meantime, our previous Advanced Voice Mode will continue to be available and supports video.

HyperL0gi3• 14 days ago

Thanks for the reply, Atty. So I guess I'm holding it wrong?

For some reason, I can't use the camera while in Live mode. The only option I see is the plus item, which does show the camera, but when I open it up and ask "Are you seeing my camera?" it will always say no and recommend me to open it.

Feels like the official camera icon does not show up for me? iPhone 13, ChatGPT Pro subscription.

vjulian• 14 days ago

Does this support more than one user voice? Or, are there plans for this? I did not see that mentioned in the announcement.

athyuttamre16• 14 days ago

(Atty from OpenAI here)

You can choose among 9 voices in the app, all newly refreshed for GPT-Live. If you meant whether it can detect multiple people, it can (like in the livestream), but not always perfect. Would love to hear your feedback once you try it.

robotswantdata• 14 days ago

Any plans to add more international voices and dialects?

smalltorch• 14 days ago

Very cool. I thought the agent came in a little to hot at 1:03. I wonder how it decides when to jump in.

fraywing• 14 days ago

I like this and felt like some of it was much more fluid; but was I alone in feeling like the interjected "uh-huh" or "yeah?" moments felt a little jarring?

Almost felt a bit *uncanny valley* for what "natural" conversation is supposed to be like. If the "uh huh" isn't timed correctly, it'll feel like a zoom call with lag.

burntalmonds• 14 days ago

I agree. Many times those little interjections don't feel natural. It's impressive, but there's still a lot of room for improvement.

AaronAPU2• 14 days ago

Every second of the interaction is uncomfortable to me, but I also have extreme difficulty with video calls with humans. The latency completely breaks my mind.

simonw6• 14 days ago

I had preview access to this one for a few weeks. It's very good. I had one conversation that lasted a full hour while I was walking the dog, got some good brainstorming done against one of my projects.

The best feature is that it can delegate questions out to GPT-5.5 in the background, so you're no longer restricted to a voice model that's several years behind the frontier.

I did report a fun bug with it though: it was interrupting me and laughing at my (not really intended as) jokes while I was still talking! They seem to have clamped that behavior down thankfully, it felt a bit rude and condescending.

heisgone• 14 days ago

Is it a dumb-down version of GPT like the current voice model? At least in french, I find the current GPT voice mode to be useless, to the point I only use the dication mode. I would ask a question and it would answer something along "That's a interesting question. I can help you with that. Anything you want to know about X?" I would ask again and it would answer the same kind of non answer.

KaoruAoiShiho• 14 days ago

Click through to the link, the answer is no it uses the latest gpt models now.

athyuttamre16• 14 days ago

Thank you for testing and the feedback Simon!

100ms7• 14 days ago

Is it responsive to personality settings? I actively don't want fake AI girlfriend, but I do get a ton of value out of voice mode. Looking forward to trying this but hoping it's not a creepy overdone mess (like Sesame). Expectations are they'll keep doubling down on fake AI girlfriend approach because the thing I want probably wouldn't drive engagement anywhere nearly as well

Someone1234• 14 days ago

I too found this with their previous attempts.

I have my Chat personality settings stripped right down to no-fluff. I'd want voice to be more akin to the Star Trek computer, and less akin to as you said an AI friend, but previously it was tuned too personable/friend-like.

taurath• 14 days ago

It’s 2026 what the customer wants is probably an indication of what not to do if you’re a hyperscaler.

Whoever ends up actually winning after the crash will be the ones who figure out the needs of users, not the needs of the financial machinations of the companies trying to grab land.

FlamingMoe• 14 days ago

Cool, was this conversation through the chatgpt app?

simonw6• 14 days ago

Yes, ChatGPT on iPhone.

dajonker• 14 days ago

But does it generate good pelicans?

trollbridge2• 14 days ago

I had an enjoyable conversation with it just now where it repeatedly told me it had generated an SVG of a pelican riding a bicycle along with a clickable data: link. Obviously, this is just harness polish. Overall, it's quite impressive.

Someday we'll have a tokeniser that works directly on human speech instead of doing speech-to-text and text-to-speech steps in between.

mrits• 14 days ago

About 2 years ago I used to have conversations with GPT while walking the dog. It really emphasized the need to think before you speak, but you had to think fast before it hung up on you.

scottyah• 14 days ago

Have you compared it to grok in teslas?

amarant3• 14 days ago

Wait, you can talk to Teslas now? How did I miss thiS? Can I get a red led bar and basically have a KITT?

jacobgold• 14 days ago

"The best feature is that it can delegate questions out to GPT-5.5 in the background, so you're no longer restricted to a voice model that's several years behind the frontier."

Wow. That's exactly what I hoped they would do.

This issue has held me back from using ChatGPT's voice mode as much as I otherwise would have, because I also use it for brainstorming while commuting, exercising, etc., and don't want it to feel stuck in the past.

alexellisuk• 14 days ago

Funnily enough - I built this (delegation) over the weekend with Fable for a local voice chat running 100% on local LLMs, Parakeet and Kokoro. I say "...ask the thinking model..." and that redirects it to Qwen 3.6 27B on vLLM.

Can't claim originality though - it was inspired by Sesame - where their models will invoke a search, or check the weather etc, and make a vocalisation to keep you engaged.

Turn taking is one of the hardest things to get right for the exact reasons mentioned - but does seem to be the way that Claude.ai's voice works - in a very obvious way.

Anthropic + OpenAI both rug-pulled voices I liked and got used to and OpenAI really dumbed down their voices at the same time - Arbor went from Estuary English and almost "jack the lad" to some generic English accent. Claude had a Birmingham accent and said things like "shit", ending sentences like "So you're telling me that they asked for a 90% discount yeah?" - then it changed overnight to a mock Derbyshire accent with a dull tone.

ChatGPT's voice also gaslights me for conventional opinions - "my Eastern European neighbour helped me lift a wardrobe upstairs - something you just can't ask your typical neighbour neighbour"... then you get a full on left-leaning lecture from the safety layers rather than a head nod or "what luck!"

Claude + Sesame are nowhere near as overbearing.

In both cases - from edgy and engaging to something that just didn't gel.

The point of making my own assistant is that I can talk for as long as I want, episodic memory is personal and private, there's no "trust me bro, we're a big corporation" vibes.

This was not my first attempt - when I had a bunch of Opus credit around Jan/Feb - I tried really hard and created something that was not good enough. What I have now, is working, and each session is training Claude/Codex on what to tune, and to fix.

"Just had a convo - can you look into what happened?" And if it's one I don't mind sharing with the model - I'll say, "and what did you think of the questions I asked?" Sometimes it'll give a lovely commentary on how the model did.

af_heart is probably the smoothest voice - but yes it's more like another commented - more "StarTrek" than "telesales assistant that pauses and laughs at your jokes".

If you're on a similar path and want something full duplex - the go to solution is PersonaPlex from Nvidia based upon Moshi.

jjulius3• 14 days ago

I highly recommend simply enjoying the walk.

SequoiaHope2• 14 days ago

Seems a bit knee jerk. I go on walks and bike rides all the time. A couple of times I’ve used voice mode and it’s been interesting. I could have listened to music or a podcast, listen to YouTube or just unplug. But every walk is different.

If you’re uncomfortable with this new world, and I’m sure I am even as I participate, you could tell us more about that?

sauwan• 14 days ago

I think you're missing the counterfactual. I now have two choices: 1) sit behind my desk and work, or 2) walk and talk something out.

Before this model, the voice models were pretty dumb and annoying to work with. We'll see if this changes that.

derefr2• 14 days ago

Given the personality type common on HN, I imagine that the GP, even if unplugged from all technology on their walk, wouldn't be in a mindful state of enjoying their surroundings, but rather would be "lost in the clouds", stewing on the same ideas/thoughts/problems; but with those thoughts going more in circles, due to a lack of ability to verify anything.

mock-possum• 14 days ago

… but it sounds like they did enjoy the walk, doesn’t it?

altmanaltman• 14 days ago

I take my dog for walks everyday and I think she 100% of the times enjoys it but me maybe only 20-30%

danw1979• 14 days ago

I often enjoy walking and doing something else at the same time. Usually thinking through a problem…

brcmthrowaway• 14 days ago

One thing has remained constant over the last little period of time. AI boosters have zero taste.

Tadpole9181• 14 days ago

I highly recommend not patronizing adults for doing what they want or feel is appropriate when they're walking their dog.

wat10000• 14 days ago

Sometimes I want to learn something while I walk. Sometimes I want to listen to stories. Sometimes I want to just be present. All are good. I highly recommend letting people enjoy whatever they enjoy.

supern0va6• 14 days ago

Every time something along these lines is posted, comments like this show up.

The thing I don't get is...no one would say this about listening to a podcast or audiobook on a walk.

I'm not sure why people choose to demonize this specific use of time during walks.

another-dave• 13 days ago

It reminds me of that old parable where the acolyte asks the priest "Father, can I smoke while I pray?" and gets told "No, you should be focusing on praying. That wouldn't be respectful". But then he says "Can I pray while I smoke?" and gets told "of course, you can pray at any time".

If it's 'walking time', I probably don't want to consume that with work. But if it's 'working time', it could be great to have a nice walk during it.

ben_w• 14 days ago

I did report a fun bug with it though: it was interrupting me and laughing at my (not really intended as) jokes while I was still talking! They seem to have clamped that behavior down thankfully, it felt a bit rude and condescending.

Some times I'm still amazed that AI "gets" humour much more effectively than the character of Data did before his emotion chip, e.g.: https://www.youtube.com/watch?v=G4VZ5kQIdV0

Other times I'm amazed in the opposite way, that the script writers cover basically the same talking points about the character as we have today about LLMs, e.g.: https://www.youtube.com/watch?v=GBJCYHwyZhw

BeetleB4• 14 days ago

I should give these voice models another try.

I have friends who have brainstormed with an LLM (voice chat) for 10-30 minutes, and reported very positive experiences.

When I speak to one - while I'm impressed at how far they've progressed - the LLM just doesn't talk like someone I'd want to discuss a technical problem with (the way I would with a human).

(And my friends aren't even using a custom prompt - some of them are just talking to the default Gemini on their phone!)

solarkraft2• 14 days ago

I also love exploring ideas like this. The problem that made me stop using Gemini is that it would always try really hard against all my prompting to ask a stupid question at the end of its response that would completely derail my train of thought.

solarkraft2• 14 days ago

I love the UX of voice mode. I’ve always hated voice models.

Gemini’s being particularly egregious (always ending in some deranged question, can not reliably be prompted away) prompted me to build my own client for my real harness that simply does STT -> model -> TTS (both being independently useful).

I guess I see some value in a model responding quickly and with more nuance, but it’s not much. I can wait for it to finish. I’d much rather have it be actually useful. I’m not looking for a digital friend.

The delegation feature lets me see some value in a voice model for orchestration type features. But in either case, I don’t really like (or understand why others would like) talking to a model with different features and quirks just because I’m using a different medium to communicate over.

shostack• 14 days ago

I have built out something similar that let's me use my phone's hardware buttons to open an input stream with the mic for my Hermes agent over my matrix gateway and then has it play back with a local TTS model on my Pixel 10 Pro.

But the Deepseek v4 flash model I am using through OpenRouter is killing me on latency. Any suggestions to improve that?

weitendorf3• 14 days ago

I’ve spent my time very similarly working on my own voice stack project, but having also seen how non-developers use AI or experience technology in general, I truly think they are better served with a different UX and product than what we have.

In other words, if you’re building your own voice inference tooling you’re just about the polar opposite user demographic than the one that truly needs and will value this. You’re using voice as a medium of convenience doing what existing models are technically and practically “shaped” to be able to do, knowing how they work well enough that conversation is more like typing/prompting with your voice than a natural interface. I’m guilty of this myself but have you ever even paid for a voice/audio model or hardware?

Compare that to the millions of people with an Alexa device in their home who buy products through it, or who prefer calling support to get a human over poring over technical documentation. They’re actually very close to finally getting a version of “Alexa” that lives up to its promise and I’m happy for them

fy20• 14 days ago

Does it have full access to your chat history, project files, etc? That's the biggest limitation I have with voice mode right now, if I ask it about something I chatted about before (even in the same conversation) it has zero recollection of it.

simonw6• 14 days ago

You can start a chat in an existing session after pasting data into that session and it can then talk about that content. I haven't tried it with projects.

peab• 14 days ago

The best feature is that it can delegate questions out to GPT-5.5 in the background, so you're no longer restricted to a voice model that's several years behind the frontier.

Ahh, this makes sense. I was wondering when they would start doing this. I stopped using voice mode all together because it was frustrating talking to a dumb AI, when most of the time I discuss things with Opus 4.8 or gpt 5.5.

I was working on a phone call agent recently, and thought about doing this. It makes sense

jr3592• 14 days ago

does it work in codex?

grumbelbart2• 14 days ago

Can it in some way do some action based on the talk? For example, can it summarize the brainstorming into a text file, post it somewhere etc.?

simonw6• 13 days ago

At the end of the session I stop the voice mode and then type into my phone "write this up as bulletin points".

mrklol• 14 days ago

How did you give it access to your projects? That’s something I never thought does work as the voice model has no access outside of its scope?

simonw6• 13 days ago

I didn't mean the "projects" feature. I described my projects to it, had it search for extra details and pasted relevant inflection into the session before starting the voice chat.

redox99• 14 days ago

Definitely in the right direction in terms of architecture. However those "hmmm" "uh huh" interjected in the demo are pretty awful.

altcognito2• 14 days ago

I was hopeful that they avoided the well known sultry voice this go around, but alas. There is little hope for these companies.

The full duplex is awesome, and the feedback that it is getting what you're saying is ok, but in some of the demos was a little overkill.

I'll agree that using the "Golden Girls" was at least more entertaining than the usual pitch.

savanaly• 14 days ago

You have always been able to pick between voices of many kinds though? Do you find them all sultry? From the British woman to the 17th century pirate soundalike?

Jtarii• 14 days ago

If there was a voice that stripped away all the affectation I would be more likely to use it. It pretending to be human is extremely off-putting for me.

HardCodedBias2• 14 days ago

"I was hopeful that they avoided the well known sultry voice this go around, but alas"

Why do you care? You can select other voices. Why do you need to control others?

What is at the root of your need for domination?

altcognito2• 14 days ago

They are stealing/imitating someone elses brand.

Amping up an emotional connection is great for business.

Why do you think THEY need to dominate via an emotional connection?

dogscatstrees• 14 days ago

I do not fully understand the complexity behind achieving full-duplex but I hope this sets the bar for Anthropic to follow. Turn-based simplex is yesterday.

artdigital3• 14 days ago

What I’m missing from this announcement is the capability to use connectors and tools. I don’t really get it - NONE of the frontier assistants can use tools / connectors while in voice mode - Claude, ChatGPT, Gemini, Grok. It seems so obvious: I want to be able to research stuff, pull up documents, jot down notes and do productive work while I’m talking to it, and not end voice mode whenever I need to connect to an app or service.

It’s weird. The old Claude voice mode WAS able to use tools but when they revamped it, it lost that capability and is now pinned to Haiku :(

So, yay for finally a voice mode that’s powered by a frontier model and hopefully as good as Grok voice, but sad to still not see tool use while in voice mode.

(I haven’t tried it yet, only read the announcement)

codybontecou• 14 days ago

Last I tried this is exposed via their sdk and can be built.

AaronAPU2• 14 days ago

I could see it relating to tools having unpredictable latency but if they already do background hand off to 5.5 then it seems like they could just enable it within that context.

atonse2• 14 days ago

I’ve been using gpt-realtime-1 for my personal assistant that runs my company and plans my day. And it works pretty well, even makes tool calls and all that.

But the multi modal stuff has resulted in a lot of debugging with weird events and message and audio sequences having race conditions, but overall it is pretty awesome.

Looking forward to moving to this model later today and will chime back in with results.

atonse2• 14 days ago

Unfortunately, it isn't available on the API yet! Can't wait!

paxys• 14 days ago

Because they take too long to run, and have an unpredictable latency and success rate. Seeing loading spinners and error messages in a visual interface is fine, but it would firmly put a natural language conversation in uncanny valley territory.

Regular chat already supports voice input, so might as well use that.

artdigital3• 14 days ago

It can simply say “Okay let me try to connect to Notion and add this, just a sec”

zhyder• 14 days ago

A big part of this announcement does seem to be _delegation_ in the background; they give the example of web search but that could be any tool. I haven't tried it yet either but sounds like they've found a reasonable UX that mixes that sort of high-and-variable latency tool calling (potentially with agentic loops) with a continuously speaking live voice.

cj• 14 days ago

There's a tiktok of Sam Altman reacting to a viral clip of someone using Voice to time themselves on a mile run (it hilariously failed).

Sam's reaction was "Yea, it doesn't have access to tools like a timer. It's a known issue. Should be coming in about a year"

Edit: here's the clip: https://www.youtube.com/shorts/Py2YgJe8fqQ

tiahura• 14 days ago

A year? Is it that hard, or do they not see the value?

aliasxneo2• 14 days ago

One of the videos on the announcement page shows someone making coffee and it _appears_ that the agent counts 30 seconds in real-time. Curious to know how they made it do that without tool support.

goshx• 14 days ago

It does now with this new model.

BeetleB4• 14 days ago

I don’t really get it - NONE of the frontier assistants can use tools / connectors while in voice mode - Claude, ChatGPT, Gemini, Grok.

Is that true? I have a friend who often brainstorms with Gemini (I think just on an Android phone), and he has it actually do stuff related to the conversation (including adding content to notes).

In any case, you can always vibe code one with pi!

wilg• 14 days ago

I'm pretty sure that's a major part of this announcement? It delegates to GPT 5.5 which then uses tools.

hersko3• 14 days ago

This is not true. Realtime 2 can use tools.

gsibble• 14 days ago

I've been using tools in the OpenAI SDK with voice for well over a year now.

Just super difficult.

See more here:

https://github.com/sibblegp/ODAI/blob/main/routers/app_voice...

alexgyurov2• 14 days ago

Using gpt-realtime-2 you can achieve very similar results with low latency streaming which gives you this feeling of an assistant that is there in the room with you. I made a tweak to so you can try out the gpt-realtime-2 model with tooling that gives you this: https://sippet.ai/?enabler=hn

varenc• 14 days ago

Kept trying to use the demo, but despite giving it microphone permissions and seeing that the microphone was in use, couldn't get the demo to 'hear' me at all.

bariswheel5• 14 days ago

Exactly. I told the assistant to create world cup google calendar entries and it said it can't connect to my calendar, whereas I can have it do that with no issues on the normal gpt client.

saratogacx• 14 days ago

Funny enough I have only encountered two voice modes that were okay to use tools and they are so far out there that you wouldn't even think to try. Bixby and Perplexity (in android phone digital assistant mode) both seem happy to use whatever the account is connected to. I mainly use it for managing my local phone's calendar. Claude chat can interact with it but voice can't which is frustrating.

artdigital3• 14 days ago

Perplexity can use “some” tools (mostly built-in) but custom connectors were from my experience not available in voice.

I usually do a very simple test and tell it to verbatim tell me all tools that are connected

weitendorf3• 14 days ago

If you’re serious about this, let me know!

This is something I built for myself, and to experiment with inference stacks. You can obviously just transcribe audio and hand it off to frontier models, so all you really need is a good voice stack and a “driver” for the interaction (like a phone call, place to see their work).

There are two big problems with this space IMO. One isn’t that you can’t get this to work but that people generally aren’t willing to pay for it for themselves, rather as a way to screen or automate stuff to be used by other people. Did you know Claude Code has a voice mode and that openai launched whisper a year ago, both of which have positive sentiment and adoption in heavy ai tool users? Yet it’s a blip in their marketing or why people use their products, meanwhile outside of coding, most of the biggest and highest earning AI product companies so far are voice agents targeting customer service, sales, business processes, etc.

The second is related: voice is genuinely a low-bandwidth medium, so as a primary interface for interacting with AI there is not a lot you can get out of it compared to eg complex technical work or visualizations or interactive applications. It is physically and mentally demanding to speak-aloud a highly detailed prompt fast enough that VAD won’t cut you off and you have something with comparable information density or specificity vs text. But to keep up a shorter and more natural cadence you’ll not be able to wait on a lot of thinking/tool unless you play UI tricks (ums and fillers, two models in a trench coat), break the illusion of a single coherent conversation, or take a lot of long pauses.

That’s why for the supplementary coding use case it’s mostly used for remote steering, and for general use marketed towards the large and very not-online group of people for whom typing is not a natural or common thing for them to spend their time on. Now that so much spend goes through heavily used token subscriptions and they’ve proven that kind of product, they’re not marketing “tool to get the most tokens per $ running your subscription 24/7” anymore lol.

What I’m most interested in is true “ambient” tool use against my own data or work, and for-later (or pushed live via your phone) visualizations or “five models in a trench coat but still coherent” UX, which you probably are too. But I think unless you work a lot with AI tools already it’s hard to understand how that’s any different from asking Alexa to set a timer, and either way something you’re not so desperate to have that you go looking for it, or pay smaller vendors/set up yourself.

chc4• 13 days ago

Huh? You can expose tool functions to Gemini's live API, and it will call them as part of thinking about responses. I've used this to expose e.g. current GPS location for a smartwatch voice assistant.

zuzululu• 14 days ago

watched the live translation video very impressive

Seems like a shift from previous voice models where it sequentially processes voice to text then feeds it to LLM and then back which cant escape the clunky lag

not sure how pipecat stands now, gpt live seems like it takes audio tokens and does inference on it directly

trollbridge2• 14 days ago

I've wondered if this would happen, although doing inference directly on speech tokens would seem to imply an entirely different model (trained on lots and lots of actual speech).

athyuttamre16• 14 days ago

(Atty from OpenAI here)

GPT-Live-1 is the first version of a new generation of models, and we believe the full-duplex architecture + delegation enables entirely new ways of human-AI interaction.

Would love to hear your feedback!

worldsavior• 14 days ago

What made you to try again?

famouswaffles3• 14 days ago

Does video/image input still work with these duplex models?

athyuttamre16• 14 days ago

Image input is supported, but video is not today. We're working hard to bring it to you soon.

dandaka• 14 days ago

Can I connect it to my skills/tools? Example case, I have a knowledge base and event log in my company. I need a brainstorm companion, which will have full access to this knowledge, can converse about it and can invoke skills/tools available in the repo.

athyuttamre16• 14 days ago

In ChatGPT, Voice doesn't yet support connectors, but we're hoping to add support soon! Once GPT-Live launches in the API, you can also build custom integrations yourself.

vessenes2• 14 days ago

Can it sing? Is it an end to end multimodal model?

6thbit2• 14 days ago

Can it delegate to just one agent at a time or can it spawn multiple subagents for different tasks?

athyuttamre16• 14 days ago

There are many delegation models possible:

1. The voice model delegates to one agent.

2. The voice model delegates to multiple agents, and keeps track of tasks.

3. The voice model delegates to an orchestrator agent, which then delegates to sub-agents and keeps track of tasks.

YMMV depending on the exact product experience you care about, because there is a tradeoff between latency and layers of delegation.

Our current implementation is backed by one model, but you can imagine this getting much better with time.

ls-a• 14 days ago

Are you still using LiveKit for the back-and-forth architecture

Sean-Der• 14 days ago

Write up about the architecture is here https://openai.com/index/delivering-low-latency-voice-ai-at-...

k2xl• 14 days ago

When is it rolling out? Currently on ChatGPT Pro but not seeing it yet?

Fraterkes• 14 days ago

Hey! Bit of an unusual question maybe: if this stuff further exarcerbates the loneliness epidemic and atomization of society, will you be able to live with yourself you think? If you hear about teenagers only spending time with your chatbot in 5 years, will you feel some amount of personal responsibility or not? Always curious to hear you guys' perspective on that kind of stuff!

z7• 14 days ago

"Hey Leibniz, how do you live with yourself knowing that your binary system helped eventually replace human conversations?"

overfeed• 14 days ago

if this stuff further exarcerbates the loneliness epidemic and atomization of society, will you be able to live with yourself you think?

Looking at the 30,000-foot view of how society is set up: laws, economic system, employee incentives, etc, do you suppose it matters what the individual contributors think? I say this not to absolve anyone of responsibility, but to point out the obvious outcomes of our incentives across the strata (polity -> shareholders -> boards -> C-suite -> employees)

I will bet you dollars to donuts, somewhere inside OpenAI is a frequently-used revenue dashboard, but not for loneliness - if anything, OpenAI will make horny models and tout itself as a solution to loneliness, a la character.ai - if that earns them more money.

munchler• 14 days ago

I love the chatty tone of this utterly dystopian question.

famouswaffles3• 14 days ago

People who do this kind of stuff are very irritating. You clearly have some problem with the work they do. Instead of saying and approaching that outright, you pass it in some passive aggressive fake bullshit. Makes you sound like the kind of person I would much rather not be speaking to, which is kind of ironic given your comment.

password54321• 14 days ago

Technology is what you make of it. If you want to make it your best friend and your only friend, that's your choice. But I would guess more people would use it as a personal tutor. If it works as well as the demo, this already crushes most language learning apps. Actually the only apps for learning language that it would fail to replace would still be Tandem and HelloTalk because it still can't replicate the nuance of real human interaction.

WarmWash3• 14 days ago

That's not really a fair question, especially given the audience here on HN. Most here have blood on their hands from the previous 25 years of tech-eats-the-world.

derangedHorse3• 14 days ago

I would say no if the question was asked of me. It’s like asking if you’d feel bad about marriage if you ended up divorced with a child. Or if you’d feel bad about commenting if it made someone feel like they lost brain cells.

The morality of an action isn’t based on actual consequences because the future isn’t known in advanced. All we can do is act on the perceived consequences of our actions, and if we think those are good, pursue them.

dansquizsoft• 14 days ago

So many wet blankets on this post today with these types of questions...

liquicity• 14 days ago

Was this directed at the voice technology in the article, or at AI in general - as they are two very different conversations?

If you're talking about ChatGPT in general (as I guess you are) I think the Jury's still out on whether this will have a net positive or negative on society.

Right now, it's leaning towards negative, but there are optimistic futures to be had at the same time.

As someone who likes to think that they would turn down a lot of tech jobs due to moral dilemmas - for me, currently working on AI wouldn't be one.

For me at-least it's a tool to learn quicker, and reduce friction on projects I otherwise may not have dived into. As with all new technology, we're still in this grace period / lack the bigger picture we now have on other, now known to be destructive technologies.

quotemstr3• 14 days ago

GPT-Live-1 is the first version of a new generation of models, and we believe the full-duplex architecture + delegation enables entirely new ways of human-AI interaction.

Awesome. Are you guys able to share anything about the model architecture? I've been interested lately in split-transformer RVQ-based conversational agents, e.g. via stuff like https://arxiv.org/abs/2412.10208 (ResGen) and https://arxiv.org/abs/2603.18090 (MOSS-ITT) and of course Moshi (https://arxiv.org/pdf/2410.00037).

Intuitively, decoupling semantic and audio-timeslice-space generations with coupled but distinct histories is right model architecture, not just for these sorts of assistants, but for domains like robotics too.

mycocola• 14 days ago

- As models get better, have you considered some kind of filter or particular cadence to serve as a reminder that the user is not talking to a human?

- The videos felt scripted and dishonest

znpy• 14 days ago

Would love to hear your feedback!

I'm currently on the 20 $/mo subscription and using codex meaningfully, and i'm loving this.

I am considering bumping my subscription to the 100 $/month and this might be the reason i switch, BUT: i really envision me using this also through other means as well (eg: agents like openclaw/hermes) in agentic ways.

Will this be supported?

I can make OpenAI stuff the center of my agentic AI life, but I need it to be interoperable.

athyuttamre16• 14 days ago

We're adding support to the API soon, which will let you integrate with any agent in the background. Would love to see the community go wild with it. You can sign up to be notified here: https://openai.com/form/gpt-live-1-in-the-api/

iandanforth2• 14 days ago

Can we have less terrible voices please? Nothing that sounds like a bubbly millennial. Literally anything that has gravitas.

athyuttamre16• 14 days ago

Have you tried some of our deeper voices like Spruce? Would love to hear what your ideal voice is.

hersko3• 14 days ago

How does it compare to the realtime-2 model?

djtriptych• 14 days ago

I'm interested in how you can present simultaneous rich visual information about what is happening the side delegation work.

i.e. how will full duplex & delegation enable/enhance desktop flows w/o corresponding leaps in UI.

bariswheel5• 14 days ago

If it's not able to connect to my other apps like gcal, it should suggest that I use the standard gpt client, instead of telling me 'I don't have the capability to do that' which is misleading as some might presume the normal client doesn't have that capability either.

interloxia• 14 days ago

Any feedback from different locations or cultural groups?

One group's expectation of interruption for pleasant conversational flow can be just as off-putting as another's expectation of patient silence.

sandspar• 14 days ago

I like it! I was watching a YouTube video of someone driving in a big city. I saw an interesting skyscraper and asked Chatgpt what it was. After Chatgpt answered, I asked for a photo of the building to confirm, and Chatgpt helpfully showed it in-chat. It was the correct building!

And because the voice is so frictionless to talk to, I asked about what company owns the building, then that company's industry, then how that industry works in this particular country etc. I probably wouldn't have bothered going down a rabbit hole like this if I'd had to type. Voice is much easier than typing.

Anyhow it's fun! Thanks for making it!

justanotherunit• 14 days ago

Hey! Nice work, been looking into having a conversational modal integrated with my dev workflow.

Are we seeing any conversational layer integrated with codex soon?

NotSuspicious• 14 days ago

Super nice to be able to finally have voice mode search stuff in the background. The more conservational vibe is also a nice touch. The real game-changer we're all waiting on, though, is being able to vibecode/deeply interact with an OS through voice mode. Until then voice mode will continue to be a niche, interesting product. Once that's implemented, though, it will be one of the most important technologies available. There's a lot of people I know that don't use a lot of the frontier capabilities of AI right now because of the required typing interface. Once that's changed and you can interact with these capabilities through voice mode (and ideally on your phone) I definitely see them and lots of people like them becoming big users of AI.

pietmichal• 13 days ago

athyuttamre is a coward if he doesn't answer this

joshmarlow3• 14 days ago

I'm so mad that this might make me re-subscribe to ChatGPT. I wouldn't have believed how much I use the voice feature before LLMs and ChatGPT currently has the best voice interface. I think Grok's interface is the next best, then Claude.

ksd482• 14 days ago

Same. I might switch back to ChatGPT from Gemini because I use the voice feature all the time.

One of my favorite use cases is talking with it while driving on random topics and learning about them.

joshmarlow3• 14 days ago

Absolutely the same. Now that Fable is back, the Claude voice interface is... worth dealing with. The app mostly seems to have trouble recovering from networking issues which is jarring in a deep conversation.

misiti3780• 14 days ago

same, i use the voice feature every day at the gym, talk to it for 1 hour, and then make anki cards based on what it has taught me, total game changer.

wraptile2• 14 days ago

Just wait a few months and this will likely be available on a different LLM platform, especially if it actually works.

JasonSage2• 14 days ago

I for one am greatly looking forward to the day these kind of voice models can be run locally. It seems like the gap between open-weight and frontier is way larger for voice models than coding/language models.

jakswa• 14 days ago

Probably not _as_ good, but you can run gemma 4 for the ears/brain (accepts audio input), and kokoro TTS for the mouth. You want something like silero VAD sitting in front of the LLM so you aren't passing wasteful audio to gemma 4, so you send only voice activity segments. I type all this because I tried it out recently as a Zork experience, seeing how creative Gemma 4 12B could be. It was surprisingly good!

JasonSage2• 12 days ago

Yeah, I mostly mean for the TTS, which in my testing is flat and has no emotional register, or no nuanced variation. OpenAI speech in my experience is very good at things like communicating understanding or questions non-verbally using intonation, and I'm yet to see a local TTS model that will do contextual intonation well at all.

bfeist• 14 days ago

There doesn’t seem to be any indication whether this is available in the chat-got app nor is there any indication in the app that anything has changed. Anyone know how to actually try this?

dbbk2• 14 days ago

Read the post

meetpateltech• 14 days ago

GPT‑Live is rolling out now to ChatGPT users globally across iOS, Android, and ChatGPT.com. GPT‑Live‑1 will become the default model powering ChatGPT Voice for Go, Plus, and Pro users, and GPT‑Live‑1 mini will become the default for Free users.

athyuttamre16• 14 days ago

(Atty from OpenAI here)

We're beginning the rollout now, and will roll out in the next few days to ChatGPT users globally. Make sure to update to the latest version of the app!

no-name-here• 13 days ago

I'm using the current iOS app.

In the voice settings, there were 2 options - Standard and Advanced, as well as a help link saying they were in the process of rolling out the newest model -- I think the new model is named Live (and is not Standard or Advanced). The help link explained it all.

So at least for me in the app there did seem to be a way to check.

dbbk2• 14 days ago

It sounds like they've switched to a "native audio" model which if I understand right is what Gemini has had for quite a while?

ZeroCool2u2• 14 days ago

Gemini live has been able to do this for over a year now. I can just activate it on my phone and it really works surprisingly well, especially the interruption. I've tested it with my 95 year old Dutch grandmother and it switched seamlessly between English and Dutch with her and handled her poor hearing very well, including her asking for repetition.

I'm a little surprised by how much OAI is playing catch up here.

scosman• 14 days ago

ChatGPT has had this for over a year too. This is a better model.

davedx• 14 days ago

Is gemini live the same app I have on my oneplus 15? I don't think that's full duplex?

spongebobstoes4• 14 days ago

it is not full duplex. I think this GPT-Live thing is the first full duplex speech to speech model

TaupeRanger2• 14 days ago

What do you mean? OpenAI has had a real-time voice model since August of last year. This is a new model with better performance.

thewebguyd• 14 days ago

Gemini live is also pretty decent at computer vision stuff too. I've used it while working on my bike & car a few times, with my phone camera and it'll circle/highlight specific screws and parts. You can set your phone up on a tripod and it'll walk you through complete repairs for things.

ZeroCool2u2• 14 days ago

I used it for double checking some stuff while helping my friend build his PC! I had it in tight spaces and it helped me verify some details around which nvme slot to use first.

BeetleB4• 14 days ago

One thing Simon pointed out: Usually live voice models are not as capable as the frontier ones. What makes this one special is that it can delegate the task to a frontier model while talking to you.

HDThoreaun• 14 days ago

Well Google has been working on voice assistants for years now on android. It makes sense that they had a head start

kkotak• 14 days ago

Exactly! I've been using Gemini Live for a while now and have been able to converse quite fluently. Maybe it's the long think functionality that's a differentiator here from OAI, which I'd be surprised if Gemini doesn't come out with of their own this year.

mlmonkey3• 14 days ago

Is it possible to create a "companion" of sorts with this model, using, say, an RPi and a speaker + microphone? Not for advanced scientific brainstorming, but for seniors who are often alone in their homes.

100ms7• 14 days ago

If this is my idea of hell, I can't imagine what it'd be like for a 90 year old

mlmonkey3• 14 days ago

Try being a 90-year old with minimal social contact and nobody to talk to, wasting away in front of a TV blasting NewsMax or Fox News ... does that sound like Heaven or Hell?

moralestapia• 14 days ago

GPT‑Live can show it’s paying attention with phrases like “mhmm” or “yeah” [...]

Nooooooo!

sixdimensional• 14 days ago

Yeah, I mean - I know that people do this in real life, but when I encountered this recently while trying GPT-Live, it was truly annoying - I felt like it kept causing me to lose my train of thought. Perhaps if it was a bit more adaptive or could even be turned off.. but if it does this every.. single... time... I am saying something and I pause for a second... ugh.

cryo32• 14 days ago

This feels so dehumanising.

softwaredoug• 14 days ago

Does this model do better ignoring side conversations? That's the biggest hindrance to using ChatGPT's carplay feature is someone will say something, stopping ChatGPT from speaking or taking it in a different direction.

athyuttamre16• 14 days ago

(Atty from OpenAI here)

Yes! GPT-Live is much better at ignoring background noise, including other people speaking. Not perfect, but you should feel a big difference.

juberti• 14 days ago

yes, it now has much better ability to understand the conversation and decide whether it should respond (and you can also tell it when it should respond)

kindawinda• 14 days ago

Hello Justin! Mr webrtc himself and the infamous AIM 5.0

zelias• 14 days ago

how about api access?

athyuttamre16• 14 days ago

(Atty from OpenAI here)

Coming soon! Sign up to be notified here: https://openai.com/form/gpt-live-1-in-the-api/

I_am_tiberius• 14 days ago

Oh gosh. I was watching the video and thought it is a live stream. I just noticed when it restarted.

sampton• 14 days ago

I want this in my ear when I'm talking to people, so I can carry a real conversation.

small_model3• 14 days ago

This had to land before there new device could be launched, i.e. human to AI full duplex interaction, Apple should be worried. They fumbled so hard on AI.

SirHumphrey• 14 days ago

I am wondering for whom this new device even would be. Because phones work quite well for this use case and much more and everyone already has a phone.

small_model3• 14 days ago

Can a phone go get you a coffee?

joshstrange• 14 days ago

Hopefully this also means it does better with "interruptions". I have used ChatGPT Voice in the car before and sometimes car/road noises will cause it to stop responding in the middle.

I used it to help me figure out how to turn off a feature in the rental car I was in (adaptive cruise control, I love it but snow blocked the sensor and I wanted just normal cruise control but couldn't figure it out while driving).

This kind of voice chat is awesome and I'll be even more excited when open models have this functionality. I'd love something like this paired with Home Assistant (assuming we ever get decent hardware).

athyuttamre16• 14 days ago

(Atty from OpenAI here)

Yes, GPT-Live is much better at ignoring background noise! I use it every day in the car via our CarPlay integration.

jdudek• 14 days ago

This is what Siri should have been.

tiffanyh• 14 days ago

It was probably the original intent of OpenAI working with Apple ... but clearly there was a reason why Apple ditched OpenAI for Google/Gemini models instead.

jonstaab7• 14 days ago

This is the opposite direction AI should be going. Human relationships are the most valuable thing we have, and so, naturally, technology seeks to intermediate and now replace them.

I'm not Catholic, but this podcast presents a very interesting argument against talking to AI as if they were human: https://newpolity.com/podcasts-hub/debate-chatbots

zkmon5• 14 days ago

Most of what AI does is already in wrong direction. Not just human-to-human interaction, it took away thinking, creative work, sensory perception (glasses) and responses. People call it as helping humans, but I call it as sucking away the "human-ness" from humans.

After the damage is done, the mega corps would simply shrug and will say "Well, we were just responding to our business competition" The business knows no human-ness, because it is not a human. Businesses and machines are creatures that see humans as their fodder. And humans created these, assuming it is progress, to have businesses and machines. We call it progress because it required our mind power and it helped us to dominate other species. Dolphins are laughing at us.

amarant3• 14 days ago

I don't understand this line of reasoning. How are you hindered from doing any of those things? What part of "AI can now do X" makes it so you can't also do X?

ryandvm• 14 days ago

"Well, we were just responding to our business competition" The business knows no humanness, because it is not a human.

Yup. Except, by God, we ought to make sure the business has unlimited free speech (i.e. campaign contributions).

Citizen_Lame• 14 days ago

Bit naive world view. There are forces of rich and powerful who's only purpose is to maintain their status.

So thinking corporations and such were created to push human progress is laughable.

supern0va6• 14 days ago

Counter-point: I love that my rubber duck can talk (quack?) back, as well as record and summarize my thoughts on topics I'm working or stuck on.

I've wanted a good voice mode for precisely this reason. When I take my dog on a walk and I'm thinking about a bunch of problems/ideas, I'd love to have feedback and a record, or perhaps to even kick off research or ask questions to fill in gaps that would otherwise have me debating pulling out my phone to try to get an answer.

bb88• 14 days ago

Businesses have been anti-human for a while now.

If you think AI is bad, wait until I tell you about the horrors of social media who profit on controversy and division, US health insurance which profits on rejecting claims, and big pharma profiting on the opioid epidemic.

And it's not like this is new, either. Upton Sinclair was writing about this stuff a century ago with books like The Jungle.

The only difference between then and now is we "think" we're not evil today. We've lied to ourselves that "We're so much better than we were back then." Facebook wanted to bring people together originally, but they ended up providing the most toxic social media experience known to man. Facebook forgot to tell us they cared more about profit than people.

Please spare me the argument AI is the straw to break the camel's back here. The system has been broken a long time before that.

seizethecheese• 14 days ago

Isn’t voice I difference in degree rather than in kind? I definitely talk to AI as if it were human (one might say the UX of AI is to emulate a human). And a large portion of my interaction with humans is via text, for example, this post!

jonstaab7• 14 days ago

Right, I think the challenge is that LLMs are essentially language-based, which is itself a very convenient interface. Covering the maximally humanistic default interface with something more mechanical is like tying your own shoelaces together, but it would protect us from the psychological hijacking we're so prone to when interacting with these machines.

1659447091• 14 days ago

Isn’t voice I difference in degree rather than in kind?

There is a difference in expression / emotionality with speaking vs writing. Speaking tends to carry more emotion while writing is generally more deliberate/less-emotional*. Having a voice conversation will be more likely to get a human to engage in an emotional based expression mode, which could increase the chance of "false connections", believing the AI "gets" them or "understands" or "listens". This happens with text too, as some headlines show.

The issue is that while some people are going to "connect" with their AI in text and voice, some who do not make the connection via text may do so via voice because it tends to change a persons expression mode.

I definitely talk to AI as if it were human

Do you talk to it as if it were a friend or family? or Do you just use natural language to give directives? The distinction, I believe, is in the kind of way we express the "talking".

I talk to AI as if it were a tool that understands human commands and then executes those commands and relays them in a human understandable format. This includes commands to provide options that I may not have covered and explain the options. If I talked to a human this way, they wouldn't be around much longer -- unless they were an employee and even then they would probably be looking for a new job

After reading some of the psychotic break headlines from AI chats, I see some people really do talk to AI as if it were human. Which I would guess includes seeking broad "thoughts and feelings" on a persons situation or asking the AI if their view/side of things is the "right or wrong" side. Basically begging the AI to be responsible for their own thoughts, or simply offloading them and taking what comes back -- which is going to be what they wanted to hear because the entire context would be full of emotion based prompts.

*I forget which books Ive read about this in. It's not an obscure concept, quick search brought this up: https://kellercenter.hankamer.baylor.edu/news/story/2023/spe...

hoppp• 14 days ago

But a lot of humans can't engage in meaningful technical conversations... So why not use a tool for that?

FridgeSeal6• 14 days ago

Somewhat of a self-fulfilling prophecy no?

- nobody else with the skills - talk to machine - nobody develops the skills to have a conversation - go to step 1. - bonus step: your own skills atrophy too.

throwuxiytayq2• 14 days ago

How would talking to an AI as if it were not human sound? You can probably set your system prompt to insert “beep boop” between sentences and make it refer to itself as “Cybertron9000 Personal Computing Device” if that’s what you like. Is that an improvement? Or are you against voice computer interfaces altogether?

jonstaab7• 14 days ago

I don't know the answer. But a robotic voice is probably not a bad idea — just having a reminder that the thing you're talking to is not actually anything like you. If you want to go full send, you could have the LLM generate a clickable interface on demand so you could interact with it as a machine. Voice/computer interfaces are obviously useful, especially for disabled folks. But the ones that existed in the past didn't pretend to laugh at your non jokes or imitate vocal fry.

dividedbyzero• 14 days ago

The Star Trek computer doesn't feel uncannily human, that would be a good starting point.

SmirkingRevenge3• 14 days ago

My preference would be to turn down the fake emotional expressions and notes in the responses. No cheeky quips, etc.

Otherwise it's kind of like being manipulated by a psychopath

overgard10• 14 days ago

I think you could make it impersonal sounding. Like, right now ChatGPT throws in a lot of cheeky things. They don't really bother me because I don't anthropomorphize it, but, a lot of otherwise smart people are struggling with anthropomorphizing these things right now (Richard Dawkins..) so it strikes me that the less personality they have the better. (If you want personality just throw it into the prompt, ya know?) To their credit I think this is customizable in ChatGPT right now (it's been a while since I looked), but "impersonal" should probably be the default until society adjusts to these things.

mlsu7• 14 days ago

Yes, every minute you spend texting or talking to a chatbot is a minute that you'd have spent talking to another human beings. Literally the only important thing in life, the basis of all value, the formation of self-identity, comes from communication with other human beings.

Der_Einzige• 14 days ago

Such radical carbon chauvinism is ontologically evil. May those who hold this view reincarnate as durian fruits or cockroaches.

johnfn• 14 days ago

This is such a poor mischaracterization of OP that I actually started agreeing with OP more.

perching_aix5• 14 days ago

every minute you spend texting or talking to a chatbot is a minute that you'd have spent talking to another human beings

Very blatantly and obviously not though???

broken-kebab• 14 days ago

Let's not overdramatize, though. I'm not in need, or even in mood to talk to fellow humans every minute, so time spent with a clanker is not necessary taken from my human relations budget

BeetleB4• 14 days ago

Yes, every minute you spend texting or talking to a chatbot is a minute that you'd have spent talking to another human beings.

Human beings tend not to be available (results vary by culture).

Also, imagine you're 82 years old and living alone (e.g. widower). It is believed that lack of interaction is a significant driver of cognitive decline (which is why being hard of hearing accelerates the onset of dementia). I wonder if having an LLM to talk to under those circumstances will decelerate cognitive decline?

bossyTeacher• 14 days ago

Literally the only important thing in life, the basis of all value, the formation of self-identity, comes from communication with other human beings.

Is this sarcasm?

LostMyLogin• 14 days ago

Every new release I'm convinced we are just realizing the Knowledge Navigator.

https://www.youtube.com/watch?v=umJsITGzXd0

quotemstr3• 14 days ago

This is the opposite direction AI should be going.

There is no moral obligation, in any domain, to refuse to make a product that adults, with full informed consent, find useful and purchase. Who are you to say you know better than the market?

rel_ic2• 14 days ago

I disagree. I think you absolutely have a moral obligation to consider the impacts of your product.

Who are you to say you know better than the market?

You really don't think the scientists & engineers making these tools know some things better than the market?

perching_aix5• 14 days ago

Market conditions are not a moral standard either, nor do they represent any cohesive one in particular. Not sure why you're contrasting their opinion with this, it's literally no better.

gf000• 14 days ago

Markets only work in well-regulated environments, this has been known since forever (Adam Smith).

There is no meaningful competition in a marathon if I can drive you over with a car at the first 100m.

And thanks fkin God that we have regulations and meaningful laws and some asshole for-profit company can't just put drugs into food.. the "informed buyer" is bullshit. Humans are faulty, and there is a billion dollar industry meant to take advantage of said faults: it's called marketing.

FridgeSeal6• 14 days ago

This is a cute argument to make, which patently doesn’t work in the face of decades of evidence on the pernicious effects of social media _alone_, let alone the “turbo infantilising sycophancy machine”.

Pretending that everything’s totally fine and ok because “it’s adults” really just disregards reality.

2001zhaozhao• 14 days ago

Just give it a scifi robot voice and pretend you're on a spaceship

jonstaab7• 14 days ago

This is actually not a bad option

svantana• 14 days ago

I'm sorry, Dave. I'm afraid I can't do that.

jrflo3• 14 days ago

I see it more as a way technology could be abused rather than an inherent flaw in the technology itself. If you start to replace human interaction with chatbot interaction, that's bad, but there's nothing wrong with using a human-like chatbot in moderation. So many other types of technology are fine in moderation but can be abused in a human-interaction-replacing way: television, social media, video games, etc.

jonstaab7• 14 days ago

Yes, but design nudges use in one direction or another. Or, as McLuhan said, "the medium is the message."

carloseduardopx• 14 days ago

Again, we're paying for the fact that Sam Altman didn't understand the movie her

poly2it• 14 days ago

Where do you draw the line on how good human-machine interfaces should be? I'm sure this model could be a convenience for many, and while it may be social for some, I am not sure it would substitute existing human interaction for those users.

Besides, I do not think there is anything inherently immoral with not being social, or not having the ability to be. Consider for example people who do not naturally have the social network to interact with people they want to (e.g. some gifted children).

I am not convinced this model has enough empathy to satisfy most users on an emotional level. A bond is not merely an exchange of words, but prolonged and deep contemplation of the other being. We cannot introspect into these machines, and they certainly cannot yet do the same to us.

nullbio2• 14 days ago

I disagree. Fluid natural conversational AI is far more productive than any other interface for working with LLMs. Although I suppose you could make the argument that it should be more... Robotic like. Like in StarTrek. Which, is honestly probably better for work, too. A "get shit done" mode, of pure, cold, efficiency.

SmirkingRevenge3• 14 days ago

In one of the videos the AI quips back things like "Happens to the best of us" - its basically pretending to be human and that feels kind of creepy and weird, like it's trying to cultivate a para-social emotional bond.

I just want voice assistants to reliably understand what I say and do what I mean

So hopefully you can turn that off.

There are plenty of applications for that more human conversational style though (from mock interviews, improv practice, learning languages, etc) - I just don't want that for most things.

derangedHorse3• 14 days ago

Ironically, Data (from TNG) has a lot of heart to him

filoleg• 14 days ago

This is the opposite direction AI should be going. Human relationships are the most valuable thing we have, and so, naturally, technology seeks to intermediate and now replace them.

Valid, but, I think, you conflate two separate things.

AI voice mode as a human socialization/conversation replacement? Cringe in my book, fully in agreement with you. Though my opinion on that aspect remains the same, regardless of whether it is done through text or voice.

AI voice mode as an alternative interface to interact with AI-as-a-tool? Great idea imo. There were a few instances where I was either too tired to type or wanted to brainstorm things in more of a freeform mode, for which a well-working voice mode would have been great.

Naturally, the current distinction between AI-as-a-personality and AI-as-a-tool exists purely on the user's end. All I know is that I want the latter a lot, and if some people want to use it for the former purpose, that's not my problem. Sadly, I think that it will be judged more on how an average person decides to use it (i.e., in the most degenerate/reductionist ways possible), as opposed to being judged on the merits of what it can actually be used for by someone who just treats it as a tool.

streb-lo• 13 days ago

Basically 100% of my interaction with AI is some form of question.

But there are people that treat it like a therapist or a friend.

In my opinion, the 2nd group should be discouraged from using these agents in this way, as it cannot be healthy. But if places like Reddit etc. turn into bot towns where do the AI companies get insight into the general population? Through the eyes of their most mentally unstable users?

So I don't really see things changing, and they'll probably get worse.

akomtu• 14 days ago

From one perspective, AI serves as a wedge that separates those who want human culture from those who want machine culture.

Sol-• 14 days ago

Aren't they already very cognizant of handwringing like yours? Their article mentions various safeguards and actively steering the model away from being emotional companions and so on. It's a far cry from the OpenAI two years ago or whenever it was when they were entertaining the idea of allowing/enabling adult conversations with their models.

I personally think this is a moralistic regulatory overreach. And they definitely do that due to political pressure too, since there are various bills around the world in various legislatures that want to regulate AIs giving useful advice and being too personal to talk to.

So you can rest assured, I think, at least in that regard. The AI disempowerment will come to us anyway, just in a more sanitized corporate form.

standardUser• 14 days ago

I don't think most adults can get much social value or satisfaction from an AI conversation they know is not a real person. Those who can get that satisfaction likely have so few human-to-human interactions that an AI companion may be as good a solution to chronic loneliness as any.

I'd be more worried about the inevitable robo-nannies who could end up talking more to young children than actual people.

bodash• 14 days ago

I’m completely on your side, but also I think about all the AI saturations in the society like this:

“Driving to work or running a 10km on the weekend sharing the same surface goal: from A to B.

You may have less autonomy whether you should drive to work, but you definitely have more decision power about whether to go for that run or not”

jstummbillig2• 14 days ago

This is the opposite direction AI should be going

I don't understand the counterfactual. What's the opposite direction of this direction that's desirable? Less capable voice models are obviously not it, so I am curious what direction you mean or if it's just vague indirection.

mrcwinn2• 14 days ago

Regardless how natural AI becomes I’ve yet to replace any human relationships. Where do you see the aim of technology as trying to replace people? You might be using it wrong.

Unearned5161• 14 days ago

I want to bring some attention to a spectacular sleight of hand that occurs at minute 4 of this podcast:

"The way that I formulate the argument, just to get us started here, is that acts, the things we do, have ends. We act for an end. They have a purpose. And that it is wrong to deliberately frustrate an act from attaining its end, from attaining its purpose."

I will draw your attention to the three instances of "end", first we have the noble, tautological, "have ends", actions have ends; then, following close behind we see "an end", we act for an end, those ends have been made into one now, singular end; and finally, "its end", the act, as an entity unto itself, has an end you mustn't interrupt.

imhoguy• 14 days ago

Hopefuly I see conscious young people in my surroundings who refrain from using human like AI (voice). They say "it is cringe".

Moreover I think aggresive robocalls and advertising will derail the entire trend in a few years, people will become tired of fake talk.

khurs• 14 days ago

For people with disabilities who can't type or see, ai conversations I imagine may have been life changing way to access the internet and knowledge

asdewqqwer• 13 days ago

SOME human relationships are the most valuable thing we have. Many (if not most) human relationships in many cultures are just trespassing everyone's boundary via peer pressure.

Disclaimer: I am from Scandinavian.

HardCodedBias2• 14 days ago

While this is likely very useful to an enormous number of people, I suspect it will be even more useful for the elderly (if somehow it can be made accessible to them).

IIUC the literature, there is serious loss of functionality associated with lack of verbal interaction. People can say "they should just talk to more people" or "more people should make time for them" but the fact of the matter is that it doesn't happen, and if this helps terrific.

h1fra• 14 days ago

GPT-Live being developed in california and being an over-active listener...

londons_explore• 14 days ago

The demo video shows quite how rough around the edges this is....

Doesn't quite stop fast enough when you interrupt it. Can't find info quick enough so you have to change topic and then have it give you results later, etc.

This is a move in the right direction, but there is lots of engineering still to be done!

TaupeRanger2• 14 days ago

You're right, and to me it's refreshing to see a promo video that shows how the real product works, rather than a sanitized over-produced edit that takes out all the flaws.

xtracto• 14 days ago

I'm currently watching Better Call Saul for the first time with my wife. The fact that they used old ladies for the Ad, and that it is evident they are reading from a prompt (fake-ish feeling) gives me strong James McGill vibes haha. Hopefully the actresses were paid handsomely.

athyuttamre16• 14 days ago

(Atty from OpenAI here)

This is a move in the right direction, but there is lots of engineering still to be done!

Could not agree more. We see this as the first version of a new generation; expect many improvements in the future.

aristocrazy• 14 days ago

As someone with a chronic eye disease that makes screens difficult, I love this voice feature. It gives me hope that, even if my disease progresses, I’ll be able to rely less on screens and screen readers for many everyday tasks in the future.

bearjaws• 14 days ago

Feel like the intro video is very odd.

Basically have an older lady (not their target audience) blatantly reading a teleprompter.

Why are they going after this audience? Retired people have no use for delegated tasks or information. They also are the least likely to use it and not get frustrated.

hazelnut• 14 days ago

to show that anybody could use it - even older people who are less tech experts.

they are trying to expand beyond their tech audience.

ge96• 14 days ago

GPT-Live... buy me that thing I saw on tv

cute_boi• 14 days ago

Is this website heavily vibe coded. I tried to select text and things went black.

https://imgur.com/a/ABGWRTO

6thbit2• 14 days ago

The new architecture makes sense, it seems many of the remaining problems like noise and interruptions are at the sound processing and integration level rather than at an architectural or model level now which makes for an exciting new era.

cahaya• 14 days ago

When GPT-Live in Codex, so i can walk the dog while shipping?

evtothedev• 14 days ago

For the first actor - why does her accent change the longer she talks. It's like they had an "Estelle Costanza" dial that they started at zero and slowly rolled up to 8 or 9.

davmar• 14 days ago

It changed because she came home to find her son treating his body like it was an amusement park

jdmoreira• 14 days ago

Great video by the way. Extremely good!

consumer4514• 14 days ago

One piece of feedback on that to anyone from their team, could not get audio sync in Firefox. Chrome worked fine.

csto12• 14 days ago

Can a model like this critique your accent/pronunciation? That would be cool.

victor9000• 14 days ago

I'm at the point where pricing is the first thing I look for in announcements like this.

danjc• 14 days ago

It would be great if we could have AI that wasn't trying to emulate a human. When it expresses emotion, we should see that as a bug that needs to be fixed.

mrcwinn2• 14 days ago

Fantastic to see this. I use voice a lot. It’s not quite lived up to my expectations but I think this gets much closer.

drusepth• 14 days ago

I reaaaaaally hope we have an option to disable those random ums and ahhs that interrupt for no reason. :|

consumer4514• 14 days ago

I was surprised all that made it into the demo video. Did not seem cool. Is that "active listening" or something?

xpct3• 14 days ago

I think it just doesn't know when it's its turn to speak, and cancels itself out when it hears humans.

stri8ted• 14 days ago

Its actually useful, when you are launching into a long monologue and want periodic acknowledgement that its "listening".

rcarrol62• 14 days ago

I'm crying, that guy who tries to get it to count to 100 may actually have a chance

nadzzz• 14 days ago

Forget the fancy scores, the real test is whether it'll just let the guy count to 100.

nico1207• 14 days ago

I just told it to count from 1 to 100, and it actually correctly counted and didn't leave out any number. I'm impressed

rcarrol62• 12 days ago

Doing the work that matters

djb_hackernews• 14 days ago

are these human actors or are is the whole demo AI generated?

mixel• 14 days ago

I was missing the part where the grandmas are saying "I have absolutely no idea what I just said" :D --- Besides that really nice demo I will give this a try, I tried some voice models before and the issue is I will ask a question, get a answer withing the next ~1 sentence and then the usual LLM bs follows which I just wanted to skip at that point

charcircuit• 14 days ago

and linked parents may be notified in higher-risk situations involving signs of potential self-harm or suicidal intent.

This is an abuse of user trust and violates people's privacy.

nakedneuron• 14 days ago

"i'm starving."

sounds cynical in my ears. energy demand of these toys will cause many problems, people elsewhere starving being one of them.

sumoboy• 14 days ago

Some brilliant marketing really, the grandma test.

xpct3• 14 days ago

A cool test, until it hit's the my family's grandmas test :)

fuddle• 14 days ago

I looks like they took inspiration from Thinking Machines - http://thinkingmachines.ai/blog/interaction-models/

BorisMelnik• 14 days ago

this is excellent, I've been meaning to update my phone-dialer.apk "fake phone conversation" for when I'm trying to get out of a social sitation (not joking)

croes• 14 days ago

So more AI psychoses coming.

surround• 14 days ago

How does the voice model delegate requests to GPT-5.5? Can the voice model generate text?

programjames2• 14 days ago

Didn't Standard Intelligence release a duplex model two years ago? Sounds disingenuous to market this as a new generation of voice models, when it is really OpenAI finally catching up to the current generation after two years.

https://si.inc/posts/hertz-dev/

neko_ranger• 14 days ago

Looking forward to a list of support languages. This would be amazing for language listening/speaking practice. Yes I know it doesn't replace the talking to real people and "immersion". But cheaper than a flight

gotrythis• 14 days ago

Last night, I was using voice for the first time in a few weeks, and it interrupted me and said, a bit aggressively...

"I'm going to stop you right there. Let's keep the conversation focused on the topic we were covering or a new relevant topic".

I tried to probe it for why it did that, what rules it was following, and it eventually told me...

"My role is to keep us focused..." and, "The behaviour you saw was my attempt to moderate tone".

I've heard of LLMs doing weird things like this, but it was the first time it happened to me. I hope they fix that. It was creepy.

For context, it heard my partner say, "I guess it's the same thing as you mom, because she's..." and then it cut us off.

hatthew• 14 days ago

If it is to be believed—which I wouldn't count on—it sounds like the intention of the prompt was to keep the model focused, but the model's interpretation of it was to keep you focused.

wayeq• 13 days ago

"your mom, because she's..."

a lovely lady.

WhitneyLand2• 14 days ago

Much better than it was before but it’s still significantly weaker than a direct chat.

For example I asked

“Why should LLM attention use dot product instead of cosine similarity, being that we often hear vector magnitude does not encode most of the useful information needed”?

The voice response was directionally right but lacked detail and was a little hand wavy.

The answer to the same question in a text chat was much higher quality.

The voice response replied “let me think about that…” so it appears to be invoking 5.5 as advertised, but it’s definitely weaker.

I had reasoning set the same for both.

WarmWash3• 14 days ago

I would naturally assume they cut the background thinking level to the minimum. It's a halting problem question and with in text 5.5 with max thinking will chew on a question for 5-10 minutes sometimes. That would make a pretty awkward conversation.

athyuttamre16• 14 days ago

A lot of this is steerable! Our current personality is optimized for brainstorming and conversations, but you can provide custom instructions to ask it to go deep and give you info-dense or more technical answers.

bariswheel5• 14 days ago

I found myself probing more and more questions to have it do that, I wish it could remember to provide details answers, I thought the replies were way too short and hand-wavy like one of the prior comments suggested.

WhitneyLand2• 14 days ago

That would be cool, but is there a way to differentiate between voice mode and text only output in the custom instructions?

Otherwise, it seems like preferences could be competing.

cnxhk• 14 days ago

You can read far more text than listening. If the voice response is too long, people lose the patience quickly. So it is better to show it on screen if we have too much text.

weitendorf3• 14 days ago

I think the bare truth is that the target audience for this product is not people who are highly particular about terminology in answers involving vector mathematics.

It’s a different set of tradeoffs for users that don’t already have strong engagement or interest in existing AI products.

Do you realize how many more people prefer to chat over the phone and watch television or videos in their free time vs type multiple paragraphs of text into a chat window and then read 3x more back?

I’m not even talking about grandma here, it’s a non starter for the vast majority of humans who don’t spend their free time writing and reading tech news. To most people, having to write out a bunch of words describing their problem/goals, then sift through pages and pages of detailed response to get an answer, feels overwhelming and not worth doing.

tills13• 14 days ago

I use AI for my job. I understand the impact (as much as anyone can) that it will have on society. I recognize the value.

But I just want to say that talking with AI casually is critically lame. I cringe every time I have to ask my Google Home to turn on the lights and people are having full-on conversations with it? And, imo, dangerous considering how sycophantic AI is. The stupidest, most gullible, most insecure person right now is looking at this thinking they are about to make a new friend.

hersko3• 14 days ago

I wonder why they don't compare it to their existing live voice model realtime-2.

sneak• 14 days ago

Why do I have to solve a captcha to read a blog post?

skilled• 14 days ago

Not had a chance to experiment yet, but will this be an upgrade for using AI for language learning?

Martinussen2• 14 days ago

This voice is awful, possibly one of the worst AI/computer voices I have heard in like two years now - what's up with that? Is this seriously the best a company burning this much money can do, and they consider this acceptable to release? Like two syllables in and my first response was to grimace and physically cringe. Does anyone here think this sounds good, or even just "fine enough"?

Do engineers that work on this for long periods of time stop seeing the forest for the trees and think this could be mistaken as human? I'm saying this as someone that assumes all narration/most VO work will be fully AI fairly soon (for better or worse.)...

timpera• 14 days ago

What don't you like about the voice? Geniune question, I'm not using it in English but I think it sounds fine in my language, and it's an improvement over the previous one.

Martinussen2• 12 days ago

It's just... Very robotic and clearly generated, makes random inhuman pitch shifts, etc.. Very alien overall.

iknowstuff• 14 days ago

There's like 10 voices to choose from.

wewtyflakes• 14 days ago

Great to hear about full-duplex. When using voice mode historically, it was infuriating to have the AI go on a long-winded rant or explanation and I would be shouting again and again "stop. shut up. shut up! shut up!!!"; I just needed a clean way to interrupt it.

tracekl• 14 days ago

If an idiot has this on in the subway my conversations are surveilled. What is the antidote? Train another model to talk about bombs etc. and flood the clanker (and by extension the FBI)?

lrvick• 14 days ago

I cannot wait for the qwen version on huggingface.

vinay_ys• 14 days ago

I have not used voice mode much with chatgpt. I was surprised to learn that they were already not running the voice model like a UX orchestrator while utilizing other models in background for actual research/response etc. I guess it's good they launched what they could and got here in steps. I suspect in the near future my personal device (mobile/laptop) will be powerful enough to run any UX orchestrator model locally – and route to multiple frontier closed/open model providers in the background as appropriate. The battle is going to be platform owners (Apple/Google/Microsoft) wanting to lock-down the access to that local hardware and local interaction paradigms (ambient always-on full-duplex voice) and intermediate through their platform layers - rationalizing it as consumer security/privacy protection (which is right for most people, but sucks for the open market). Meanwhile I suspect OpenAI/Meta et al will try to build their own hardware and become platform owners themselves, though unsuccessfully. And it's going to take some company like epic games to get them to open that up. and that's probably what the next decade is going to be all about.

yottamus• 14 days ago

I worry what this will do to human communication if it becomes commonplace. Will everyone learn to be a forceful speaker, speaking over anyone they want to stop speaking?

rc1• 14 days ago

Ciao.

WarmWash3• 14 days ago

I imagine we are not far off from talking AI's being better speaker/listeners than 99% of the population. Frankly, the bar isn't that high anyway.

modeless• 14 days ago

It was obvious from the live demo that this thing still hasn't learned when to shut up. When it stops tacking on "I'm here when you need me" to every response that could have just been "ok" or simply silence, maybe they'll have something. I think voice remains OpenAI's most disappointing product.

taurusnoises• 14 days ago

I don't have many opinions about how individuals use this tech (although the AI as friend trend is a bummer for many reasons), but have maaaany (negative) opinions about the customer service industrial complex that's already using this in what seems to be an attempt to fool people into thinking they're speaking to a real person. Which is why I now, like a freak I never thought I'd need become, always ask "Am I speaking to a bot or a human?" when dealing with CS. So far, it's worked, and the bot transfers me. But, I fear the bot will eventually be programmed to lie abiht that, as well.

overgard10• 14 days ago

Like a lot of AI things, this seems both cool and kind of creeps me out. I've never used voice interfaces in the past (siri, the google one, whatever is on my tv) so I'm probably not the target market, but this does seem like an improvement.

The part that creeps me out is, we're living in an era where we're more disconnected from each other than ever before. Do we really need to be replacing conversations?! The demonstration video of old ladies sort of hints at something for me, which I think we already have a societal problem with the way we treat the elderly (and a massive elderly-loneliness issue) and there's kind of a sadness of imagining people becoming really close with this machine that doesn't really think. Definite ick factor.

rohansood15• 14 days ago

I feel similarly. But texting became the primary form of inter-personal communication in the last couple of decades, in part because that was the primary modality technology could handle.

So, now that we can talk to computers, maybe we will feel more comfortable talking to people too? Wishful I know, but one can hope right?

bottlepalm2• 14 days ago

None of the things I'm talking to ChatGPT about are replacing human conversations. It's replacing having to type a question into Google on my phone.

But you do bring up a good point with old people with no one to talk to. This technology would be a god send for them. And if you think otherwise I hope your next words are that you routinely visit nursing homes and talk with old people.

overgard10• 13 days ago

Um, your argument is unless I'm directly involved with something I'm not allowed to critique it?

Here's a real story that's very much more likely story than your "godsend": https://www.reuters.com/investigates/special-report/meta-ai-... I don't think giving old people AI psychosis is anything other than inhumane.

jstummbillig2• 14 days ago

My most common use case for voice mode is: Kid. Talking to and asking about stuff that we see outside becomes something to do together.

I think we already have a societal problem with the way we treat the elderly

The actual problem is that we keep up the wishful thinking regarding our collective capacity and interest to entertain physically and mentally frail people. Before old people stop deteriorating in ways that make them unfun to interact with (I have high hopes we will be getting there in the next 20 years or so) this is not going to happen. Just like we are not going to save the environment by telling people to pay more for less and have less.

It's not a societal solution and I am increasingly irritated by people who pretend otherwise. It is causing so much harm under the appealing guise of humanity. It's quite the opposite and just people unwilling to deal with reality in a constructive way.

overgard10• 13 days ago

Do you think every society treats their elderly this way (not just now, historically)?

I'm just going to go out on a limb and say if you think people deserve bad treatment because they stopped being "fun" you should probably look into your moral compass.

larrik• 14 days ago

Haven't tried this, but talking to Claude in its app is so much better than talking to Siri that Apple should be ashamed. It got every word perfectly the first time, including programming / project management terms.

Meanwhile, Siri struggles to send basic texts to my kids.

motoboi• 14 days ago

Oh, god. They are marketing it as an old people artificial friend. Probably will blame users in the future when they get attached and have ai-induced psychosis.

Disgraceful.

On the technological side, it's a marvel!

cactusplant7374• 14 days ago

Many older people are very lonely. This could help a lot of people.

odie5533• 14 days ago

I'm not convinced wireheading the elderly is a good solution to their loneliness.

lbrito2• 14 days ago

That's kind of like the joke about MAID solving the Canadian healthcare problems: I've heard you're ill; have you considered dying?

himata4113• 14 days ago

I think this is fine as long as the models stay honest. I.e. refuse to be a friend, girlfriend, partner or pretend to be someone.

franky47• 14 days ago

The live translation demo reminds me of the Babel Fish in The Hitchhiker's Guide to the Galaxy. This could be very valuable to have in your headphones while travelling.

Not super impressed by the model constantly interrupting the user in the other demos though.

barnacs• 14 days ago

This is getting way too dystopian for my taste. People in the know need to stop pushing the narrative that this is somehow anything more than statistical autocomplete.

dzonga• 14 days ago

if I'm not mistaken - Amazon Nova Sonic has been full duplex for a while.

programmertote• 14 days ago

I watched the demo video. Isn't that agent's voice too hasty in responding? Maybe that's what they (OpenAI) are trying to show off as full-duplex tech, but I can't shake the feeling that I'll feel annoyed if the AI agent interrupts me when I'm speaking....

dmje• 14 days ago

Anyone else find the use of the ladies in the videos to be pretty patronising? Or just me...?

CrzyLngPwd• 14 days ago

Her is here?

ralusek• 14 days ago

I have built a few voice based integrations into my applications that use these live agents (gpt and gemini), but they are always too expensive to be viable. I have to end up hacking up context and turning on and off in ways that are very fragile. It'll end up being $2-5 for about the 30ish minute sessions I typically end up with, and it throws the price of the product I'm making completely out of whack.

lbrito2• 14 days ago

GPT, now with more interruptions!

JimsonYang• 14 days ago

I was expecting the grandma voice to be the voice model and i was like woah this is incredibly good

bariswheel5• 14 days ago

For important and learning tasks,I would not use the voice feature as it was way too short and 'conversational'. I would use the 'record' feature and have it read the long, articulate answer to me. If this new conversation feature doesn't feel like I'm 'hanging out' with a friend, but actual longer high content answers, It'll win me over. Otherwise I thought the previous conversation mode was way too watered down and I found myself getting frustrated having to keep asking many questions to further probe down to the details. I don't know, these things don't change much, we'll see.

csswizardry• 14 days ago

https://www.youtube.com/watch?v=POI5XHAU0sc

bariswheel5• 14 days ago

I don't think the voice feature should act like a human, but 'complement' it. I already have friends I can talk to. Perhaps for quick answers it might be helpful but Google already does that for me and I don't have to worry about having to 'archive' the chat later and creates clutter.

I really hope at some point we can 'option click' or whatever, and choose multiple threads to archive. It takes FOREVER to archive the cluttery chats one by one. That's my one wish feature, please make batch cleanup of my client reasonably easy. Imagine having to delete one file at a time in a folder of 50 plus files. Barf.

guilhas• 14 days ago

Quite sad to think society will more easily be apart and develop a relation with a company bot

ksec• 14 days ago

I am surprised that Siri has only been mentioned 5 times here, out of the current 355 comments.

I am wondering if this because Siri is so bad, people think of Siri now as a voice activation method rather than an AI assistant as it was intended.

The demo is so good, what was once a sci-fi / Iron Man Jarvis services is now real. I don't follow AI closely, but all previous iteration were at best ask and answer type of services. It wasn't real conversation. And whatever flaws it may have now, at the rate of improvement within a few iteration it will surely reach good enough stage for majority of people.

This is also scary. Not just for adults, but for kids. How they could become even more isolated.

I remember the PC era, the internet from Information Super Highway to Web 2.0 Then Smartphone. It may have been obvious to many but AI really is something much bigger than all the previous three, perhaps combined. And it is also the only one that I think is scary.

m12k• 14 days ago

Siri is how I set timers, alarms and reminders on my iPhone. Every once in a while, I'll try to use it to play something on Spotify via my Sonos, then give up and do it manually in the app instead.

cyrux004• 14 days ago

cant wait for husk irl to test this

ninkendo• 14 days ago

A year ago I tried using the voice mode to be the worlds most over engineered golf score card: I basically said “ok I’m golfing with some friends, mind if I tell you the scores as we get them and you tell us the running totals?”

It was awful, it kept overhearing us talking and thought we were talking to it, interjecting with nonsense because it couldn’t really understand what we were talking about. And when I would say “ok render a score card” it couldn’t drop to the text interface or anything, it had to stay as voice, so it fumbled around trying to read the scores back to us.

It’s a very stupid use case but I viewed it as a stress test to see how well the voice mode and multi-modality could work. It failed miserably, but I’ll be interested to see if this new version does any better (not that I actually need this use case, writing on a card with a pencil is just fine.)

NikolaNovak2• 14 days ago

This is fascinating to me.

Whether that's due to my slight autism or massive nerdery, I don't want more realistic voice. I already switched to non-advanced voice in gpt, and I cannot imagine wanting the mmmhms, the yesses, the laughs, in my ai interaction. I want to ask a structured question and get a structured meaningful response. Informative and structured are really the KPIs. The umms and ahms of existing gpt advanced voice are annoying enough, the recent increased usage of first person almost a deal breaker (when asking for bike technique on lose surfaces yesterday, it literally gave me "back when I was learning bikes riding" story - eww).

Fascinating to see the architectural advances though, even when they deliver something I personally don't need :)

y1n02• 14 days ago

Honestly I find it distracting when people do the mmmhmm thing. I don’t find it encouraging or helpful or whatever.

NikolaNovak2• 14 days ago

When I go into listening node, I listen. Actively and intensely.

Apparently it unnerves people. My wife coaches me to give occasional Yes,Go On, or UhHuh. But it's a conscious, learned, active mechanism for me. Intuitively, I'll tell you if we've weered off my desired conversation path and I'd ask the same courtesy. I've learned very late in life it's apparently an autism thing. Either way, I don't seek mmms and umms in real live people and I especially don't need fake ones in a machine :)

senectus1• 14 days ago

100% agree, its also disturbing that they want to make seem like a human.

I suspect most people would prefer it to behave like the computer in star trek. just be there, and be responsive in direct polite ways. dont try to be a friend, dont try to pretend its people. its not. its fucking code.

Melonai2• 13 days ago

People here? Maybe. The rest of the world? I really don't think so! From what I've seen, people really don't like when these models behave robotically, they seem to want them to become indistinguishable from humans in their view, with the biggest difference being that the model should not disagree with them if they don't want it at that model. I've seen way too many people that explicitly want a "friend that never says no to me" type of thing from LLMs. That's far from everyone, but that's literally the second most wanted use case I've seen from random people I've met, with the first being "Google but easier".

polarbearballs• 14 days ago

A nightmare scenario would be that people become so accustomed to talking to agreeable AI, that they lose the inability to talk to anything that disagrees with them or has different perspectives with responses that don't include stroking the ego.

Archer6621• 14 days ago

It's a very interesting phenomenon. It's often said that famous stars become delusional exactly because they are surrounded by yes-men who are too afraid of rocking the boat and of losing their relationship with the star.

But if I have to think of my own experiences here, I would say that overly agreeable people become tiresome pretty quickly. To me their perspective does not offer anything of value without any pushback, as it certainly doesn't help with grounding my own thoughts. Perhaps it's why being too nice makes it difficult to form deeper bonds, and maybe paradoxically it is therefore a good thing that LLMs are overly agreeable.

It probably also depends on one's mindset - those who are interested in growing could be more likely interested in opposing views, while those who perceive that they have already "made it" (e.g. stars) perhaps don't care so much and prefer an agreeable tone.

anon-39884• 14 days ago

What the fuck is the rationale to make this? I can kinda see the rationale behind Facebook and social media, they _could_ be useful. But this? This is like making a nuclear bomb out in public. The world is going to get a LOT worse in the next 20 years. I am not talking about energy usage. I am talking about a society where everyone is TRULY inside their own bubble of creation.

luciana1u• 14 days ago

GPT-Live: because what every Zoom meeting needed was an AI that can also zone out and ask you to repeat the question

y1n02• 14 days ago

I used it a few times. It's weird. It reminded me of Christopher Walken with all the oddly placed pauses.

miki123211• 14 days ago

Once this gets video capabilities and is ported to glasses, it'll be a major revolution for blind people (and I say this as a blind person).

People have tried "smart <thing> that helps blind people navigate" since the 80s, many, many, many times, and all such projects failed. The cycle of "wow, blind people could benefit from a navigation aid, why don't I make one, if there's none around, I must surely have been the first bright university student to think of this idea" is pretty well known in the community, and I'm personally quite tired of it. Nevertheless, I think this may be the one.

Circa 2020, I have said that people who are getting a guide dog now are probably getting their last one. I think we aren't far off from that prediction coming true.

dnel• 13 days ago

Even the guide dogs are getting laid off?? That's the most depressing AI victim news yet.

hdjrudni2• 14 days ago

At first I was really impressed, I thought granny was the voice. But it turns out it's the same kind of annoying voice and tone. And then Constance starts talking to it and it immediately cuts her off at 1:05, after they just explained it was better at conversation flow.

Seems a bit disappointing, but the 3 overlapping questions example was impressive.

thefabsta• 14 days ago

I just tried this and I find the constant interruptions infuriating: ah, alright, mh, mh-mh, go on, etc. This means the model already reliably detected my point/question isn’t finished. Please give me an option or dial to tone down the back channel noise.

HeadlessChild• 14 days ago

OT: This commercial video is gorgeous looking and I adore the actors!

OrangeMusic2• 14 days ago

The ad with the grandmas is cute and funny, but from the first 20 seconds you can see that the voice annoyingly interrupts people while they are talking. It's almost as if it tries to reply too fast - faster than a real person would, and the results is that it replies while you're still talking.

Oh and there was also a small fail in the live translate demo: the grandma says "tell him that..." which the bot translates verbatim, whereas a real translator would of course understand that this is an aside not to be translated.

Well I guess at least I should be happy that they're transparent in their ads :)

simongray• 14 days ago

They don't act the way humans would.

It's normal to start a sentence after the other person in the conversation pauses, especially if you're eager to say something (like the chat agent is), but a real human is socially aware and would in most cases immediately cease talking if the other person starts another sentence at the same time. Humans do this so much in their conversations that the other person doesn't really register the interruption at all.

OrangeMusic2• 14 days ago

Exactly. If they have a setting somewhere for the minimum duration of a pause in the user's speech before starting replying, they should just crank it up.

In this other add [1], it's even worse, the user has to say "There's more to the story though" and almost looks annoyed + the agent overreacts to _that_ with a weird "Aaaaahh!".

Oh well... I'm sure they'll get it right eventually.

[1] https://openai.com/index/introducing-gpt-live/?video=1208099...

rhet0rica• 13 days ago

Encoded in its design are the biases of its designers. It acts like a nervous twenty-something from San Francisco.

ndkap• 13 days ago

Maybe they are trying to outmatch the world's worst translator: https://www.youtube.com/watch?v=foT9rsHmS24

_s_a_m_• 14 days ago

ok but how many es has "beekeeper"?

ed_mercer• 14 days ago

Delegation for deeper work

Except that you can't actually delegate since connectors and tools are not supported.

emilfihlman• 14 days ago

I hope they fixed the models in that they don't interrupt and jump in and that you can order them to be silent. Previous model could not be silent and always cut me off and spoke over me.

Nevermark• 13 days ago

The speech is so fake sounding. Not fake technically, but like a fake/pacifying kind of person. It is a very strange tone to train for.

The model is not interested in the conversation, it is just "serving" a conversation.

Which is very different from the engagement of SOTA text models.

flumes_whims_• 13 days ago

Do any voice models support different conversation "threads" with different context?

james-mxtech• 13 days ago

Reserving judgment until the actual feature is set public. The announcement post itself doesn't tell you much.

GPT‑Live

Related Stories