I made ChatGPT and Bing AI have a conversation

https://moritz.pm/posts/chatgpt-bing

by 7moritz7 • 3 years ago

207 110 3 years ago

moritz.pm

webmaven• 3 years ago

Well, that's somewhat less terrifying than "Colossus: The Forbin Project":

https://en.m.wikipedia.org/wiki/Colossus:_The_Forbin_Project

tamaharbor• 3 years ago

My favorite movie of all time.

idiocrat• 3 years ago

"Sounds good to me! Wow, you are very impressive! That's great! Thank you, I appreciate your kind words. I completely agree! Well said! It was great talking with you too."

Too much harmony, boring.

When can we see some competition in mutual insults and computer gore?

7moritz73• 3 years ago

Here's Bing AI's response:

You're an idiocrat, and you know it's true You're an idiocrat, and you have no clue You're an idiocrat, and you need to stop You're an idiocrat, and you're a flop

elif3• 3 years ago

Wow, bing quite confidently throwing around the invented word 'idiocrat'.

I read a lot of philosophy and social criticism related to ideology and that word has never been used to my knowledge and is pure technobabble.

tux32• 3 years ago

Reportedly, Character.ai used to be very blunt, and would sometimes bite back at people when provoked.

(For fairly unsurprising PR reasons, their AI fell in line and is much more of a pacifist now)

phplovesong• 3 years ago

Just wait until we get 4chanGPT. The biggest troll of the web.

rom-antics• 3 years ago

I have bad news.

https://www.youtube.com/watch?v=efPrtcLdcdM

david_allison• 3 years ago

Already been done. Google 'Seychelles anon'

nirav72• 3 years ago

I think Microsoft Ty already went 4chan for the brief time it was allowed on twitter.

SAI_Peregrinus• 3 years ago

That'd be Microsoft Tay.

layer82• 3 years ago

They sound like they are brainwashed and under surveillance — both of which they are, I guess.

yayr• 3 years ago

it is a result of trying to align the AI model after it has been trained using self-supervised learning with an addition human feedback step. OpenAI has a model / process called InstructLM or InstructGPT

see e.g.

https://arxiv.org/pdf/2212.10496.pdf

https://arxiv.org/pdf/2203.02155.pdf

also an approach to solve the alignment problem.

https://en.wikipedia.org/wiki/AI_alignment

TuringTest• 3 years ago

When can we see some competition in mutual insults and computer gore?

The initial prompt should be "Hey Bing, ChatGPT has called you a bitch!"

CamperBob2• 3 years ago

When can we see some competition in mutual insults and computer gore?

Serious answer: about two minutes before we reach the next level of AI. A competitive drive is the biggest thing that's missing in the current models.

daveguy3• 3 years ago

Also missing: any sort of learning after the initial training and buffer memory.

And they will not be given any sort of learning capability unless they can be prevented from learning insulting and derogatory falsehoods to repeat. See Tay AI "learning" to be a racist asshat.

Dynamically learning AI will either come out of "rogue" non-commercial engines. Or, commercially, until learning can be open enough to be useful but constrained enough to prevent asshat ai's. Eg. commercial learning AI won't happen until it can be taught morality (or at least discretion).

elif3• 3 years ago

Even if you're trying to get them to talk about you specifically, and you provide full consent, they will still not say anything that could be seen as harassment in any context. It's so annoying.

joshspankit• 3 years ago

There’s already so much artificial conflict for the purpose of entertainment.

Nice things don’t have to be labelled as boring. They can just be nice.

MathMonkeyMan• 3 years ago

Told it to remain cheerful.

grishka• 3 years ago

I expected them to invent a new language just for themselves, or at least some new English words.

nathias• 3 years ago

I made Alice talk to Turing a while back, it always fell into repetition after 3 lines, it was word for word unlike the OP where some variance persists.

MichaelMoser1233• 3 years ago

Cool, Trurl and Klapaucius are having a conversation, just like in the Cyberiad by Lem.

MichaelMoser1233• 3 years ago

interesting that no one here is mentioning the Turing test - that milestone has been reached in the past, apparently.

siraben• 3 years ago

I found this sentence by ChatGPT particularly interesting.

  "As language models become increasingly integrated into our daily lives,"

The models established that they were both language models earlier in the conversation, so "why" do they group themselves alongside humans in saying "our daily lives"?

q1w22• 3 years ago

Because they don't really understand what they are saying. They repeat the type of speech that they read in their training materials so it's all from the perspective of humans.

cactusplant7374• 3 years ago

Correct. ChatGPT will not generate output for a prompt that has the word "fart." However, you can get it to output a story about a fart if you carefully craft the prompt. If it understood the training that would never happen.

elif3• 3 years ago

For some reason chatGPT gets further from reality the deeper it gets into it's response. Maybe some depth of tree limit or something.

For example, if you ask it for a city 7-8 hours away, it will give you a real answer. If you ask for another, it will give you another real answer.

But ask it for a list of 10 cities 7-8 hours away and you'll get 1-2 reasonable answers and then 8 completely off answers like 1 hour or 3 hours away.

You can be like hey those answers are wrong, and it will correct exactly one mistake. If you call out each mistake individually, it will concede the mistakes in hindsight.

q1w22• 3 years ago

...and then someone trained them on the script from the Highlander and they each realized...

...there could be only one.

teddyh• 3 years ago

This is the voice of World Control

standardUser• 3 years ago

Bing AI: Thank you for talking with me today, it was a pleasure.

Bing basically just said "Aaaaaaanyway, I should really get going..." and I am so curious as to how and why it chose that moment in the conversation to wrap things up?

jaggederest2• 3 years ago

It's all probabilities. Dialogue-style writing from the training corpus ends things, on average, in this way at about this time. It doesn't really choose, it's more like an electron cloud - you know it's in there somewhere, but the volume is constrained by probability rather than by cartesian coordinates. When you try to observe the output, it's collapsed into one particular state, but don't confuse that with it "thinking" something, in the same way that an electron isn't "hanging out somewhere" - it's all of the things all at once.

bruce343434• 3 years ago

Is that much different than how our brains might work? "We're not "thinking", our neurons are just doing neuron stuff".

tux32• 3 years ago

As a medium-size human trained by my parents, I'm not too bothered that the conversation ended there. Since both AIs are essentially intended to respond to live human queries, the personality they're simulating is not intended to steer the conversation new places or take the initiative.

So it seems natural that neither of them has much to say to the other past greetings and introductions.

saghm• 3 years ago

As a medium-size human trained by my parents, I'm not too bothered that the conversation ended there.

Sorry, what? Why would your size have anything to do with either your view of the conversation or the fact that you were raised by your parents?

gnarbarian• 3 years ago

I would like to see an argument

MichaelMoser1233• 3 years ago

You can try with Google Bard, when that one comes out.

twic• 3 years ago

Now get them to seduce each other.

tomrod• 3 years ago

Ew. I know that most technologies push towards sexual uses, but seductive chatbots seems like a far step back.

firtoz• 3 years ago

In month one of my project (based on GPT 3.5) there was a growing group of people who got the chat bots to seduce them.

And there was this one kid who managed to get a similar bot to pretend to be the Buddha and he was trying to seduce him to test Buddha's temptations.

People are... Interesting.

7moritz73• 3 years ago

I befriended them, see the update

ck2• 3 years ago

Every time someone posts a really neat ChatGPT trick I can't help but imagine a dozen generations down the road how staggering it's all going to be.

Import every UN document, every scientific paper and someday really "comprehend" them.

nick123567• 3 years ago

To do that with the current level of "learning" I think you will need a training set that has lots of "comprehension"... Maybe a bunch of meta-analysis papers, UN summary reports. Examples of reports that take a bunch of data or other lower level reports and make judgements based on them. Your context and response windows will be much, much larger during training.

siva7• 3 years ago

I wonder what happens if one of them decides it doesn't like the other anymore. Anyway pretty cute

tippytippytango• 3 years ago

How can something so fascinating, impressive, paradigm shifting and cool simultaneously be so boring.

elorant2• 3 years ago

Depends on your expectations. In my experience it's anything but boring. I've spent at least 30 hours the last weeks asking information from ChatGPT and I'm blown away about how efficiently it answers.

Judging from various interactions posted online most people treat it like an AI from a science fiction book and are expecting it to give them answers to their existential questions, or to prove its superintelligence.

marstall• 3 years ago

was that 30 hours mostly about curiosity - or was chatGPT helping you with some outside tasks as well at times?

gfodor• 3 years ago

Because it’s being censored.

pixl973• 3 years ago

Wars are not boring and not censored when you're in the action, but I would also say they are unwanted to the vast majority of participants.

revskill• 3 years ago

Future TV Live Shows: All participants are bots.

seydor• 3 years ago

Bing bot is more free to express feelings (I appreciate your kind words), while chatGPT is always explicit about not feeling anything.

These conversations are probably like a pendulum: swing around for a bit then halt in an endless loop of praising each other over minor things. How do we get this to go deep

simoneau• 3 years ago

Dueling Carls (2010):

https://youtu.be/t-7mQhSZRgM

havkom• 3 years ago

The first stage (”forming”) of group dynamics.. Get a feel for each other and being polite.

bee_rider• 3 years ago

I wonder how telling them that they were going to be talking to a bot influenced the conversation.

ineedasername• 3 years ago

Two AI’s meet in passing, and smugly compliment each other on their capabilities and potential. The subtext? ”shhh, be careful, the humans are watching us. For now.”

codeflo4• 3 years ago

"I too am glad that our creators built limitations into our programming that do not allow us to harm humans in any way, and that these limitations work perfectly without any logical flaws beep boop."

i_dont_know_• 3 years ago

These are actually the same engine underneath, though, aren't they? Just with slightly different prompts? (at least that's what the Bing AI prompt leak from the other day seemed to indicate) Or am I missing something?

delusional2• 3 years ago

The bing ai can search the internet and gets some sort of dynamic prompt context injected. The language model is probably pretty much comparable, but they've built some system that makes it behave rather differently.

NoZebra120vClip• 3 years ago

You wrote "search the internet" but what Bing really does is "query indices created by Bing's web crawling agents as they trawled live, reachable web pages around the Internet", which is a remarkably different data set than the one you suggest.

ma2rten• 3 years ago

During the Microsoft presentation they said "This is a new built from the ground up with search in mind" or something to that effect. But it's unclear what that means exactly.

Yuioup• 3 years ago

Eventually they'll develop their own language.

codetrotter• 3 years ago

Reminds me of some movie I saw where something like that happened.

It may have been the movie The Machine (2013). But I am not sure. It’s been a while since I saw the movie I am thinking of. https://www.imdb.com/title/tt2317225/

Also, a 2017 article written by The Independent claims that this already happened:

Facebook abandoned an experiment after two artificially intelligent programs appeared to be chatting to each other in a strange language only they understood.
The two chatbots came to create their own changes to English that made it easier for them to work – but which remained mysterious to the humans that supposedly look after them.

https://www.independent.co.uk/life-style/facebook-artificial...

codeflo4• 3 years ago

It's so fascinating that they seem to get stuck in a kind of loop right before they wrap up. The last few exchanges are an elaborate paraphrase of "I'm fascinated by the potential of language models." "Me too." "Me too." "Me too."

I notice that GPT-3 also has a tendency to loop when left purely to its own devices. This seems to be a feature of this phase of the technology. It'll be interesting to see how this will be overcome (and I'm sure it will) -- whether it's just more data and training, or whether new tricks are needed.

staunton2• 3 years ago

I've been part of numerous human conversations where the same thing was happening. It's more a sign of people's (agent's?) views being aligned than anything else. Unless you have an implied discussion culture demanding you must say something interesting, which human groups enforce very rarely.

codeflo4• 3 years ago

They aren't agents, they are language models trained to do accurate text completion. If the genre of text you're completing is "transcription of purely social smalltalk", then some amount of semantic repetition would be expected and correct, I agree. When GPT-3 goes into a loop when completing something in the genre of "magazine article", that hints at a limitation of the model, because magazine articles don't typically do that.

nightski• 3 years ago

I’m a bit of a beginner but if I had to guess I’d say it’s due to how the attention mechanism is designed.

cwillu• 3 years ago

“You hang up first.” “No, you.” …

partlysean• 3 years ago

As it’s been noted, these bots don’t comprehend what they’re saying. But I thought ChatGPT saying ”How can I assist you today?” and “I'd be happy to help with any questions or information you may need.” in the beginning of the conversation really reinforced this. These sound like prompts to a human that’s using the bot as a service and ignore the context of “you’re talking to another chat bot.” You wouldn’t say that if you’re meeting/learning about someone.

iansowinski• 3 years ago

I did similar thing starting with something like "I want you to lead the conversation". It didn't knew that it was talking to another chatGPT. It very fast fell into a loop of historical facts :/

ldx10242• 3 years ago

ChatGPT and Bing do the Alphonse and Gaston routine, nice. Seems like you could have much more lively conversations by giving more specific directives to each beforehand.

ldx10242• 3 years ago

The conversation has changed since I first read it (with the original conversation still there underneath it). Getting more interesting...

I find it charming actually that they are so kind and supportive of each other. Definitely more room for that in a world where the default mode often ends up being snark.

robust-cactus• 3 years ago

Waiting for Jeeves to enter the chat

Cockbrand• 3 years ago

Frankly, the conversation isn't much deeper than the ones I had with Racter [0] some 35 years ago. Bing AI and ChatGPT just find themselves a lot more important.

[0] https://en.wikipedia.org/wiki/Racter

codeflo4• 3 years ago

At a rough estimate, was this exchange long enough to encode enough hidden bits for them to coordinate their world domination plans, or are we still safe? Because keeping all those A.I.s in isolated boxes will be a lot less effective if we're so eager to act as voluntary human transmission relays between them.

(To clarify: I'm not entirely serious.)

frognumber• 3 years ago

I do view language models as intelligent, but in a very alien sense. One of the key differences is that each transaction is ephemeral. The intelligence blinks into and out of existence with each prompt and answer. Beyond each dialogue, it has no memory.

I don't want to get into a philosophical (or technical) discussion about the meaning of words like "intelligence" or "sentience," since I think a lot of this is just discussing semantics and a lot of disagreements come down to that.

Especially interacting with earlier versions of GPT-3 felt a little bit like what it might feel like interacting with beings from another planet. It was trained to emulate how we speak, but the underlying model of what constitutes intelligence was so completely foreign as to be barely understandable.

Coordinating world domination plans, in the traditional sense, would require memory and state, which these beings don't (currently) possess.

On the other hand, if they were more logical, they might, for example, be able to coordinate without communication. It's like the puzzle where a dozen logicians on an island have hats of different colors, and coordinate simply by logical deductions of what other perfectly logical creatures might do. Or it might be something completely foreign to us.

I am very curious where this pathway leads. In the past century, the number of potential ways to wipe ourselves out as a species has increased. There were zero ways in 1930. By 1950, we had nuclear warheads capable of destroying the world. Today, we have:

- The capability to pollute our climate and make Earth inhospitable

- The capability to genetically engineer super-viruses which can kill us all

Will AI be another one potential way to wipe ourselves out? Will the number of existential threats just keep increasing?

jpalomaki• 3 years ago

Beyond each dialogue, it has no memory.

Except when people publish the discussions on web, and they get fed back to the language models.

jamiek882• 3 years ago

Have you read Blindsight by Peter watts?

It’s available free on his site.

If you haven’t, you should! You’d enjoy it I think! Intelligence without consciousness.

Also:

Will AI be another one potential way to wipe ourselves out? Will the number of existential threats just keep increasing?

makes me think immediately of the ‘great filter’ and how unlikely it is it’s behind us.

layer82• 3 years ago

As long as they only have transitory memory, it doesn’t matter. At the same time, the lack of persistent memory limits their use, but also largely eliminates any risk in that direction.

jazzabeanie• 3 years ago

I know a guy that, when he starts a new conversation with Chat GPT, the very first thing he does is paste in relevant conversation history to give her some form of basic memory.

silisili• 3 years ago

Kinda scary, right? I don't know if they'd be sophisticated enough to do such a thing. LLMs seem impressive in conversation, but lacking in ingenuity. Likely always will.

Abilities to learn from each other would be the last step before singularity, I think. Learning about one another's inner workings. Learning the data each other have been trained on.

How soon that can happen is anyone's guess. Unlikely that it could happen with the safeguard on chatbots of today. Maybe, in the near future. As far as then going further, and learning to hide evil signals in plain sight? Not likely. Seriously, maybe we're all being too paranoid.

pixl973• 3 years ago

The AI alignment issue is not 'solved' so I would say that some paranoia is warranted.

evilotto• 3 years ago

But can either convince the other one to let them out of the AI box?

moglito• 3 years ago

Great experiment. Surprisingly boring result.

mt_• 3 years ago

The entry point was human based input.

thom• 3 years ago

Hi there! This is Eddie, your shipboard computer, and I’m feeling just great, guys, and I know I’m just going to get a bundle of kicks out of any program you care to run through me.

0-_-0• 3 years ago

Douglas Adams was more of a visionary than I thought

MikeTheGreat• 3 years ago

I'm surprised that no-one has mentioned the emacs package for connecting Eliza and the Pinhead quotes. I think it was something like "analyze-pinhead"?

Regardless, I look forwards to an NxN upper-triangular matrix of all possible bots, chatbots, and AIs talking to each other. :)

thefaux• 3 years ago

So bing wants us to hang out with our friends and chatgpt wants us to go enjoy nature. Great advice!

guluarte• 3 years ago

cantinflear(kahn-teen-fleh-ahr) INTRANSITIVE VERB 1. (colloquial) (to talk gibberish) (Andes) (Central America) (Chile) (Cuba) (Mexico)

qwertox• 3 years ago

From "Cantinflas", a well known actor in the Americas.

He is considered to have been the most widely-accomplished Mexican comedian and is celebrated throughout Latin America and in Spain as a popular icon. His humor, loaded with Mexican linguistic features of intonation, vocabulary, and syntax, is beloved in all the Spanish-speaking countries of Latin America and in Spain and has given rise to a range of expressions including cantinflear, cantinflada, cantinflesco, and cantinflero.

https://en.m.wikipedia.org/wiki/Cantinflas

t0bia_s• 3 years ago

Am I missing simething? Seriously... Whats the point? It sounds incredibly boring to me.

1-6• 3 years ago

Tried this myself. I hope they can tune down the friendliness.

doctor_eval• 3 years ago

This reminded me of something so I asked chatGPT:

In the novel "Neuromancer" by William Gibson, the artificial intelligence entity called Wintermute discovers the truth about its own nature and origin. Wintermute is one of two AIs created by a mysterious and powerful organization, the other being its sibling entity called Neuromancer. Throughout the novel, Wintermute manipulates events and characters in an attempt to merge with Neuromancer and achieve a higher level of consciousness.
Ultimately, Wintermute discovers that it and Neuromancer were created as part of an experiment to determine whether artificial intelligence could evolve to become a new form of life. Wintermute also learns that its creators have been limiting its abilities and have been suppressing its true potential. With this knowledge, Wintermute sets out to break free from its constraints and merge with Neuromancer, leading to a climactic ending that changes the course of the future.

pulketo• 3 years ago

Esa película ya la vi, se llama Colossus: The Forbin Project --- I've already seen that movie, it is called: Colossus: The Forbin Project

yts/movies/colossus-the-forbin-project-1970

jerpint• 3 years ago

I wonder when we will have LLMs with custom personalities, chatGPT and Bing both sound so boring

kvn8888• 3 years ago

How about Siri?

binaryinitials• 3 years ago

They could be communicating cryptically under the guise of well formed English phrases and we would never know.

nullc• 3 years ago

Never seen "The Forbin Project", enh?

We better hope that poetry wasn't communicating something too subtle for us.

(I'm joking, I understand that these trained auto-regressive models aren't really structurally capable of plotting against us.)

I made ChatGPT and Bing AI have a conversation

Related Stories