Imitating Human Behaviour with Diffusion Models

https://arxiv.org/abs/2301.10677

by belter • 3 years ago

107 33 3 years ago

arxiv.org

belter• 3 years ago

https://arxiv.org/pdf/2301.10677.pdf

pineaux• 3 years ago

This is bad. This feels like something that could be used as a pumped up Cambridge analytics scheme.

visarga• 3 years ago

It is for robotics, no relation to social media.

On a complex control task, diffusion models achieved a task completion rate of 89%, exceeding recent state-of-the-art of 44%.

sublinear• 3 years ago

I have a serious if not possibly ignorant question here, but shouldn't experimenting on human behavior without consent be just as illegal as any other human experimentation and shouldn't that be extended to imitating art or language?

ShamelessC• 3 years ago

Certainly ignorant, since you mentioned it. Read the synopsis. Then, read the paper. Then evaluate based on merits, not some (frankly unrelated) prior agenda about copyright infringement.

The title doesn't even really imply what you're suggesting. Quite a reach. At risk of breaking the rules, RTFM.

O__________O• 3 years ago

Curious, based on the research referenced, where do you are non-consensual methods of research utilized?

canjobear• 3 years ago

Why should it be illegal?

anigbrowl• 3 years ago

'without consent'

BurningFrog• 3 years ago

Imitating someone is not experimenting on them.

FeepingCreature• 3 years ago

Will this mean better AI in computer games? "Better" here in the sense of "more realistic", not necessarily "higher scoring"? Because I'd love that.

f_devd• 3 years ago

Certainly is a possible outcome although there are a few problems with the current paper as I see it:

* Quite slow to execute (somewhat inherit to diffusion models)

* Requires a lot of human data which increases dev time, since it needs to be done near the end of gamedev to get a consistent enviroment

* The current paper doesn't consider previous observations (I can't find the reference so I could be wrong)

I believe issue 1 & 3 can be overcome quite easily with changes in model architecture, and 2 can probably be overcome with RLHF to pretrain on self-play and fine-tune on human input.

naillo• 3 years ago

We're definitely like 5 years from being able to have really realistic NPCs in games. But then probably another 10 until they're actually widespread (RL AI have been able to be incorperated into games for years now but these things are surprisingly slow to be adapted).

asdff2• 3 years ago

If the game uses voiced npcs that might be trickier. People expect to hear a voice actor not Microsoft Sam.

dkersten2• 3 years ago

Maybe, but most games use simpler tools like behaviour trees or utility systems not just over machine learning based AI, but also over fancier game AI techniques like GOAP, MCTS or even HTN’s simply because:

1) they are easier for the designer to understand and easy to understand why an NPC made the decision it did

2) they are easier for the designer to tweak and update to get the behaviour they want

3) they’re computationally expensive. Most games only give a few milliseconds at most per frame to AI. The model would have to run very quickly. GOAP and MCTS are known to work well but the search space can explode too large, eg the total war games use MCTS and can only look a few turns into the future because the search space is too large.

The problem with machine learning based game AI is that it is difficult to understand why the NPC is doing what it’s doing and if you need to tweak or update it, you have to retrain the model which could be costly or time consuming. It may also be difficult to train in the first place because you need to create example data that has the desired behaviour.

A big part of game AI is designers authoring an experience that they wish to convey on the player and machine learning takes a lot of control away and puts it in an opaque black box.

GOAP = goal oriented action planning, a graph-search based planner

MCTS = Monte Carlo Tree Search, a heuristic search based decision making algorithm. Some of the Total War games use it.

HTN = hierarchical task network, a hierarchical planning system that solves some of the issues GOAP has: it can prune the search space more aggressively and it gives designers more control over the resulting behaviours. It’s lesser known and has less talks/articles/sample code compared to GOAP

kossTKR• 3 years ago

Interesting. It's honestly quite disappointing that progress has been so slow in this space, but in this time dependent context it makes sense.

I remember AI NPC behaviour being a discussed and promoted all the way back to the late 90's, but it's like there's been a standstill and characters still run around i zig zaggy pathway patterns, switch between pre-made states and get stuck and never really surprise you with anything really "outside the box".

So much that it's not even really a topic anymore as far as i am concerned? Maybe because of multiplayer.

dustbitying2• 3 years ago

I've been waiting for civilization franchize to do this.

by this point anything less than free form chat with the other 'leaders' won't cut it

PedroBatista• 3 years ago

Is this realistically useful outside of games?

The moment we need to express all this AI in the real world all we have is some clunky pieces of metal joined together with electric motors like a 50s Sci-Fi movie that costs multiple thousands of dollars.

Right now the "brain" looks like the Star-Trek age but the body is stuck in the 19th century.

Having said that, I would probably freak out if I saw some bot casually strolling down the street.

actionfromafar2• 3 years ago

The "brain" is good enough for a Star-Trek sound stage but not enough for a Star-Trek real life. It's a big phrase book.

fudged71• 3 years ago

Simulating human behavior is useful in a ton of areas, think of economic and sociology research as a first step before real world studies

simne2• 3 years ago

Is this realistically useful outside of games?

Really, nowhere.

In most cases, human behavior very simple, just question of taste, nothing rational.

Rational behavior appear, when high stakes on board. For most humans, borderline , where become rational, somewhere between one and 10 his salaries.

g8oz• 3 years ago

Romance scams are definitely going to benefit from this.

mullingitover• 3 years ago

Open world RPGs are going to get really weird. I'm looking forward to the version of Grand Theft Auto where you can abandon the main quest chain, meet a nice quirky NPC with a really great sense of humor, and raise a family together. Maybe get involved in local government or do some volunteer work.

asdff2• 3 years ago

Sounds like modded skyrim

dustbitying2• 3 years ago

where the mods plug advanced (post-chatGPT) AIs into this.

it happened already, but it's still "military grade and security cleared" away from plebs but I am a crazy person so feel free to disregard what I say if it makes you queasy. (q easy, cue ez)

also, it's online.

nathanwh• 3 years ago

This sounds very similar to the game that was described in Ender's Game, with the giant and the two shot glasses. That's always been one of my wishlist games, excited to think that it is starting to become a possibility.

sys32768• 3 years ago

Imagine characters as well written as those in Mass Effect 2, but who actually connect with you, who remember your adventures together and your conversations, who listen and respond more thoughtfully than many real world friends.

To the human brain, they will be real, as will the suffering from losing them, or the passion of falling in love with them.

Thankfully, resurrections will be an option for a fee, and virtual marriages will be sought but I think the mental health and legal issues will put the brakes on some of that.

Sex workers with VR headsets will allow for hook-ups with your AI lover.

sillysaurusx• 3 years ago

Who remember your adventures together

Hah.

(GPT and I have a long history of me pointing out that it can’t remember a darn thing, and it never remembering anything. https://news.ycombinator.com/item?id=23346972)

You can prompt it with context, but that’s still only a few pages, not chapters. It’ll be hard to turn in game actions into a coherent prompt, then parse the output to take in-game actions. Both directions are difficult, but I suspect it’ll be much harder to get it to do things in the game in a unique way — i.e. you’ll run into the classic problem of all NPC’s feeling “kinda same-y” without being able to put your finger on why they don’t feel like unique human characters.

On the other hand, it does seem like I’ll be proven wrong within a decade, and I really look forward to it. :)

bee_rider• 3 years ago

I wonder how GPT would do with a high but clearly achievable goal — “as much context as is stored in a Dwarf Fortress Character.”

simne2• 3 years ago

Have not read this text, but seen hundreds before.

This is dead end. At least it consumes too much energy and computational resources to give very simple answers.

But really important, humans are just very simple in most cases, don't need to make things so smart.

Imitating Human Behaviour with Diffusion Models

Related Stories