Adventure game graphics with DALL-E 2

https://hpjansson.org/blag/2022/08/16/adventure-game-graphics-with-dall-e-2/

by marcodiego • 4 years ago

428 158 4 years ago

TillE• 4 years ago

These sort of complex 2D environments are a nightmare to work with in adventure games, since you have to manually detail where the player character can go, how the character should grow/shrink to simulate perspective, etc.

I checked a video of Milkmaid of the Milky Way (2017) and sure enough, the environments are 3D with heavy stylization. Characters are animated in 2D but positioned and rendered as billboards or similar. 3D environments are much simpler to work with, using an off-the-shelf engine.

There is a kind of adventure game you can easily make with static 2D graphics: graphical text adventures. Not particularly exciting, but it'll work. For more sophisticated games, you can probably get away with AI generation for stuff like character portraits.

coffee_beqn• 4 years ago

You’ll definitely need to nap the walkable areas and even worse split the image into layers so you can walk behind/between things.

onlyrealcuzzo• 4 years ago

I don't think it'll be long before there's a 3D modeling version of DALL-E.

There's already a bunch of programs that can turn 2d images into 3d models - definitely a lot to improve - but they exist.

tiborsaas• 4 years ago

In Westworld season 4 there are scenes were Christina works with an AI editing tool that generates 3D visuals based on prompts:

https://www.youtube.com/watch?v=3uGLjmrPorg

notnaut• 4 years ago

Most of the ai art I’ve seen could really only be used as something like flavor art. Magic the gathering or slay the spire, you might imagine certain generators making an interesting set of cards for.

whateveracct• 4 years ago

But those games are definitely better with deliberate and bespoke flavor art imo. But yeah, if you're on a budget, that's probably the best use-case.

dr_dshiv• 4 years ago

GPT5 Prompt: The following is a detailed storyboard for a graphical text adventure set in the style of “Sam and Max Hit the Road” where the game concept is a space detective story akin to “The Little Prince” meets “Nancy Drew”

hammyhavoc• 4 years ago

They're not difficult, mate. Nav meshes and scaling. What's there to get wrong? It's one of the more simplistic things you can do in terms of game dev. Few hours of work, tops.

boboche2• 4 years ago

I love article titles and my imagination as I thought someone made an actual clicking game with on the fly generated content through DALL E :)

andrewxdiamond• 4 years ago

Makes me ponder what kind of video games an _advanced_ AI could create on the fly.

People talk about the impact of DALL E on art, but what if it goes _further_? How complex of an RPG world could an AI build around a player?

To the naysayers; decades ago it was impossible for a computer to display images like the ones DALL E makes. For a good chunk of computer history even holding these image bytes in memory would have been a feat.

Timelines aside, it’s fun to ponder about.

dflock• 4 years ago

https://play.aidungeon.io/

omarhaneef• 4 years ago

There would be all kinds of repeated actions, obtaining counter-intuitive objects to get past obscure guards in a way that doesn't quite make sense.

I know this because our best (not sarcasm) humans have done the same thing for years.

tlack• 4 years ago

I've been exploring a related concept in a Telegram game. The player can basically create a choose your own adventure-type world by describing a set of interlocking scenes and the segues (buttons/commands) between them.

I'm using Disco Diffusion for the rendering instead of Dall-e 2 but the limitations are similar. It can be frustrating to get consistent results or impose the kind of order on them that is required to make something feel like a real game. Or maybe I'm not thinking hard enough..

If this kinda thing (AI-generated game worlds) interests you, try it here: https://t.me/xiadreamland_bot

nodja• 4 years ago

For consistency across generations you'll need something like https://arxiv.org/abs/2208.01618 to carry the concepts across, hopefully nvidia releases the source code soon, or someone that understands the internals of latent diffusion better can implement an open source version.

thorum2• 4 years ago

One cool thing about Stable Diffusion (the current leading competitor to DALLE) is that you can create images in a similar style by configuring the seed number. Different prompts with the same seed number can be used to create different images with similar visual styles, character design, etc.

For example, this person used SD to generate portraits of the same woman at different ages, from an infant to an 80 year old:

https://reddit.com/r/StableDiffusion/comments/wq6t5z/portrai...

GrumpyNl• 4 years ago

Why does it have so many problems with the eyes?

zzleeper• 4 years ago

By the way, does anyone have a sense on how long is the wait list for DALLE2? I got into the wait-list at the end of April and am still there.. midjourney is amazing (even subscribed) but I want more variety in my AI art :)

taspeotis• 4 years ago

I signed up last week and was given access in a day

MacsHeadroom• 4 years ago

I thought the waitlist was over. I didn't even join the waitlist and was given access a few weeks ago. (I already have/had an active paid OpenAI account.)

boboche2• 4 years ago

Got my access 2 days ago, after ~3 weeks wait. They are probably prioritizing based on business case too, i.e. potential $ > developpers > personnal use.

DethNinja• 4 years ago

It looks like AI generated art will be a huge boon for the indie games.

Midjourney can definitely lower concept art costs by 5% to 20% as it stands. Nevertheless, AI generated art currently can’t fully eliminate real concept artists.

hackernewds• 4 years ago

the obvious disconnect to me has been that we compare DALLE and midjourney results to what we human-generated art used to look like on earlier Unreal Engine. This is what human generated art looks like now:

https://youtu.be/JXrWPLNp9tw

hombre_fatal• 4 years ago

Well, as TFA and the comment you replied to point out, the bar for AI-generated art isn't to compete with top-tier human talent. There are many other use-cases.

Seems like you meant to reply to a comment that claimed otherwise.

ZeroGravitas• 4 years ago

Ed Catmull made this animated hand in 1972:

https://www.youtube.com/watch?v=fAhyBfLFyNA

Would anyone in 1972, even Ed Catmull himself, be able to imagine the Youtube video you linked, broadcast globally, for free.

I think these tools are going to be big, but I feel the whole AI thing actually detracts from it. I'd rather think of it like tracing paper or photography than as a replacement for artists.

nmfisher• 4 years ago

Midjourney can definitely lower concept art costs by 5% to 20% as it stands.

I'm not sure that's even true either. After playing with Midjourney myself, it feels like the most aesthetically pleasing outputs regularly fall within a certain range of styles/prompts/hues ("hyper-realistic", "sci-fi", saturated neon orange/blue/red, etc). Getting consistency across prompts is also a big problem.

If everyone's using Midjourney to generate concept art, everyone's concept art ends up looking the same. At that point, you're presumably back to human artists (though maybe using generated art for inspiration).

astrange3• 4 years ago

Midjourney has a very strong house style they apply to all images - it always looks vaguely cyberpunk and more or less only has one face.

You can change it by turning down their style parameter and then forcing it off to another part of latent space with the right prompt words, and it kind of helps. The aspect ratio flexibility then makes it more interesting than other models currently out there.

keyle• 4 years ago

As a (now casual) game developer, this is absolutely fantastic.

I've never touched the realm of adventure games simply because I lack the skills and I don't have any contacts that are interested to work for free...

Having these type of systems on a dime to generate ideas, narrative and contents is a game changer.

It won't however change the fact that releasing games is part of a big machinery of algorithms - of the 25-35 steam games released every day; meaning: mostly no-one will see or play yours... Indie games are nowadays released like throwing a pebble in the river... See ya... Unless you push a ton of cash in advertising and get a publisher but by that point you'll hate making games anyway...

downboots• 4 years ago

The ending paragraph is great imo.

and the not too distant future will be saturated with extremely plausible-looking gibberish.

Humans are good at deceiving each other. How to avoid making us end up deceiving ourselves collectively?

HAL 9000 didn't have to explain itself.

mNovak• 4 years ago

Now we just need a slick UI for the full workflow: DALLE concept, DALLE scene extensions, and AI up-sampler

samstave2• 4 years ago

Holy Crap! I was just thinking about this as I was using DALLE and TripMind!

I also thought that childrens book illustrations will be interesting, as well as illustrating books actually written by children.

I was thinking RPG avatar/monster icons...

skytrue• 4 years ago

I started off feeling hopeful/excited by OpenAI, GPT-3, DALL-E, etc, as a creator/writer. As time has progressed and I've used these tools and other machine learning tools to create media, I've become disillusioned. It feels as if this is about to explode an existing problem, namely, there's too much content in the world already. Lowering the effort bar for content creation and generation is, in some ways, going to cause a deluge of low-quality/mid-quality content to be generated.

I wonder if we'll see a new generation of "editors" showing up to help curate and provide some guidance in terms of what to play if you're limited on time. I often go through the new releases on Steam and I'm amazed at how many games are released that have zero reviews, or less than 5 reviews, yet people are still constantly releasing more and more. I'm sure some of those games are masterpieces, but will never see the light of day.

pithon2• 4 years ago

It feels as if this is about to explode an existing problem, namely, there's too much content in the world already

Imagine applying that same perspective to software, pre-github.

emmo• 4 years ago

I'm not sure I see the relevance. Could you explain further, please?

kixiQu• 4 years ago

Did people feel that way about software?

jillesvangurp3• 4 years ago

We're at the beginning of a rapidly evolving situation where out of the blue it is now possible to direct an AI to produce imagery that is interesting using just language. From there to moving animations is a relatively small step and already being worked on. From there to photo realistic scenes directed by just words not that big of a leap either and also something that is being worked on. Are there constraints, glitches, and limitations. Of course. Has that ever stopped artists producing interesting art? Of course not. People have been telling stories via art ever since people figured out that they could scratch things into rock, clay, and whatever.

Perhaps the depressing thing for some artists is that they need to adapt to this and up their game. We've seen the same with photography. Every idiot can now have a decent phone camera and there are plenty of people on Instagram doing not so interesting things with those. Does that invalidate what really good photographers do? No. But it does make their work less special when an AI guided camera in the hands of an absolute amateur can produce photos that are decent. And now with this, you could produce realistic looking photos of things that don't exist by simply asking for them in the right way.

More content means the quality standards are raised. There are not a lot of artists left that make a living scratching things in rocks. But there are more artists than ever. The only real limitation is their imagination.

ido5• 4 years ago

I don’t want it “whatabout” this, but…Is art really the thing we need to automate right now?

There’s so much labor that we more directly need more of and that we could all benefit a lot more from automating it.

To give a mundane example off the top of my head- street cleaning. I live in a big city (Berlin) which is often filthy with litter. Obviously there are not enough people cleaning it (or it wouldn’t be). Can’t we automate that instead? How about automating construction? Part of the reason housing is expensive are lot prices but surely a lot of it is also labor cost.

It just feels like such a frivolous and relatively useless thing to automate, and a misallocation of resources.

NegatioN2• 4 years ago

The quality of the upper echelon of art may be raised, but there's still a discovery problem there. Having to sift through stuff to find the gems is already an issue imo. The OP makes a decent (pessimistic) point

awb2• 4 years ago

From there to moving animations is a relatively small step and already being worked on. From there to photo realistic scenes directed by just words not that big of a leap either and also something that is being worked on.

I don’t think DALL-E can even persist a single 2d object between scenes. For example, if you create an animated character you like, I don’t think it’s possible to ask DALL-E to render that same character in a different scene.

And you’d need 3d training data to create 3d rendered scenes, where a camera can pan/zoom realistically through a scene. There’s probably much less of that kind of data available. What we do have is artificially created 3d scenes in movies, but it’s not always very realistic, not to mention proprietary.

If VR kicks off and people can start easily recording 3d moveable scenes then we might start seeing AI creating similar scenes shortly after.

flohofwoe• 4 years ago

I wonder how tweakable those generated images are. The most important requirement for 'game art creation' is that it is created in a tight feedback loop between an artists, an art director who needs to enforce an overall artistic vision, and the cold, hard requirements of the game design.

Can I tell the AI "that looks great, keep the trees and house, but I need the door on the right side, and the sky a bit less cloudy". Will it be able to incorporate such instructions without "remixing" a very different image? Can it "understand" the suggestions the same way a human can without having to go into so much details that it essentially becomes procedural generation? Is this even something that's possible with the current approach?

If that's not possible, then I can just as well google and hope to find a matching image.

soco• 4 years ago

The question is, should everyone calling themselves "artist" be able to make a living off their creations? Based on your predictions there will be only a subset which can be professional artists... and I think it's okay this way. Everybody can produce art and call themselves artists, but only a few can also make a living from their art - because by definition art needs a consumer and the (paying) consumers pool is limited.

notart6662• 4 years ago

It's not a small step to move from image generation to animation. In fact, it's quite contrare the complexity grows with length, even creating a short would be exponential in cost. GAN Networks cannot and will never be able to do this.

hertzrat• 4 years ago

Speaking of upping their game, I have a friend who worked in photography, and photo and video editing. Over the years, the tools got better and better and more user friendly. The money started to disappear due to more and more people being able to just use phone apps to do it all. He adapted by… leaving the field completely for a tech job.

That’s what we will see: a far smaller percent of people who have the pleasure of paying their bills by working in the arts. It’s all already so commoditized, I don’t know a single artist any more who can do it full time except one woman with a gallery I met the other day on a road trip. Is she going to have to go back to her old career of environmental policy soon?

riffraff• 4 years ago

Lowering the effort bar for content creation and generation is, in some ways, going to cause a deluge of low-quality/mid-quality content to be generated.

Isn't this the case already?

For example, I have recently discovered science fiction poetry exists. The amount of stuff that gets produced in this niche of a niche is baffling already, and growing almost exponentially.

I feel human curation and editing will just have to be important again.

hnick• 4 years ago

I wonder if we'll see a new generation of "editors" showing up to help curate and provide some guidance in terms of what to play if you're limited on time.

Iron Pineapple has an entertaining series he calls "Steam Dumpster Diving" which is similar to this, but it's very focused on Souls-Like games.

https://www.youtube.com/watch?v=9KARY5ocvKo&list=PLuY9odN8x9...

It does sometimes include games many of us have heard of but there are a lot of unknown games, and plain bad ones (he has a soft spot for student projects too). I think he sees the value of new ideas hidden in jank, as do I, so I like the series.

I think the shift will be towards matching personalities, you get to know a reviewer and see what they like and how compatible they are with your own opinions. It doesn't have to be a one-to-one match as long as you're aware how they diverge on certain genres. The curator section on Steam seems to be an attempt at this, but any social media that allows following/subscription could serve too. It's still a significant time investment to keep up to date and to even find that matching personality.

I wonder if I actually bothered leaving reviews on Steam, would it suggest people with similar tastes to me?

shreyshnaccount2• 4 years ago

there's also an interesting take that as these generative models become better they will be used for search instead of regular search engines, and social apps would automatically generate content for you, trained on the vast dataset they already have. i think the hardest thing in this trend is going to be assessing 'truthfulness' automatically

simion314• 4 years ago

Lowering the effort bar for content creation and generation is, in some ways, going to cause a deluge of low-quality/mid-quality content to be generated.

This is not a problem, the issue is with Steam of whoever curates this content for us, with some good filters you can avoid the problem. My first program and game was garbage but it was not on GitHub or Steam to bother anyone, so the issue is not that people have access to good tools (I was using some Visual Studio for students edition) the issue might be that maybe some services have bad filters.

For new indie devs, please use whatever tools make your vision , publish them, ignore the haters, you will probably not make a living from Patreon or donations but if you love what you doa nd makes you happy that is the important thing.

LoveMortuus• 4 years ago

I understand your fear, especially because a very similar, if not the same, thing happened with Unity, where our allowed the creation of just what you're talking about a massive amount of low to mid quality games. I even remember reading articles about how the Unity splash screen has become recognised as a mark for low quality games...

garblegarble• 4 years ago

I'm still hopeful that this technology will enable writers who have a good idea for a story to build much more on their own without having to be in a position to hire voice actors and artists: whether that's pixel graphic backgrounds for adventure games with decent text-to-speech for characters, or 3D worlds built in Unreal with Metahuman-generated NPCs playing out a curated story within a procedurally generated city.

There being lots of low/mid quality games is, I think, a problem that already exists today on app stores -- on Steam especially between Greenlight & vast numbers of games 'releasing' in Early Access... and the more that a single writer with some dev skills can do on their own the more opportunity they have to develop their games as a brand, and get feedback to fire their creativity.

cmsefton• 4 years ago

Yes, I also like the prospect that this tool would allow rapid prototyping and storyboarding for games, graphic novels, films etc. Being able to generate a rough idea of what you want or envisage for a scene and show that to an artist/director of photography/whatever would be very useful.

j_mo• 4 years ago

writers who have a good idea for a story

Or programmers who are bad at art, so, programmers in general ;)

dfxm12• 4 years ago

It feels as if this is about to explode an existing problem, namely, there's too much content in the world already. Lowering the effort bar for content creation and generation is, in some ways, going to cause a deluge of low-quality/mid-quality content to be generated.

Like you say, this is an existing situation (I hesitate to call anything that lowers the barrier to entry a "problem"). The printing press opened up printing for more people. As did desktop publishing. Similarly, garage band and bandcamp make it so much easier to produce and publish music. Yeah, there's a ton of books and music out there, including a bunch of junk, but the cream still tends to rise to the top. I'd rather take my chances on having to find a masterpiece in a haystack than have it never get published at all, either because of lack of funding/lack of some specific skill that AI can handle/no willing publisher, etc.

MattRix2• 4 years ago

It doesn’t matter how many bad Steam games there are, because their algorithms prevent you from ever seeing the vast majority of games on the platform. The same is true for videos on youtube and songs on spotify, you won’t find the really low effort/quality content unless you actively seek it out.

irrational• 4 years ago

I remember back when I was in college the WWW was barely released and search was in its infancy. If you were doing a research paper, trying to use the WWW to search for papers on the topic was laughably useless. Instead you would go to the university library (which still used card catalogs!) and make an appointment with these people who had access to some search system (I can’t remember what it was called). You would sit down with them and explain what you were researching and they would craft search queries in the query language this system used and read over the results with you to see if they sounded promising. They would tweak the query based on your feedback until you got the results you wanted. Then they would print out the results and you could go elsewhere in the library to lookup the papers. It cost money per search, but the university covered the cost.

I wonder if we might see something similar with these ai generation tools. People who become experts at crafting the queries to get back the results you are looking for act as intermediaries.

samstave2• 4 years ago

Here are a couple I did:

looking up at a massive art deco archway with huge beautifully ornate door, tessellated like the ceilings of Iranian holy mosques with the dimensions symbolizing sacred geometry and celestial lighting 8k detail*

https://imgur.com/gallery/QulgbtM

https://imgur.com/gallery/GNgZ4hu

https://imgur.com/gallery/TIBALCT

jrussino• 4 years ago

These are subtly nightmarish to me, especially the first. The beauty of such ornate mosaics (in the real world) is the clean, symmetric geometry. Ironically, that's the sort of thing you might naively think a computer could be especially good at (compared to more "organic" subject matter). These are evocative of tiles Islamic mosques if you squint at them, but if you look closely they're a blurry tangled mess. I would totally buy this as concept art for a demonic church or something like that.

Edit: I think the third link showed up while I was typing this comment. Those hit me entirely the other way - really cool!

thorum2• 4 years ago

DALLE can’t render fine detail at a distance of more than a meter or so. Possibly because OpenAI limits how many diffusion steps are used for each image.

dgs_sgd• 4 years ago

After seeing all the DALL-E 2 posts it's pretty clear that interacting with it is an art and not a science. If black box AI continues to improve I predict an emerging profession of "AI Prompters" whom others will pay to get the desired outputs out of AI tools.

sroussey• 4 years ago

I’ve already seen GTP-3 used to talk to DALL-E.

Still need to see how to start with an image, get a description, then go back to image with these tools.

stocknoob2• 4 years ago

Go was an art too, and they built an AI to find the optimal move.

Train another AI on improving input prompts to another prompt that generates art humans find pleasing.

ceroxylon• 4 years ago

Really great example of using generation as a tool rather than a crutch. Inevitably techniques will be developed to use it to create new never before imagined styles that still speak to us at an instinctual level despite the inhuman steps along the way.

bepero• 4 years ago

You could use this bookmarklet for generating images without watermark when you merge the images: https://www.designinspiration.info/save-dall-e-images-withou...

mrwh• 4 years ago

I used a bunch of dall-e images to illustrate a talk recently, thinking that it's not _quite_ yet a totally hackneyed idea (but soon will be).

The approach in this article is actually pretty interesting, and some of the results do recall the better 90s adventure games. If only there were a similarly effective way to generate good character animations, I'd be tempted to resurrect long-dormant plans for a graphic adventure.

pugworthy• 4 years ago

Why not feed all the descriptions from say, original Colossal Cave Adventure game into DALL-E 2?

"YOU ARE STANDING AT THE END OF A ROAD BEFORE A SMALL BRICK BUILDING. AROUND YOU IS A FOREST. A SMALL STREAM FLOWS OUT OF THE BUILDING AND DOWN A GULLY."

ido5• 4 years ago

That actually sounds like a pretty interesting interactive art exhibition piece!

darishante• 4 years ago

The first thing I thought when reading this was "wow, someone must have fed Infocom games' location descriptions into an AI". Would still like to see that.

CamperBob25• 4 years ago

So frustrating that there's no way to access this tech without putting your name on a list and waiting an unspecified amount of time (months?). It's the sort of thing many people would pay well for, even at its current stage of development.

pigscantfly• 4 years ago

Decided to try it out: https://labs.openai.com/s/nHmjLYmVPdDQzUU5DvGT2JgK

makapuf• 4 years ago

Wow, existing text-adventure could be very interesting with this kind of semi real-time illustrations. Maybe we'll finally know what is Grue like. Also, Table RPGs with Dall-E illustrations generated semi-realtime by the game master.

bjelkeman-again• 4 years ago

That was surprisingly good.

Steuard• 4 years ago

It's interesting that in both of the examples people have shared here, the image produced was quite good but entirely missed the "flowing out of the building" part of the prompt (which I think is a fairly significant aspect of the scene).

astrange3• 4 years ago

https://labs.openai.com/s/DvQ49etAKKCU6Zpy32GFJlq0

hipjiveguy• 4 years ago

cool idea, but those images are so... un-text-adventure? I guess they feel like they should be more low res? I guess too "real" removes imagination from the text adventure equation

Terretta• 4 years ago

Two replies are from Dall-E, copied here for convenience:

- https://labs.openai.com/s/nHmjLYmVPdDQzUU5DvGT2JgK

- https://labs.openai.com/s/DvQ49etAKKCU6Zpy32GFJlq0

For comparison, first two sets of 4 variations from MidJourney:

- https://i.imgur.com/iEvlYXE.jpg

- https://i.imgur.com/aR0R10p.jpg

The game with both is promptcraft. Here is Midjourney after changing “brick building” to “brick house” and changing “road” to “dirt road”. It did brick roads but at least a road showed up:

- https://i.imgur.com/bfia9zT.jpg

Then you can upsize to hallucinate additional detail:

- https://i.imgur.com/y1uPc6b.jpg

- https://i.imgur.com/LId4wy4.jpg

jollybean• 4 years ago

They'll soon be making films using simple AI instructions.

Imagine when our creative works are better when AI makes them ... that'll be an odd time to be alive.

ajaym0• 4 years ago

DALL-E is next level. I'm still waiting for the day where I'd get to play a fully AI generated game with a generated story line; one that rapidly changes according to the decisions made by the player. That would be insane.

allendoerfer• 4 years ago

Maybe you are already playing it. Or am I?

Loveaway• 4 years ago

5 billion years of evolution, an endless amount of lifeforms came and went, how lucky must we be to have our one and only shot at life right now, right here. Born free of hunger, free of the primal struggles of survival, that alone is an inconceivable fortune. But not only that, we're also here in time to witness monumental revolutions, the creation of the Internet, and now the creation of AI. AI that will make artificial reality indistinguishable from reality, generate whatever we desire, live however we desire. The only limit being our thoughts.

And it's all happening now! What a great time to be alive, imagine being incarnated in one of the infinite other possibilities and having to life a normal live, that would have sucked!

Foobar8568• 4 years ago

rustic mexican mansion with a grassy area sports car parked in front surrounded by small houses on a sunny day, high quality atmospheric high renaissance oil on canvas

The picture related to that one looks more like Provence /Marseille aera than truly Mexico.

Basically there is a small mount nearby Marseille that looks exactly like that and obviously was used in many paints.

The house and pine tree really looks like villa in Provence, and with that small mount in the background... Yeah I feel at home :o

While the paint is largely different, I have seen much closer look alike in the past but from a famous French painter https://fr.m.wikipedia.org/wiki/Paul_C%C3%A9zanne#/media/Fic...

ohuf• 4 years ago

I'm wondering what DALL-E would make out of the descriptions in classic text adventure games from the 1970s-90s like, for example the ZORK series?

yoyopa3• 4 years ago

i keep thinking these kind of tools are very dangerous and can lead to a lost generation of artists, who won't develop their skills because they can't compete with the garbage output of "ai" algorithms.

entrox• 4 years ago

Exactly my thoughts as well. We're now starting to automate our own culture away: stories, art, music... Why would you spend the years building skills to create something in a sea absolutely flooded by automated algorithms? As these AIs get better, it will be more and more difficult to distinguish the output from human minds.

I keep wondering what the endgame here is. Once everything can be algorithmically created, what's the point of humanity anymore? Just consuming an endless flood of auto-generated, recommendation-optimized content?

danielbln3• 4 years ago

Think outside the box. The human element just moves up in the abstraction stack. Don't have to spend time manually arranging words anymore, now you just direct settings, character motivations etc. Don't need to manually set pixels to certain colours, now you can quickly create complex images and combine them, remix them, create something bigger.

yoyopa3• 4 years ago

it doesn't even have to be optimized. it just has to be interesting enough to captivate your interest so someone can show you ads.

CamperBob25• 4 years ago

Yeah, just like calculators killed off all the mathematicians, I guess.

yoyopa3• 4 years ago

calculators do not produce inferior work the way dall-e and the like do

hgs3• 4 years ago

I’m concerned about the precedent DALL-E 2 is setting. Learning skills, whether it be drawing, painting, or otherwise, should not be a “problem” that needs to be solved with AI. The joy of creating is in the journey, not the destination. I can’t imagine any fulfillment from glueing together auto-generated content. It’s the art equivalent of a CRUD app.

para_parolu• 4 years ago

I’m a non-creative person. Sometimes I need to ask artist for an art. Dalle would help me to give and idea.

oytis• 4 years ago

If the joy is in the journey, no one can take it from you. Some people might want to get to the destination quicker and are not interested in the journey.

The consequences of this technology are going to be interesting though. The trend of people having to be absolutely the best and unique or GTFO seems to be unstoppable.

stocknoob2• 4 years ago

Is photography an art, or are you just using a machine and fiddling with settings?

namose• 4 years ago

Most businesses want CRUD apps, and people don’t particularly like coding them. Technology where you can pump out a CRUD app with little to no effort would be a blessing, freeing people to work on more interesting problems.

telesilla• 4 years ago

"we've been privileged to live in a truly global era with minimal blank spots on the map and a constant flow of reasonably accurate information, the implication being that the not too distant past had mostly blank spots and the not too distant future will be saturated with extremely plausible-looking gibberish."

What an excellent insight.

grumbel• 4 years ago

I played around with that a bit myself, though mostly 2D tiled side scrollers, but I found it pretty much impossible to create good 8/16bit style graphics with DALL-E2. It can create pixel-art just fine and it can create pixel-art sprites, but it's all in the style of modern smartphone games or flash animation, not in the style of actual 80/90 games. And like most of DALL-E2 output, it's extremely zoomed in, so you never get something that looks like a screenshot, you get a closeup of a single sprite.

Even trying to infill 8/16bit games was a disaster, as it just ended up repeating the tiles 1:1, not creating actual level structure with those tiles.

DALLE-mini in contrast is pretty blurry and low-res, but it can produce images that at least look like actual video games. So I assume DALL-E2 just has a huge hole in the training data here, as nothing video game related produced good results. The article settles for prompts focusing on regular artists as well, instead of video games.

One area that DALL-E2 absolutely nails is RPG-style portrait images, it can crunch out amazing ones on the first try.

DALLE-mini:

https://matrix-client.matrix.org/_matrix/media/r0/download/m...

DALL-E2:

https://matrix-client.matrix.org/_matrix/media/r0/download/m...

antifa• 4 years ago

Some of those make me wonder, are there any 2d/3d engines that render normal 1x1 retro style pixels as randomly sized "pixels"? I wonder if that could become a surealist retro style.

hoseja• 4 years ago

Make some of these generators create graphics from Dwarf Fortress descriptions. Boom, best game ever.

jstanley• 4 years ago

A common defense claims that the model learns from the training set the same way a human student would, implying human rules (presumably with human exceptions) should apply to its output. This can seem like a reasonable argument in passing, but besides being plain wrong, it's too facile since DALL-E is not human-like.

This is nowhere near enough to refute the idea that human rules on fair use should also apply to works you create using DALL-E.

The fact that DALL-E can't own the output is irrelevant. Firstly, the human operator can quite happily claim ownership of the output. Secondly, I don't see how ownership of the output is even related to whether the training data was used fairly.

still_grokking• 4 years ago

I guess the other current front-page submission is relevant here:

https://news.ycombinator.com/item?id=32486133

amelius3• 4 years ago

Waiting for DALL-E to become capable of producing 3d game assets (along with accurate physics models).

nathias• 4 years ago

soon we'll be able to replace all skills with arcane incantations, the future belongs to wizards

mechero• 4 years ago

Nicely written! Including also the pricing, licensing, and ethics perspectives made it even better. Thanks for sharing.

chucklenorris• 4 years ago

But these images are not copyrightable - what's stopping someone to rip off your artwork?

dukeofdoom• 4 years ago

one problem i found is getting a side profile of a charcter, midjourney seems to default to the typical front shot. Also if it could walking animations would be awesome

Adventure game graphics with DALL-E 2

Related Stories