Midjourney AI Guide

https://enchanting-trader-463.notion.site/Midjourney-AI-Guide-41eca43809dd4d8fa676e648436fc29c

by jger15 • 3 years ago

267 160 3 years ago

enchanting-trader-463.notion.site

I don't know. Stable Diffusion runs locally. It feels really weird to run this kind of thing on someone else's computer.

Especially when the only interface is via Discord! I continue to refuse to join Discord. It's an archivists nightmare.

MattRix2• 3 years ago

You can join discord just to use Midjourney. It’s really mot that big of a deal.

exodust2• 3 years ago

Tried to sign up, but won't bother after they falsely claimed a "security issue with my browser" and then demanded a phone number on that basis.

I hate this hostile, intrusive UX pattern. I verified my email, I never use VPN, and my browser's ad blockers were disabled. Yet they claim "security issue". Discord can shove their dishonesty.

And yes I tried one of those free number websites but didn't work because millions of other people use those same numbers.

Turing_Machine• 3 years ago

Especially when the only interface is via Discord!

I hate to be one of those guys who bandies the term "UX" around, but yeah, that's terrible UX.

I'm willing to put up with it for v5, though. My local install of SD just doesn't measure up, at least not at present.

famouswaffles2• 3 years ago

Yeah Base SD is pretty bad. That said, the new Kandinsky 2.1 model is really good. Much better than any of the base SD models and is open source. Try that some time

Bing image creator is also really good and free with a hundred generations per day

robbintt• 3 years ago

So everyone but some archivists are using it? Hack the system my friend

cavisne• 3 years ago

The founder gave an interesting interview about this.

In short when they did user testing with a Web UI, people would write a basic prompt "dog", "cat" and then get stuck.

Discord makes it social by default, you can see what people are prompting and get inspiration.

I also found it a bit weird, but now that ive onboarded its great having a multi platform native experience (ie even chatgpt still has no mobile apps).

dr_kiszonka• 3 years ago

I agree that the social learning component is very useful. Initially, I was taken aback that they force you to use discord but it is great for learning from others.

computershit• 3 years ago

I don't know anyone who's used Midjourney more than a day and stuck around in one of the newbies channels; pretty much everyone slides into the bot's DMs.

The social angle is not what's fueling Midjourney's success. The quality of its output certainly is.

ZephyrBlu12• 3 years ago

Discord is actually a really great experience for power users. I can generate new image sets as fast as I can type because MJ's Discord bot takes care of everything else for me.

Are there SD applications that have UX as good as that?

asynchronous3• 3 years ago

Running locally I can get SD’s webui to spit out images in about 6-10s on my hardware.

aenvoker4• 3 years ago

It's an archivists nightmare.

I’m guessing you are referring to archive.org style public archiving.

But, I’ll mention anyway that for your own generations there is a web interface to search and bulk download your images. And, a web interface is in the works. You lose out on the social aspect of prompting with friends. But, gain some UX for working solo. Or, you can work solo in a DM convo with the bot.

epivosism2• 3 years ago

Repo for my C# bot which you can use to download (and annotate) all your creations. https://github.com/ernop/social-ai/

asynchronous3• 3 years ago

Super agree on the Discord point. Feels foreign to run an entire business model by relying on a third party chat service.

guiambros3• 3 years ago

It's an archivists nightmare.

My experience has been exactly the opposite.

I created my own Discord "server" (which is not truly a server per se; more like your server account [1]), and then installed MJ bot. This way I can keep all my creations in a single place, with the added benefit that I have my own channels for things like compilation of links, prompts database, separate channels for different types of creations, and so on.

I even invited a couple of family members to join my Discord server, so they can use MJ if they want, without having to share my Discord account (but of course it still counts towards my MJ credits).

All in all, I have been incredibly (and surprisingly) pleased with Discord experience.

[1] https://www.youtube.com/watch?v=MDPY_bMPO0A

lumenwrites• 3 years ago

Wow! Thank you so much for sharing this, this is such a fantastic idea! It will be so much more convenient to use midjourney from now on!

iand• 3 years ago

I have done this too. How did you get the bot to use your MJ credits? I found that the bot still uses the credits of each person who invokes the command.

jutrewag3• 3 years ago

Midjourney v5 is like magic though. Imo stable diffusion doesn’t even come close.

realusername• 3 years ago

There's a lot of Stable Diffusion models though, I would say the opposite, it's hard to compete for Midjourney when you have 20 different competing fined-tuned Stable Diffusion models depending on what you want along with ControlNet, automatic1111 & comfyui.

whywhywhywhy• 3 years ago

Seem about the same if you know how to use them imho. I’ll say one thing Midjourney images are always way more “basic” in terms of aesthetic. Everything looks like the Artstation front page, which while very competent is tacky look.

drcongo• 3 years ago

Discord is all kinds of nightmares. Every time I open it I have to close multiple popovers trying to sell me things, something about "Nitro", stuff about running my own Discord etc. Then there's the fact that there's red dots on channels that I've never been in and there's no way of working out why I have a red dot on there or viewing just my mentions. I hate it.

atleastoptimal3• 3 years ago

The crazy thing about generative AI models is they provide a service that's significantly better in both price/output and bests possible output.

In addition to being able to create completely novel, high quality images, they can do so at speeds that no human could ever hope to match. And image models of this quality have only been around for a year, imagine where they'll be in five.

I empathize will all the artists who feel cheated out of these models training on all their data, but the sad reality is these AI models are just far too useful to ever go away. The world's standards for art and text have gone up faster than they ever have in world history over the course of the last 10 months

gumballindie• 3 years ago

They’ve got electrolytes.

cyanydeez• 3 years ago

Counterpoint: they only generate novel differentiation but won't generate new detailed products.

This basically means you get thousands of different nostalgic triggering visuals but it's a visual trick the same way marvel movies all follow the same premise and eventually satiate the space.

atleastoptimal3• 3 years ago

Marvel movies however make more money on average than any other kind of movie. If that's where the money is, that's where the capital efforts of artistic creation will tend towards. Whether the art is trite or original is up to the highest brow critics to determine.

PradeetPatel• 3 years ago

Partially true, I'm currently working with multiple clients in China where AI generated art is heavily utilised. But we are acutely aware of the limitations of AI, therefore human resources were hired for the purpose of clean up AI art.

Given the cost saving potential of AI art generation, I suspect it'll only be a matter of time before it becomes mainstream in the west.

Instead of having an "us" against "them" mentality, there might be a future where human artists can work alongside AI to push human creativity to a new level.

fassssst2• 3 years ago

Counterpoint: western music is a 12 note scale. Variations *are* "new."

crabkin• 3 years ago

I have a hunch based on no insight or rational thought, but it is that the wall will be generic for AI apropos to art/creation. It will be doomed to uninventiveness.

barrkel2• 3 years ago

Yes, it's basically true. For true novelty, you need to create a bunch of examples and teach a model (fine tuning). Depending on how novel it is, it may be hard to teach and teaching may damage a model's generality (over training), so you need to include examples of everything else and train at a lower rate, and it'll take longer and cost more. But it's possible.

ZephyrBlu12• 3 years ago

The big problem is the variation. If you want a specific, complex scene it's basically impossible to get exactly what you want in my experience.

I've also found that some words and phrases will overpower the rest of the prompt, so it can be hard to get to specific areas of the latent space.

I think they're really good for mood board kind of work and exploring ideas, but you'll probably still need an artist to create something that is specifically what you want.

in3d2• 3 years ago

Have you tried ControlNet with Stable Diffusion?

drusepth• 3 years ago

The big problem is the variation. If you want a specific, complex scene it's basically impossible to get exactly what you want in my experience.

The UI/UX of a proper workflow is still very janky (even in user-friendly UIs like auto1111), but you can get very specific, complicated scenes with a mixture of ControlNet + inpainting.

I've also found that some words and phrases will overpower the rest of the prompt, so it can be hard to get to specific areas of the latent space.

I've also had this problem (particularly with multiple colored objects, like "blue eyes, brown hair"). Apparently Cutoff (https://github.com/hnmr293/sd-webui-cutoff) is very good at addressing this "leakage", but I haven't implemented it yet.

Right now, things are really good for mood board kind of work, but there's a lot of tech already available for enabling a lot of back-and-forth "work" on images to get them into exactly what you're imagining. There aren't a lot of good UIs for them all yet though; as soon as they get a little more user-friendly, I'd expect another boom in generative AI for artists (this time, with artists being the primary benefactor).

epivosism2• 3 years ago

This is being worked on with a model Deep Floyd supposedly coming out this week. https://www.youtube.com/watch?v=vlxnDNVkWFo

cthalupa• 3 years ago

If working in Stable Diffusion, with ControlNet, Latent Couple, SegmentAnything, and inpainting, you can get incredibly complex scene composition. It's not just typing in a description and getting what you want in one step, but it's still a significantly easier skillset to learn than what would be needed to create the same level of artwork manually.

One shot random prompt stuff is better on Midjourney and I'm still subscribed to it, but I would say I do 99% of my playing around inside StableDiffusion these days.

dragonwriter3• 3 years ago

If you want a specific, complex scene it's basically impossible to get exactly what you want in my experience.

SD with Multidiffusion or another multiple prompts with (potentially overlapping or nested) regions tool, plus some inpainting, can do a lot here.

So can SD with ControlNet, to go beyond text prompting.

bugglebeetle2• 3 years ago

The world's standards for art and text have gone up faster than they ever have in world history over the course of the last 10 months

This is a funny sentiment because to me, the exact opposite has occurred. Now that everyone can create work of comparable technical ability, never has it been more clear that taste and other conceptual skills are lacking in those who haven’t spent hours upon hours engaged with and making art.

I’m sure many will decry this as snobbery, but I think this is also obvious in the reliance on various famous artists names in prompts. I expect a similar phenomenon will emerge with AI generated code where things that look superficially impressive are terrible in other dimensions (architecture, efficiency, security, etc)

ChatGTP6• 3 years ago

I agree, but according to some people this is just statistics too. Not sure I agree with this but yeah. Don’t be surprised if you get a response like that :)

ChatGTP6• 3 years ago

We’re all going to feel like those artists soon I guess.

jonny_eh• 3 years ago

imagine where they'll be in five

We got jet engines in airplanes only 25 years after the first flight. Imagine where we'll be 100 years after!

(There's plenty of progress to be made in gen AI, but don't expect the speed of progress to be constant)

chefandy4• 3 years ago

"Tools like Flash and Dreamweaver will render web developers obsolete in the new millennium!"

-90s tech journalists, amateur web 'designers', and other non-coders who assumed they understood software

atleastoptimal3• 3 years ago

The speed of hardware compute improvements has been on a constant exponential curve for the past 50 years. The speed of increased model capability has been on a consistent linear rate of improvement for the last 10. It would be the exception, not the rule, for this progress to slow necessarily in the near future.

moomoo11• 3 years ago

Honestly I don’t understand the doom and gloom with AI.

It’s going to make humans hella productive.

For artists that means less staring at blank screens and fishing for inspiration.

The future is that anyone will be able to whip up anything without needing that particular skill that is a blocker. Instead they can pull from collective intelligence and piece something new together.

If an artist wants to make games but can’t code they can make games like a boss in the future because they can funnel their productivity into all the things they were never capable of before.

It’s literally infinite possibilities. Like I’m a software engineer. I’m sure these AI systems will be boss tier at a lot of stuff I know.

That’s good. That means I can finally stop doing the things I hate the most when it comes to making software and do the fun part: solve problems. Just like you use a calculator and formulas to solve problems and not doing every calculation by hand from scratch..

Anyway just my 2 cent. All this doomer talk is being pushed by people to get people afraid. Honestly if you’re at the forefront of technology you should be striving to shape the future for better where everyone can make hella money.

Imagine how much stuff there will be to sell to everyone, and everyone can channel their true potential and creativity into building cool stuff. You like cars and want to make body mods? Can’t code? Don’t know cad? No worries someone has set up a service which helps you easily get those molds delivered to you. And if that’s your thing you can put that workflow together and make money.

Am I crazy for thinking that way?

jutrewag3• 3 years ago

You’re not crazy, it’s just that people are freaking out because there are many folks that do a lot of this for a living. If anyone can code a game, do all the graphics, music, voice acting, script generation etc. then no one is going to pay those people anymore.

blibble• 3 years ago

you are only thinking of the first order effects

the main second order effect is that the middle class of knowledge workers ceases to exist

and the third order effect is that democracy no longer works and we either turn into saudi arabia or feudalistic medieval europe

I'd rather GPUs were banned

chefandy4• 3 years ago

Some think entire categories of careers are at risk of being less valuable or eliminated. In a society that didn't treat obsoleted professionals like used condoms, that would less daunting. We don't live in that society and won't by the time many people have to deal with the ramifications of this.

ls612• 3 years ago

Because its gonna eat people's lunch if it gets going. Many in the elite saw their lunch get eaten by the internet and are now against any further innovation, in stark contrast to the culture of the 90s and 2000s. Thus the AI doomerism and the broader techlash you are seeing today.

A_D_E_P_T2• 3 years ago

That's a good guide.

It's worth highlighting that, even in v5, the best results are obtained with fairly complicated prompts.

These results, for instance: https://imgur.com/RD7fF3M

Are what came up via: The interior of a future-brutalist megastructure. Single image comics style sci-fi robotic architecture, 70s, jet era Jetson cantilever modular space station modules, flag patch on walls, pastel glowing symbols, sci-fi towers architecture, foggy, pastel volumetric light and atmosphere, glass and steel pastel, The 5th element, The Matrix, Blade Runner, photography award, ultra elegant wide angle, volumetric light at mid day nice sky, trending on artstation, Unreal engine hyper realistic photography magazine cover, no people --v 5 --q 2 --upbeta

MattRix2• 3 years ago

I don’t think those results are actually any better than what can be achieved with much more simple prompts. This seems like an example of the “Ikea effect”, where when once you’ve put in effort to assemble something, you perceive it to have more value.

rainytuesday• 3 years ago

You can just use the /describe prompt and reverse engineer something you like, or you can have ChatGPT do it for you.

ZephyrBlu12• 3 years ago

Strongly disagree. These are 3 sets I just generated with v5 using the following simplified version of your prompt: "interior of a future-brutalist megastructure, comic pastel style, sci-fi robotic architecture, 70s".

https://imgur.com/a/cGgz9nl

MJ does really well with simple prompts.

Specific words and phrases that accurately translate what you want into the latent space are way more important than complex prompts.

If you've played around with MJ much you'll know what I mean. Some words and phrases overpower everything else in the prompt. I've found that good MJ prompts are very vibe based.

A_D_E_P_T2• 3 years ago

Damn, you're right.

Kaijo• 3 years ago

I've been experimenting a lot with both very simple and complex prompts. I think they both have their use cases. In the example you've replicated the desired image is quite generic. You aren't aiming for a very particular subject doing a particular thing, perhaps both quite obscure, with a particular composition and positional relation, a precise palette etc.

But some of the most thought-provoking results I get from Midjourney are with short, quasi-macaronic prompts [1]. I know enough botanical and zoological nomenclature to conjure fantastic lifeforms close to what's in my imagination, by contriving Latin binomials that just sound right. I can also give certain subjects the cultural flavor I want by making up nonsense words that sound like Swahili, French, Finnish or whatever, in situation where actually including the language name, or real words from the language, take the image in the wrong direction.

I had some GPU hours left to burn up the other day and even figured out how to make a short Midjourney animation with dozens of images in a smooth sequence. There are ways of very carefully stepping around local bits of the latent space.

[1] https://www.unite.ai/the-nonsense-language-that-could-subver...

Paul-Craft5• 3 years ago

Some words and phrases overpower everything else in the prompt. I've found that good MJ prompts are very vibe based.

Are you talking about stuff like the trick of adding "artstation," or "in the style of..." or "taken with a blah blah lens/camera?" That all sounds like it generally comes from bias in the training data set to me. It doesn't make it any less valid an observation or any less useful, but I wonder if A) that is the case, and B) if it's hinting at the idea that training these things on source data that was initially generated by humans is going to create some kind of limitation in what they can do.

pmoriarty7• 3 years ago

MJ does really well with simple prompts.

Simple prompts can definitely get good results, but they tend to be much more generic than what you can get with complex prompts.

fassssst2• 3 years ago

You can add a prompt guide to a ChatGPT system prompt using the OpenAI Playground. Then you can go back to writing simple prompts and ChatGPT will spit out all the magic keywords and model parameters, based on its knowledge and your system instructions.

_tom_• 3 years ago

I find that the more complicated the prompt, the less detail I see in people. With simple prompts I get photorealistic, but with complicated I get animation quality.

Not sure if this is just my prompts or something general.

xnx2• 3 years ago

Is the latest Midjourney now considered better than Stable Diffusion? If so, will Stable Diffusion catch up? I strongly prefer the open source nature and ability to run locally of Stable Diffusion.

furyofantares4• 3 years ago

It's been noticeably better than Stable Diffusion since v3 at least (I wasn't paying attention before that). It's on v5 now, and I think MJ has continued to get better faster than SD through this time period.

ControlNet for Stable Diffusion may be an exception to this.

echelon• 3 years ago

I think that's the popular consensus.

Both StabilityAI and the open source community are working on improvements to Stable Diffusion.

Keep in mind StabilityAI is also pursuing LLMs and the host of other model types, whereas text to image is Midjourney's single core competency and value prop. Midjourney is very focused on staying ahead.

edit: I wanted to add that the extensive training costs can be prohibitive for the OSS community to fully participate. Coordination via groups such as LAION can help, but gone are the days of individual OSS participants contributing directly to core foundational model training.

simonw• 3 years ago

Midjourney provides much better images by default. It's really impressive.

Stable Diffusion's advantage is in the huge amount of open source activity around it. Most recently that resulted in ControlNet, which is far more powerful than anything Midjourney can currently do - if you know how to use it.

https://github.com/lllyasviel/ControlNet

pmoriarty7• 3 years ago

Could you elaborate on just how it is more powerful?

acheron• 3 years ago

Not if you want to generate a picture of Xi Jinping.

furyofantares4• 3 years ago

In fact here's a list of painters whose style is immune to direct mimicry in Midjourney because their name is banned:

Ambreen Butt

Jan Cox

Constance Gordon-Cumming

Dai Xi

Jessie Alexandra Dick

Dong Qichang

Dong Yuan

Willy Finch

Constance Gordon-Cumming

Spencer Gore

Ernő Grünbaum

Guo Xi

Elena Guro

Adolf Hitler

Prince Hoare

William Hoare

Fanny McIan

Willy Bo Richardson

Shang Xi

Wang Duo

Wang E

Wang Fu

Wang Guxiang

Wang Hui

Wang Jian

Wang Lü

Wang Meng

Wang Mian

Wang Shimin

Wang Shishen

Victor Wang

Wang Wei

Wang Wu

Wang Ximeng

Wang Yi

Wang Yuan

Wang Yuanqi

Wang Zhenpeng

Wang Zhongyu

Xi Gang

Xie Shichen

Xu Xi

I have this list because I recently made a site[1] that displays the 4 images from a prompt of "Lotus, in the style of <paintername> <birth-death dates> [nation of origin]" for every painter listed on wikipedia's "List of painters" -- except for those in the above list.

The fact that they banned both Xi and Jinping separately to prevent Xi Jinping was surprising to me. Twice as banned as Adolf Hitler.

[1] https://lotuslotuslotus.com - small chance you get an NSFW image if you hit upon Fernando Botero or John Armstrong, perhaps there's more.

ianbicking2• 3 years ago

I listened in to their weekly chat today and it sounded like they'd be happy if they could just ban all political mimickry. I think the AI images of Trump being arrested (which looked like Midjourney to me) were disappointing.

Maybe that just means banning images that are meant to fool people, and obvious satire would be ok, but they might be ok erring on the side of caution.

(Nothing in the talk was this explicit, but this was my read of the subtext)

vitorgrs2• 3 years ago

Midjourney v4 was already better than Stable Diffusion. The new Dall-e (which you can use on Bing) I also find it better...

The main difference with Stable Diffusion is that you can fine tune with your own dataset. There's img2img, and a bunch of other tools. But the base model it's really worse than competitors right now.

flangola72• 3 years ago

Also SD can do porn, which Midjourney forbids for some reason. They're leaving an assload of money on the table and somebody will nab it sooner than later.

archerx• 3 years ago

The Dall-e API sucks so much right now, I’ve been experimenting with it the past few days and it produces a lot of horrors. I even used the Dall-e prompt book as a guide but still so many more misses than hits. Even when it gives a non horrifying image it’s just decent. 5/10 rating

I started testing out the official Stable diffusion API and it already gives you way more control than the Dall-e API and seems to produce less horrifying images that are better quality but I feel like Dall-e understands the prompts better. 7/10

I would love to try mid journey but I uninstalled discord years ago and have no plans to ever reinstall it ever again. So I’ll wait for the API access if they ever do it. 0/10 (only for being discord only)

aenvoker4• 3 years ago

SD can be better than MJ if you dig really deep into the open source nature of SD. Open source UI and plugins, community-made models of many types and uses, tribal knowledge of techniques... It’s very complicated and requires a lot of searching, reading, installing and experimentation.

The base tech and models straight from Stability AI give pretty crap results if you just plainly describe a scene.

MJ in contrast provides a great results out of the box. Say anything, get beautiful picture of something. From there you need to figure out specifically what you actually want.

However, if you really want to iterate on just specific details of a scene with a specific layout, with specific characters in specific poses, with specific style elements, MJ is too chaotic to control at that fine detail. So to is SD out of the box. But, if you take the time to learn how to install and use ControlNet, highly specialized models/LORA/textual inversions from wildly varying sources, in-painting, latent upscaling, hook up Photoshop/Krita/Blender integrations, ect, ect… you can eventually get very precise control of SD’s results. And, then new better tech releases next week! :D

pmoriarty7• 3 years ago

This kind of reminds me of a VSCode vs emacs comparison.

ianbicking2• 3 years ago

There's lots of versions of Stable Diffusion so I've had a hard time knowing what to compare exactly. But from what I've seen none of them come close to Midjourney.

Stable Diffusion does more things though, like in-painting where you can erase part of an image and then have it recreated. I've seen videos of people doing impressive things with in-painting and extensive regeneration of each portion of an image until it's just right. Seems like a ton of work though. Still I've had some fun using it to modify images or extend images.

kaetemi• 3 years ago

From what I understand, SD doesn't handle color space correctly (or at all), hence all the weird saturated blue-magenta-orange-beige gradients in a lot of its example outputs. And why its output often feels more like a bad Photoshop collage than a proper blend. It's probably trained on unmanaged sRGB. In which case the SD model is fundamentally flawed, since doing math in sRGB space is nonsense and causes bias (specifically those saturated gradients are a sign of just that...). Although I don't know for sure, I didn't find any color management code in their scripts when I looked for it, so I'm assuming this is the case.

I'd be happy to be corrected if anyone knows the details on this in SD.

dragonwriter3• 3 years ago

Is the latest Midjourney now considered better than Stable Diffusion?

Its better in terms of having a no-user-configuration service available that gets you from zero to decent results with nothing more than prompting.

SD is better in available specialized customized models (finetuned checkpoints and the various kinds of mix-and-match auxiliary models and embeddings that can be used with them), not having banned topics because it is self-hostable, available tooling and UIs that expose tuning parameters and incorporate support for integrating techniques like guided generation with various types of ControlNet models, animation, inpainting, outpainting, prompting-by-region, etc., with image generation.

GaggiX2• 3 years ago

Stable Diffusion XL is on the way, it's a bigger model, it's still training but you can try the last checkpoint on dreamstudio.

danielmoller• 3 years ago

I've played around with v5 and it generates some insane images. Vast improvement over the early days in Sept 2022 when Stable Diffusion had just come out as well, and Midjourney still had lots of room for improvement.

Excited for what V6 will bring.

aschearer2• 3 years ago

This was worth it just to discover https://promptbase.com/ -- feels like I'm seeing the future! Bonkers!

ZephyrBlu12• 3 years ago

Those prompts look crazy expensive. I would personally price the vast majority of prompts at <<$1.

aschearer2• 3 years ago

I have no opinion on that, but my first reaction was "this is silly." My second reaction was, "this will be a future job/product."

nickthegreek• 3 years ago

Or save a few of the example photos and use midjourney's /describe <url> to get something close.

quickthrower22• 3 years ago

Makes NFTs look even more dumb ha ha when you can do this.

anonyfox2• 3 years ago

here I am, $50 spent roughly just to read a few "professional" prompts I can steal from and modify :-)

yieldcrv• 3 years ago

protip: you can feed midjourney guided to chatgpt and it will make amazing prompts

sorry aspiring prompt engineers, AI can do that too

dantk• 3 years ago

I've done this and have gotten great results. I made a base prompt that includes all of midjourneys documentation, and as gpt gives me prompts I plug them into midjourney and each of them a rating. I'd like to know if you've done something similar or if you have different methods

totetsu3• 3 years ago

GPT LLMs etc are designed to output strings that look like real language, and follow rules of grammar and word constructions etc that are used by people. Image generating models can be manipulated by using prompts with all kinds of strange combinations of words and letters that would never come out of a language generating model.

flangola72• 3 years ago

all kinds of strange combinations of words and letters that would never come out of a language generating model.

My experience with LLaMA has shown me this is definitely not the case.

franze• 3 years ago

taking currently a deep dive into midjourney and

I found the most interesting results can be found by

a) combining artists i.e.: by Rafal Olbinski in the style of frank frazetta

b) combining artists and photographers i.e.: by Rafal Olbinski photographed by Helmut Newton

c) turning artists into photographers i.e.: photographed by Frank Frazetta

d) limits limits limit i.e.: only in orange and yellow

some of the things I did can be found https://instagram.com/f_r_a_n_z_ai?igshid=YmMyMTA2M2Y= here (but most in the vanishing Stories as I did not but them into squares yet)

niwrad3• 3 years ago

I feel that Midjourney v5 really lets you explore different worlds.

One recent feature the guide missed is the permutation and repeat features [1]. They're quite helpful for power users that want to explore multiple styles quickly.

Last week I tried putting together a short film using GPT-4 and Midjourney v5. I was stunned by the cinematic frames Midjourney v5 was able to create:

https://youtu.be/6O_tOuUcG9s

I (human) wrote the prompts for Midjourney, though.

[1] https://docs.midjourney.com/docs/permutations

JanSt• 3 years ago

Impressive. Thanks for sharing

Robby2023• 3 years ago

wow I had no idea about permutations in Midjourney and it's an amazing feature! thank you very much!!

Paul-Craft5• 3 years ago

Damn. It's no Harry Potter by Balenciaga, but it's surprisingly compelling given that most of it was generated (granted, with prompting) by AI tools. I notice you credited GPT-4, Midjourney, and Metavoice, but was the music AI generated as well?

I've gotta say, I've seen worse storytelling and cinematography come from actual, serious humans who were getting paid to do it. And the Balenciaga thing is obviously a joke, because that whole genre only works because the style of those videos is beyond parody and sails right over the uncanny valley. This is different. This is interesting. I like it.

niwrad3• 3 years ago

Thanks for your kind comments!

I'm glad you pointed out the music. The music was also AI generated with a tool called AIVA [1]. I'd never composed a piece of music before, and I was pretty surprised by what I could "create". I spent 30~60 minutes max creating the score.

Some parts of their product still feel janky, but as an overall concept, it's quite fascinating. One of the interactions I enjoyed was that AIVA creates scores with different tracks (layers). So I was able to edit tracks I don't like (e.g., change a Piano track to Brass) or have AIVA completely regenerate certain sections of the score (e.g., redo the bridge, regenerate the chorus sections).

One difference from Midjourney is that there's no text-based prompting. Instead, you "prompt" through music inspiration.

[1] https://www.aiva.ai/

stuckkeys• 3 years ago

Belenciaga piece is hilarious.

henpa• 3 years ago

Really nice video! The person's hand with 2 thumbs at 0:47 can really tell it was created using Midjourney. It usually does fingers very wrong! lol

ChatGTP6• 3 years ago

nightmare fuel indeed

arvinsim• 3 years ago

Curious, did all your work necessitate subscribing to the $30 plan?

niwrad3• 3 years ago

I ended up subscribing to the $60 plan, mainly to get access to the Stealth Mode. I used about ~4h of fast time during the project. With that said, I could have created this with the $10 plan (3.3 hours) if I had to.

kiru_io• 3 years ago

I found this Google Sheets linked on one of the sites, it was more useful for me than the actual site:

https://docs.google.com/spreadsheets/d/1cm6239gw1XvvDMRtazV6...

thelazyone• 3 years ago

I wonder how accurate this approach is. One thing is being trained on someone's art, another is getting hints from the rest of the whole collective knowledge of how that artist works.

checking the V5 tab I almost immediately found Akira Toriyama, and the art is ... well, sure on one of the four drawings there are some Goku-like hair on ...some cheeks (not the face ones) drawn in the style of Terry Gilliam?

Then of course, for older artists the match is much stronger, and for some of the modern and famous ones too. But it seems to me that the whole method could be heavily biased.

Midjourney AI Guide

Related Stories