Adobe's new image rotation tool is one of the most impressive AI tools seen

https://www.creativebloq.com/design/adobes-new-image-rotation-tool-is-one-of-the-most-impressive-ai-concepts-weve-seen

by ralusek • 2 years ago

912 258 2 years ago

ralusek• 2 years ago

Pretty incredible

jprd• 2 years ago

Completely agree. I thought this was going to be some underwhelming nonsense, but that is legit impressive and something even a non-artist could benefit from.

CSMastermind• 2 years ago

Arguably non-artists benefit the most. This is a time saver for skilled artists but a whole new ability unlock for the unskilled ones.

sharpshadow• 2 years ago

Amazing this will give ancient GIFs a facelift.

zeroXeng2• 2 years ago

so, pacman will have 3 D characters now ?

joelfried• 2 years ago

Yes, Ms. Pacman has the DDs, which is why PacMan himself gives her the D.

3 Ds.

achow3• 2 years ago

The source (Adobe MAX) 'demoes' full range of incredible scenarios..

https://www.youtube.com/watch?v=gfct0aH2COw

jampekka• 2 years ago

Not bad, but what's up with the audience? Is there an Adobe cult or something?

dylan6042• 2 years ago

Of course there is. Just like there's an Apple Cult, Android Cult, Facebook Cult, Sportsball team cult, blah blah blah. Any group that is large enough to attract that many users/followers/fans will naturally have a subset that is more gungho than the rest.

dagmx5• 2 years ago

There’s millions of Adobe product users out there. Almost all the design tool developers have keynote events.

As an aside, I hate that people like yourself describe fans of anything they don’t personally understand as cults. It’s an antagonistic framing of a question designed to remove any good faith discussion.

laborcontract• 2 years ago

Regardless of whether these are adobe employees or not, I’d argue that a feature like this warrants such a response.

It makes me miss Apple’s old keynote style that they’ve abandoned in favor of the bland, sanitized, over-polished and pre-recorded video keynotes.

I’m honestly over so much of the corporate cynicism and Blind-indification that’s turned what was once a necessary precautionary stance to this demonization or ridicule of people who happen to love their work and where they do it.

achow3• 2 years ago

Come on.. it is literally dream come true for an artist whose nightmare is indecisive, confused clients.

You have to read some of the YouTube comments to understand that some of those hoots and claps could be for real.

allenu• 2 years ago

I'm not sure about this particular event, but companies often have employees who worked on the products in the crowd during launches to provide even more crowd noise.

mesh4• 2 years ago

This is Adobe Max, which is a huge event held by Adobe for creators.

This session is "Sneaks" which is held every year, and has a fun, casual atmosphere. i.e. it has a theme, has a celebrity co-host, lots of jokes, food and drink served, etc...

Its basically a bunch of people who are creative, and are having fun nerding out on the tech...

Its a lot of fun.

(I work for Adobe)

reaperducer2• 2 years ago

Not bad, but what's up with the audience? Is there an Adobe cult or something?

There are conferences for Adobe customers to teach them how to use Adobe tools. I think there was recently an Adobe Max conference in Los Angeles. It could have been filed there.

smallerfish• 2 years ago

Also the "fun" stage setting. I once quit a big-ish tech company when they started pulling stuff like that.

renewiltord• 2 years ago

It's an immense feature. Illustrators love it. Of course they're enthusiastic about it. Man, there's nothing like this. You draw 2D vector art and then rotate it in 3D space. What the heck, that's freaking crazy. I'd be hooting and hollering. How can you not be losing your mind over this. It would accelerate so many processes.

My wife's an artist and says they had a shitty version of this but this is crazy.

xnx2• 2 years ago

The video is much better than the linked page. The video shows the dynamic multi-angle character rotation and other object rotations. https://www.youtube.com/watch?t=63

jervant• 2 years ago

That event has the enthusiasm of old Apple demos

jobigoud• 2 years ago

Maybe you missed the video in the linked article? it's the same demo.

andywaite• 2 years ago

Weird that YouTube's default error page (xnx's post) is a 1 minute video titled "YouTube is not currently available on this device.".

pier25• 2 years ago

Finally more AI tools for vectors!

With bitmaps you get a blob of pixels but vectors you can be edited and refined much easier.

mvdtnz• 2 years ago

This will work well about one out of every hundred times you try it. Enough to find good demo examples though.

moi23882• 2 years ago

Get an AI to generate 100 examples then

hackernewds3• 2 years ago

Now someone do this with a human object, and wait for the media to have a collective freakout

somedude895• 2 years ago

I'm a bit disappointed they didn't an artist drawing something live and then rotating that.

schnebbau• 2 years ago

Incredible, but a shame you'll have to use Adobe to get it.

nakedrobot2• 2 years ago

Yes. I absolutely despise Adobe, and I will not be using this.

They were double charging me for photoshop for two years. I caught them and it took 60 minutes on the phone to get them to do something about it.

They have an entire cancellation department. (!)

stainablesteel• 2 years ago

probably not, there's a new and growing market of image editing software with a wide variety of tricks, i wouldn't be surprised to know this is already implemented on some niche website

ryandrake2• 2 years ago

I'm making some big assumptions about Adobe's product ideation process, but: This seems like the "right" way to approach developing AI products: Find a user need that can't easily be solved with traditional methods and algorithms, decide that AI is appropriate for that thing, and then build an AI system to solve it.

Rather than what many BigTech companies are currently doing: "Wall Street says we need to 'Use AI Somehow'. Let's invest in AI and Find Things To Do with AI. Later, we'll worry about somehow matching these things with user needs."

ryanmcbride• 2 years ago

Yeah I much prefer this approach to the current standard of just putting a chat bot somewhere on the page and calling it a day.

JohnMakin• 2 years ago

Precisely. There are many such use cases too! It's disappointing to see the industry go all in on chatbot wrappers.

jthacker• 2 years ago

This is certainly a great immediately useful tool but also a relatively small ROI, both the return and the investment. Big tech is aiming for a much bigger return on a clearly bigger investment. That’s going to potentially look like a lot of useless stuff in the meantime. Also, if it wasn’t for big tech and big investments, there wouldn’t even be these tools / models at this level of sophistication for others to be using for applications like this one.

HarHarVeryFunny4• 2 years ago

While the press lumps it all together as "AI", you have to differentiate LLMs (driven by big tech and big money) from unrelated image/video types of generative models and approaches like diffusion, NeRF, Gaussian splatting, etc, which have their roots in academia.

eitally• 2 years ago

On the plus side, for Adobe, is that they have a fairly stable & predictable SaaS revenue stream so as long as their R&D and product hosting costs don't exceed their subscription base, they're ok. This is wildly different from -- for example -- the hyperscalers, who have to build and invest far in advance of a market [for new services especially].

mihaaly• 2 years ago

It is the 'make something for the user/client' vs. 'make something to sell' mindset.

The latter one is what overwhelmingly more companies (not only BigTech, not at all!) adopted nowadays.

And Boeing. ;)

politelemon• 2 years ago

And Boeing?

bobthepanda• 2 years ago

If the lore is to be believed, Southwest (a airline that has made its business only the 737) saw the a320 neo and basically told Boeing "give us a new 737 or we go to airbus." they did what the client wanted, to their detriment.

"If I asked people what they wanted they would've said faster horses," or whatever Henry Ford is falsely accused of saying.

renegade-otter2• 2 years ago

I don't think it's a Big Tech problem. Big Tech can come up with moronic ideas and be fine because they have unlimited cash. It's the smaller companies that need to count pennies who decide to flush the money down the AI Boondoggle Toilet.

"But Google does it. If we do it, we will be like Google".

reaperducer2• 2 years ago

"But Google does it. If we do it, we will be like Google".

Were you in my meeting about 40 minutes ago? Because that's almost exactly what was said.

If the big tech companies wanted to be really evil, they could invent a nonsense tech that doesn't work, then watch as all the small upstart competitors bankrupt themselves to replicate it.

emmanueloga_4• 2 years ago

I think you're being a bit too generous with Adobe here :-). I shared this before, but it's worth resharing [1]. It covers the experience of a professional artist using Adobe tools.

The gist is that once a company has a captive audience with no alternatives, investors come first. Flashy (no pun intended :-p), cool features to impress investors become more important than the everyday user experience—and this feature does look super cool!

1: https://www.youtube.com/watch?v=lthVYUB8JLs

mesh4• 2 years ago

You can have both!

Cool features that excite users (and that they ultimately end of using), and that get investors excited.

(i.e. Adobe mentioned in the day 1 keynote that Generative Fill, released last year and powered by Adobe Firefly is not one of the top 5 used features in Photoshop).

The features we make, and how we use gen ai is based on a lot of discussions and back and forth with the community (both public and private)

I guess Adobe could make features that look cool, but no one wants to use, but that doesn't seem to really make any sense.

(I work for Adobe)

latexr2• 2 years ago

I don’t think those ideas are mutually exclusive. I heavily dislike Adobe and think they’re a rotten company with predatory practices. I also think “AI art” can be harmful to artists and more often than not produces uninteresting flawed garbage at an unacceptable energy cost.

Still, when I first heard of Adobe Firefly, my initial reaction was “smart business move, by exclusively using images they have the rights to”. Now seeing Turntable my reaction is “interesting tool which could be truly useful to many illustrators”.

Adobe can be a bad and opportunistic company in general but still do genuinely interesting things. As much as they deserve the criticism, the way in which they’re using AI does seem to be thought out and meant to address real user needs while minimising harm to artists.¹ I see Apple’s approach with Apple Intelligence a bit in the same vein, starting with the user experience and working backwards to the technology, as it should be.²

Worth noting that I fortunately have distanced myself from Adobe for many years now, so my view may be outdated.

¹ Which I don’t believe for a second is out of the goodness of their hearts, it just makes business sense.

² However, in that case the results seem to be subpar and I don’t think I’d use it even if I could.

WillAdams• 2 years ago

Moreover, when one looks at the chronology with which features were rolled out, all the computationally hard things which would save sufficient time/effort that folks would be willing to pay for them (and which competitors were unlikely to be able to implement) were held back until Adobe rolled out its subscription pricing model --- then and only then did the _really_ good stuff start trickling out, at a pace to ensure that companies kept up their monthly payments.

Ikatza• 2 years ago

Is there no alternative to Photoshop? Affinity or Pixelator don't cut it?

MiddleEndian• 2 years ago

My company has decided to update its hr page to use AI for reasons unknown.

So instead of the old workflow:

"visit HR page" → "click link that for whatever reason doesn't give you a permanent link you can bookmark for later"

it's now:

"visit HR page" → "do AI search for the same link which is suggested as the first option" → "wait 10-60 seconds for it to finally return something" → "click link that for whatever reason doesn't give you a permanent link you can bookmark for later"

coliveira4• 2 years ago

Nvidia needs to continue selling chips like crazy, all companies in the US need to do their fair share to contribute!...

mstipetic• 2 years ago

Somebody's putting "AI expert" on their resume

rightbyte• 2 years ago

"click link that for whatever reason doesn't give you a permanent link you can bookmark for later"

Sounds like engagement hacking?

__alias• 2 years ago

Mine has as well, but it's pretty useful. It's really just a search engine though, but it's indexed confluence and all other internal sites and i've found it pretty useful for everything.

brokenmachine2• 2 years ago

Your company really needs those AI acceleration chips we're being shoveled!!

You could make your search that you didn't need 10x faster!

crazygringo8• 2 years ago

This feels extremely ungenerous to the Big Tech companies.

What's wrong with trying out 100 different AI features across your product suite, and then seeing which ones "stick"? You figure out the 10 that users find really valuable, another 10 that will be super-valuable with improvement, and eventually drop the other 80.

Especially when if Microsoft tries something and Google doesn't, that suddenly gives Microsoft a huge lead in a particular product, and Google is left behind because they didn't experiment enough. Because you're right -- Google investors wouldn't like that, and would be totally justified.

The fact is, it's often hard to tell which features users will find valuable in advance. And when being 6 or 12 months late to the party can be the difference between your product maintaining its competitive lead vs. going the way of WordPerfect or Lotus 123 -- then the smart, rational, strategic thing to do is to build as many features as possible around the technology, and then see what works.

I would suggest that if Adobe is being slower with rolling out AI features, it might be more because of their extreme monopoly position in a lot of their products, thanks to the stickiness of their file formats. That they simply don't need to compete as much, which is bad.

blep-arsh2• 2 years ago

Force-feeding 100s of different AI features (90% of which are useless at best) to users is what's wrong with the approach.

coliveira4• 2 years ago

So it's ok for all of us to become lab rats for these companies?

swatcoder4• 2 years ago

What's wrong with trying out 100 different AI features across your product suite, and then seeing which ones "stick"?

For users? Almost everything is wrong with that.

There are no users looking for wild churn in their user interface, no users crossing their fingers that the feature that stuck for them gets pruned because it didn't hit adoption targets overall, no users hoping for popups and nags interrupting their workflow to promote some new garbage that was rushed out and barely considered.

Users want to know what their tool does, learn how to use it, and get back to their own business. They can welcome compelling new features, of course, but they generally want them to be introduced in a coherent way, they want to be able to rely on the feature being there for as long as their own use of those features persists, and they want to be able to step into and explore these new features on their own pace and without disturbance to their practiced workflow.

ryandrake2• 2 years ago

What's wrong with trying out 100 different AI features across your product suite, and then seeing which ones "stick"?

Even the biggest tech companies have limited engineering bandwidth to allocate to projects. What's wrong with those 100 experiments is the opportunity cost: they suck all the oxygen out of the room and could be shifting the company's focus away from fixing real user problems. There are many other problems that don't require AI to solve, and companies are starving these problems in favor of AI experiments.

It would be better to sort each potential project by ROI, or customer need, or profit, or some other meaningful metric, and do the highest ranked ones. Instead, we're sorting first by "does it use AI" and focusing on those.

tiffanyh• 2 years ago

Focusing on solving customer problems, not buzz words, typically is the right path.

lofaszvanitt2• 2 years ago

Yeah but sometimes, they just f it up. Like the PS crop tool was aok then they introduced the move the background instead of the crop rectangle way of cropping which is still to this day a terrible experience.

Also, Lightroom is one of the worst camera tools out there. It's only known because ADOBE...

dmurray• 2 years ago

I would interpret it that they're getting the same push from Wall Street and the same investor-hype-driven product leadership as every other tech firm, but this time they have the good fortune to specialize in one of the few verticals (image editing) where generative AI currently has superhuman performance.

This is a testable claim: where were Adobe in previous hype cycles? Googles "Adobe Blockchain"...looks like they were all about blockchains in 2018 [0], then NFTs and "more sustainable blockchains" in 2022 [1].

[0] https://blog.adobe.com/en/publish/2018/09/27/blockchain-and-...

[1] https://www.ledgerinsights.com/adobe-moves-to-sustainable-bl...

TheOtherHobbes• 2 years ago

The article says clearly there's no guarantee this feature will be released.

Which I'm reading as "Demo-ready, but far from production-ready."

Somewhat relevant: my experience with Photoshop's Generative Fill has been underwhelming. Sometimes it's wrong, often it's comically wrong. I haven't had many easy wins with it.

IMO this is a company that doodles with code for its own entertainment, not a company that innovates robust and highly useful production-ready features for the benefit of users.

So we'll see if Mr Spinny Dragon makes it to production, and is as useful as billed in the demo.

throwaway20372• 2 years ago

I disagree with your analysis. I think this is a novel use of AI in a commercial art product. Is there any AI feature that Adobe could release that you would not view as "pushed from Wall Street"?

2OEH8eoCRo0• 2 years ago

More like "ship some half baked bullshit wrapper for ChatGPT or llama and call it revolutionary."

kenjackson• 2 years ago

That approach makes sense for very specific domain-tethered technologies. But for AI I think letting it loose and allowing people to find their own use cases is an appropriate way to go. I've found valuable use cases with ChatGPT in the first months of its public release that I honestly think we still wouldn't have if it went through a traditional product cycle.

yalogin• 2 years ago

Counterpoint, the pandering to the market has better stock price appreciation :)

Also I am sure Adobe is doing both. They released an OpenAI competitor recently

johnnyanmac• 2 years ago

Been doing both. Just look at their asset store as of late. Complete mess if you work professionally.

At the same time, apparently their generative autofill is top notch. It's just a shame the industry decided to mix together ML tools with generative art, so that it's hard to tell which from which on a casual glance

bryanrasmussen• 2 years ago

Rather than what many BigTech companies are currently doing

this BigTech strategy or perhaps also Big money strategy is a common feature of all hype bubbles, see XML as an example.

Perhaps caused by the people with the big money not knowing anything about the technology but having a feeling that this will produce some valuable things, therefore throw a bunch of money at everything, those things that survive will reward us, the other stuff we write off.

chucke1992• 2 years ago

Adobe has a powerful moat. That's why companies like MSFT can find better way to integrate AI into workflows rather than just AI companies without any moat.

cloudking• 2 years ago

This is the true power of generative AI, enabling new functionality for the user with simple UX while doing all the heavy lifting in the background. Prompting as a UX should be abstracted away from the user.

jprete• 2 years ago

This probably isn't backed by an LLM but instead some kind of geometric shape model.

m3kw92• 2 years ago

How do you explain a horse 2 legs become 4 legs when rotated assuming they only drew 2 legs on the side view

alfiedotwtf• 2 years ago

SIGGRAPH from over a decade ago has entered the chat...

https://www.youtube.com/watch?v=Oie1ZXWceqM

It may not be AI, but this single video blew my mind back in *2013* and I find myself thinking about it often.

imranq• 2 years ago

This is great -- I'm always amazed how effective classical algorithms are at doing so-called "neural tasks". What's strange is how few SIGGRAPH tech ever makes it out as a consumer product

emmanueloga_4• 2 years ago

The video you shared very much looks deserving of the 'AI' label to me.

Perhaps you mean it doesn't use some of the techniques driving the current AI boom, like LLMs or diffusion models.

leviathant• 2 years ago

SIGGRAPH from over a decade ago has entered the chat... >https://www.youtube.com/watch?v=Oie1ZXWceqM

A version of this was available in Photoshop for a long time, but I think the feature was deprecated and removed completely this year. I had used it for a few things here and there, but dedicated 3D tools were much better if you were working in that space.

djmips• 2 years ago

Looks time consuming

imsaw• 2 years ago

I thought this was one of those sarcastic headlines, highlighting the overuse of AI for basic processes.

hprotagonist2• 2 years ago

NeRF or gaussian splatting?

porphyra3• 2 years ago

I don't think either of those would work with a single 2D vector image.

hprotagonist2• 2 years ago

https://github.com/google-research/nerf-from-image

riiii• 2 years ago

I'm pretty tired seeing AI slapped on everything but holy shit this is impressive.

porphyra3• 2 years ago

I find that Adobe is really pulling away from open source software with all this AI stuff. A few years ago it could be argued that GIMP, Inkscape, and Darktable could do almost everything that Photoshop, Illustrator, and Lightroom could, albeit with a jankier user interface.

But now none of the open source software can compete with AI generative fill, AI denoising, and now AI rotation.

ceejayoz2• 2 years ago

They'll probably be better able to compete once Adobe ups prices to reflect the actual cost of all that processing.

pbhjpbhj2• 2 years ago

Photoshop is £30 a month. NASDAQ.com reports their net profit to be 40% and elsewhere they're reported to gross $20B revenue.

I think they can afford the ML based content generation costs without increasing prices.

mr_machine• 2 years ago

I was just thinking similarly. I don't need any of these AI features and I'm certainly not about to start giving Adobe money, but I'd be lying if I said I wasn't jealous.

RustySpottedCat• 2 years ago

Not yet, but I imagine soon they will. Closed source is moving to video and open source is catching up to static images with incredible pace. I won't be suprised if not only GIMP integrates something like a couple of general stable diffusion models but pirated copies of photoshop find a way to hook up a local generative model instead of the online stuff.

gjsman-10003• 2 years ago

A few years ago it could be argued that GIMP, Inkscape, and Darktable

To a Linux user, yes. To a professional, it was always a cruel joke, it was never close, even a few years ago. It's like saying Notepad++ is a functional IDE, or Kdenlive is a functional replacement for DaVinci Resolve.

I cannot stress this enough: Actual professionals do not think GIMP is a viable replacement, in any way, and never have.

gjsman-10003• 2 years ago

I would also like to add (as a separate comment though, this will be controversial):

Some would say that GIMP, Inkscape, and Darktable aren't really competitive yet because they haven't had enough investment. If we invested in them enough, and managed them well, they could be like Blender.

GIMP has been in development since 1995. Photopea was initially released in 2013, has been solely developed by one person, and is a far-and-away better Photoshop competitor. The projects themselves are mismanaged. GIMP should (frankly) be abandoned and completely reset, in my opinion, as being a failed attempt at salvaging old code forever. Wisdom is knowing when to keep pushing - and when to give up.

jetbalsa• 2 years ago

GIMP did spawn one kinda good thing, GTK was made because Peter Mattis disliked Motif and wrote a replacement and called it the GIMP toolkit

shadowmanifold2• 2 years ago

Krita destroyed Gimp years ago. This debate is always by people who obviously don't even use these tools.

No one would compare GIMP to Photoshop in 2024 that has any idea what they are talking about.

CapsAdmin• 2 years ago

In some way, having followed the open source image generation scene for a while, it feels a little bit like it's opposite?

Most of the ai image generation stuff I've seen from adobe feels late to party in terms of what you can do with open source tools. Where they do compete however is with tight integration, and I guess that's what matters the most to users in the end.

There are plugins for gimp that let you do image generation, inpainting and other things.

As far as what the post shows, it looks very much like current models that generate novel viewpoints of an object, but for illustrations. It might be doable to fine tune this for illustrations and simply vectorise the new viewpoint again. Though this will destroy any structure previously held in the object.

All I'm saying is that we have the tech to do even more than what adobe is doing, we just haven't put it nicely together yet.

NeroVanbierv• 2 years ago

I think your last paragraph sums it up pretty nicely: users need a good UX to get to these tools.

So I would love if GIMP started shipping these awesome plugins by default to pick up the pace!

jerf• 2 years ago

"But now none of the open source software can compete with AI generative fill, AI denoising, and now AI rotation."

This is a common pattern across many fields. The truly top-end companies are always running ahead of open source.

But that doesn't mean it's a permanent situation. It just means you're looking at it from a point in time where the commercials got there, and open source hasn't yet. Open source will get there, and then Adobe will be ahead on something else.

I've played a bit with "comfyui" over the past few days, a bizarre name for an AI image generation power tool. (And other things, but I have no experience there to know how good it is at those.) It drips with power. The open source world is not generally behind on raw capability. As is often the case, open source's deficiency for generative fill for instance is that A: it offers too much control, too many knobs (e.g., "which of several dozen models would you like to start with?"), and while that's awesome if you know what you're doing, it is not yet at the "circle this and click 'remove'" yet, and B: the motivation and firepower to integrate this all into a slick package is not there. I can definitely do an AI generative fill with open source software, but I'll be exporting an image into comfyui, either building my own generative fill program or grabbing some rando's program online who may or may not be using compatible models or require me to install additional bespoke functionality into comfyui, doing my work, and re-exporting it. The job is done, but it's much more complicated, and most people don't care about the other extra capabilities this workflow yields so for them it's just cost.

It's a very normal pattern in the open source world. Nothing about the current situation particularly gives me cause to worry specially about it.

To be concrete, here's a YouTube video that's to the more advanced side of what you can do in the open source world, which is probably still ultimately simplistic compared to what some people do: https://www.youtube.com/watch?v=ijqXnW_9gzc That entire series is worth a look, and there's more it doesn't cover. You can get incredible control over these tools in the open source world, but it involves listening to some guy on YouTube trying to explain why you might to sometimes use a thing called "dpmpp_2m_sde_gpu"... not exactly normie-friendly.

cchance4• 2 years ago

I mean we've been able to do generative fill and denoising, better in open for a while, its just not as easy (except for video really)

What Adobe does is wrap those things in an easy to use app, and then charge for it, and hopefully not change their licensing again to grab everyones shit again.

Regarding the scheduler (dpmpp) sure adobe doesn't tell you those things, but thats because they found one that worked, removed the options and packaged it up with a bow, comfy and a111 and forge etc, are more complex because they give you EVERYTHING and let you have at it. There are frontends that wipe all that away but they arent successful because like the linux world, people in opensource want to be able to tinker with all the internals and shit, which is why opensource tends to see some groundbreaking optimizations, like taking the Flux model from requiring 30+gb of vram to run to running on 6gb of vram lol

horsawlarway3• 2 years ago

I'm not convinced. The flows are a little less convenient right now, but that's basically it.

Ex - I can absolutely get exactly this same rotation feature using open toolchains, they just haven't been nicely consolidated into a pretty package yet.

So to recreate the same thing adobe is doing here I currently have to:

1. Use the 3d-pack in comfy-ui to get stack orbit camera poses for my char (see: https://github.com/MrForExample/ComfyUI-3D-Pack scroll down to stack orbit in the readme)

2. Import those images back into the open source tool manually.

Is it as convenient? Nope - it requires a lot more setup and knowledge.

Is it hard to imagine this getting implemented in open source? Also nope. It's going to happen, it just won't be quite as quick.

JoeyJoJoJr• 2 years ago

Do you know if there is an AI tool to “explode” an image, such as a character, into individual parts for a texture atlas?

See example: https://user-images.githubusercontent.com/9606161/53874756-0...

insane_dreamer• 2 years ago

Can't speak for PS vs GIMP but I used to use Illustrator a fair bit and Inkscape was nowhere near it in terms of both features and useability. Now that was 15 years ago, so it may have caught up.

dagmx5• 2 years ago

You are correct even today. Inkscape is great but it’s a fraction of the utility that Illustrator offers.

The only people who would actually equate them are people not professionally using these tools everyday.

Even paid apps like affinity designer are a fraction of the functionality of Illustrator.

Again, a great product but people are just dead wrong if they compare them as an absolute.

lofaszvanitt2• 2 years ago

They can, but the user experience is abysmal, useless and nerve racking.

dagmx5• 2 years ago

With all due respect there’s never been a time when that could have legitimately been argued unless someone was doing relatively basic things with those apps or was a hobbyist.

There’s always been a significant gap in capabilities once you looked past the surface.

I find this sentiment is common among FOSS advocates who don’t actually professionally use those tools.

I am definitely an advocate for free tools closing that gap, but I both design content professionally and contribute to OSS projects to close that gap. So I feel quite confident in saying that gap has always been large when compared to the Adobe suite.

woah• 2 years ago

Even if the open source option is only slightly worse, why would a professional allow that to impact how they earn a living?

almostgotcaught• 2 years ago

I find this sentiment is common among FOSS advocates who don’t actually professionally use those tools.

It's wishful thinking at best and delusion at worst. I see it constantly on hn on many threads. I suspect hn incents that kind of language because people on hn like being pandered to.

whywhywhywhy• 2 years ago

A few years ago it could be argued that GIMP, Inkscape, and Darktable could do almost everything that Photoshop, Illustrator, and Lightroom could, albeit with a jankier user interface.

It really couldn't

juthen• 2 years ago

Almost all the AI models come from open research. Yes, open software hasn't caught up because they don't have the billions of research money to implement this models, but that doesn't mean it won't happen at some point.

SirMaster• 2 years ago

Looks like Adobe finally found a way to cut down on piracy.

None of these new AI features will work on a pirated copy because it's all server-side processing.

tombert• 2 years ago

I spent so many hours trying to do rotations with a pirated copy of Flash as a kid, and I never really got the hang of it, and it always bothered me how deceptively hard rotation was; when I would show my parents my work, they would do their very best to try and act excited but I could tell that they weren't really impressed with the effort because it doesn't seem that hard, at least to a lot of people.

This makes me irrationally happy.

stavros2• 2 years ago

Yeah, this is one of those things that seems trivial until you try to do it, and then it's impossible.

PaulHoule• 2 years ago

Makes me think of

https://lookingglassfactory.com/looking-glass-go-spatial-pho...

which needs multiple views of your image from different angle and tries to make it up with AI.

o1o1o1• 2 years ago

Does anybody know a DIY solution to get a similar result? I am asking because 300$ seems like a lot of money for this.

alexashka• 2 years ago

People have been using 3D models for 2D graphics for at least a decade. 3D models rotate, by default.

This demo shows generating a 3D model from a simple 2D shape. It'll fall flat on its face trying to 3D model anything non-trivial which begs the question - who cares?

Also, you'll want to animate the 3D model - which this doesn't do, so you'll soon be back to your usual 3D toolkit anyway.

fooker• 2 years ago

The difference is that you don't need a 3D model for this.

You start with 2D vector graphics that is significantly easier to create.

dishsoap• 2 years ago

Yes, and the OP did acknowledge as much.

egypturnash2• 2 years ago

This is in a wholly 2D program. The input is implied to be one completely flat vector drawing, which Illustrator turns into a 3d model, and renders back into flat vectors at multiple rotations, with no further work on the part of the artist.

(I say "implied" because that's all they're showing in the video presentation, there may be additional setup involved that they're skipping. This is inside Illustrator though, which has a long history of 3d extensions being very awkwardly shoved into a corner of its toolset.)

simpaticoder• 2 years ago

This captures the essence of what "modern AI" is great at! Relieving the tedium of a highly constrained task.

Great demo. This will really help animators and artists.

worksonmine• 2 years ago

Came here assuming they were using AI for "rotate 90°" ready to drop a rant, but this was actually impressive.

hackitup7• 2 years ago

I had a similar negative reaction to the grandiose title but in this case it was totally deserved and I am pretty blown away.

_qua• 2 years ago

Good idea, but such a frustrating company to do business with as a consumer

trox• 2 years ago

This looks very cool. I really hope the results are not overly cherry-picked like Adobe's first version of the text-to-vector generation that only worked particularly well for the showcased art styles.

coldcode• 2 years ago

I won't be excited until its live in an app, company demos are always exciting.

999900000999• 2 years ago

I want the actual 3D models.

This looks like the perfect tech for a cel shaded game!

dweekly• 2 years ago

I found the Project Turntable page on Adobe's site more interesting (with embedded video) on mobile than the linked CreativeBloq site:

https://www.adobe.com/max/2024/sessions/project-turntable-gs...

wslh• 2 years ago

I am sure this is the right time for hobbysts to make your own movies, and animations.

I personally started programming, in part, to make simple animations like the ones you see in Scratch, and it’s incredible how accessible the tools are today for anyone looking to bring their ideas to life.

qwertox• 2 years ago

If you rmb-click on the video and select "show controls", you will not only be able to seek, but you'll also be able to unmute it.

I don't know why it was embedded with the controls hidden.

rcarmo• 2 years ago

As someone who currently works in GenAI and analytics but paid their way through college doing design (for print media) and still keeps around old copies of Illustrator and Fireworks (running under Wine) as well as using Affinity Suite, this is STUPEFYINGLY more impressive than any LLM.

Still not enough to make me pay for Adobe Creative Suite (I just dabble these days), but the target demographic will be all over it.

changing1999• 2 years ago

It took me a while to understand that the second picture is actually a muted video with hidden controls.

vivzkestrel• 2 years ago

haven't been in the loop for a while, stupid question: why do people hate adobe

dsign2• 2 years ago

Not a graphic designer, so I can't speak for their reasons, only for mine. First, I had a photoshop subscription and when I cancelled they wanted to fine me for cancelling. Then they bought the Substance suite and made it subscription only and very expensive (unless you buy the Steam version, whose price they doubled). That also hurt me, when I could barely afford those tools

I'm better off now, but I have a long memory and prefer to vote with my wallet by paying multiples to any competitor...which generally speaking is better for me and everybody else, since competition is the mother of innovation.

Apropo, Marmoset Toolbag 5 is out; it comes with a permanent license, it has a huge materials library, and the interface is very snappy and it doesn't feel like it has been programmed using Electron. You don't need to pay for Substance Painter this year.

Ah, and Adobe's latest exploit was a confusing TOS that more or less stated they would use your work that you edited locally with their software to train their AI models. I think they walked that one back when the wave of outrage hit them.

ilaksh2• 2 years ago

There are actually multiple open source ML models for 2d to 3d which is clearly what they are doing. The difference with most of them is that this is vectors.

There might actually be a similar open source model already.

But I think to create it you would build it from a database of 3d assets that you could render from many angles. Probably quite similar to the way the 2d to 3d works. I don't know maybe the typical 2d to 3d models will work out of the box or with some kind of smoothing or parameterization. Maybe if you have a large database of parameterized 3d models then you combine that with rendering in 2d from different angles then you can basically use the existing 2d to 3d model.

https://replicate.com/collections/3d-models

njtransit• 2 years ago

Are you sure that’s what they’re doing? In the demo, they show that the vector sections have been preserved, so there’s clearly more to the story. Maybe 2D -> 3D, map path to vertex, rotate, project path back into 2D?

ilaksh2• 2 years ago

I think it's not the same but similar.

cchance4• 2 years ago

It's 2d to 3d back to 2d and converted to vectors.

dsign2• 2 years ago

Well, when is so big bad company going to bully us into using their tools to convert 3D sculpts into flawlessly animatable models? I'll submit to their abuse and surrender my lunch money to them. Though not if it is Adobe, I still have some self-love.

AbraKdabra• 2 years ago

Ok that's VERY impressive, now give me the possibility of exporting it as an .stl to 3D print and then we'll be talking. Just imagine drawing something in 2D and be able to print it as a fully 3D object, it gives me chills just by thinking about it.

horsawlarway3• 2 years ago

This is here now. It's possible to set up a flow in a node based ai tool to go from text prompt to stl in a single shot.

They current results using open license models aren't incredible in their fidelity, but it's literally here today.

shunia_huang• 2 years ago

Links please?

m3kw92• 2 years ago

one thing is you can't be lazy when drawing the initial vector like a car for example, you can't just draw from the top and expect it to generate a side shot after rotating. You need to draw maybe an isometric version first.

Bjorkbat• 2 years ago

As someone who otherwise hates genAI, I must admit, this is actually a very cool demo and a very sensible application of AI.

nullandvoid• 2 years ago

How very strange, my partner was mocking up a room for our home just a few hours ago, and I asked whether an AI tool existed to rotate the incorrect angle of a sofa in a photo being used within the mock up - and here it is on hackernews just an hour later, just that tool..

Edit/ apparently I misunderstood it's only possible with vectors - getting close though to the reality mentioned!

seattleeng• 2 years ago

preserving the vector art after transforming is really cool, anyone know the relevant papers? or was this original research done by Adobe?

andrewstuart• 2 years ago

Better link with working video:

https://www.adobe.com/max/2024/sessions/project-turntable-gs...

redbell• 2 years ago

Adobe's Brian Domingo told Creative Bloq that like other Adobe Innovation projects, there's still no guarantee that this feature will be released commercially.

Well, I confess I got a little bit confused here :/ . What's the purpose then for such an innovative solution if not commercialized?!

bombcar2• 2 years ago

It means it’s a tech demo that still has issues which they think they can solve but aren’t sure.

Anything could happen and they need to be sure they don’t run afoul of securities law by “promising” something they don’t end up delivering.

andai2• 2 years ago

Is there another source? None of the images loaded for me.

andai2• 2 years ago

Edit: The article embeds this video, but apparently it embeds without sound. Here's a direct link.

https://cdn.mos.cms.futurecdn.net/RnibKWuooxUZ7xptBz4UHd/Pro...

cchance4• 2 years ago

I've seen a lot of cool shit from adobe but its mostly rehashed stuff thats been cleaned up from public workflows from stuff we've seen done in comfyui and other flux/stable diffusion based expansion workflows... like the IC-Light style relighting they demod...

But this... this is really fuckin cool

philo23• 2 years ago

I don't think quite the same kind of tech, but this kinda reminds me of the "3D" pixel art sprite editor thing in Smack Studio

https://youtu.be/sM3ss-lY1zU?t=10

adroitboss• 2 years ago

I was just about to post the same link. It is really cool tech and Smack Studio is when I first fell in love with the concept. What Adobe has is cool, but I've seen it already.

roryokane• 2 years ago

In summary, Smack Studio is a fighting game with a character editor that can rotate any 2D pixel art sprite as if it were 3D by extrapolating a depth map. You can export the resulting sprites for use outside of the game.

The game was released on 2024-07-31.

dibbla• 2 years ago

It looks cool and covinient for people like designers and other non-techinical content creators. One natural follow-up would be, can we find many other similar operations that are used by creativity people everyday and tackle them under a unified framework?

fitsumbelay• 2 years ago

pretty much how I always assumed AI-powered tools'd work. still, mind blowing to see in action

ipunchghosts• 2 years ago

Has anyone actually use this tool? I wonder how cherry picked the example is.

qalmakka• 2 years ago

Very nice! If only Adobe did Linux builds, that would be great.

fennecbutt• 2 years ago

I do like AI stuff but isn't it simpler to just introduce 3d clipart essentially? Sure models could then be generated, but traditionally made models could be used too

bhelkey• 2 years ago

It is a lot easier to make a 2d drawing than it is to make a 3d model.

brokenmachine2• 2 years ago

Yeah, nothing Adobe does is impressive enough to be worth dealing with them.

Adobe's new image rotation tool is one of the most impressive AI tools seen

Related Stories