Gaudi: A Neural Architect for Immersive 3D Scene Generation

by andsoitis • 4 years ago

111 25 4 years ago

mistrial92• 4 years ago

if this is an internal code-name OK, but this public post sounds more like a product name. How is it OK to hijack the widely-known artist, with no other meaning, for your commercial VR product ?

"Antoni Gaudí i Cornet was a Catalan architect from Spain known as the greatest exponent of Catalan Modernism. Gaudí's works have a highly individualized, sui generis style. Most are located in Barcelona, including his main work, the church of the Sagrada Família"

spywaregorilla2• 4 years ago

Seems more like an homage than a hijacking?

uoaei2• 4 years ago

It's cute, but completely tone-deaf.

zitterbewegung• 4 years ago

There is DALLE and Inception from other groups (openai and google ) . Also Big Bird and Bert. It’s basically okay as long as anyone would find an issue or involve lawyers at least for Deep Learning researchers .

klipt• 4 years ago

Dali -> DALL-E

Gaudi -> GAUD-E?

rgovostes• 4 years ago

Wait until you hear what they did to McIntosh apples and Isaac Newton.

LegitShady• 4 years ago

100% correct. just borrowing credibility unearned.

mistrial92• 4 years ago

I am not OK with public social arts being rebranded for corporate PR

cinntaile• 4 years ago

It's just a homage to an architect.

zvr• 4 years ago

Not to mention the (trademarked) Gaudi processor for ML/AI: https://habana.ai/training/gaudi2/

Wondering whether this Gaudi software can be ported to use Gaudi SDK :-)

yazzku2• 4 years ago

Why is this down-voted? Fuck the name appropriation for corporate PR.

threeseed2• 4 years ago

So what is the thought process here.

That Apple is going to name their next flagship device: ML-Gaudi ?

As opposed to this just being a playful name for an open-source project.

Hnus• 4 years ago

enables conditional generation of 3D scenes from different modalities like text or RGB images.

Please help me understand few dumb questions I have.

- What exactly is used as an input to generate such scenes is it just few pictures or even text description?

- Is it able to generate data for something which was not in the input? Like you have some common object in the corner of your photo and its able to expand the picture as if you had it in the frame in the first place?

- What is the end game of technologies like these? Could it be one day fed lets say every piece of data google has about the world like every 360 picture, every book, article, video, movie and so on allowing you to take picture of something and spawning infinitely walkable world looking and behaving as our reality? Similar to procedurally generated video game map.

upupandup• 4 years ago

i think this takes a scene, pictures or videos and reconstructs a 3D scene where it recognizes entities.

i dont think so? it just reconstructs the space it sees but it could absolutely expand to fill in the gap so to speak.

robotic navigation and manipulation with environment would be my immediate guess. It would be able to build a complete 3D version of the world and recognize objects. Your idea could be a reality here as well.

CVPR 2022 was a very interesting year for 3D scene reconstruction. One particular paper I recall was reaching into a database of CAD objects and simply replacing the scene with those objects that fit very close to what is shown in the scene. It could mean that a robot armed with this type of computer vision could manipulate with every single object it sees and know exactly how to interact with it without further examination.

fezfight• 4 years ago

What's with the weird license? Where's the code? Looks cool, otherwise.

threeseed2• 4 years ago

Code will be there in a few weeks.

And the license seems to be MIT/Apache style but making it very clear not to use their logo and that Apple doesn't grant you patent indemnification.

auggierose• 4 years ago

Is that a Wolfenstein texture I see there?

coolspot• 4 years ago

Vizdoom dataset, yes

http://vizdoom.cs.put.edu.pl/

yarg• 4 years ago

Perhaps I'm wrong, but judging by the wibbly-wobbly walls, this is well behind the state of the art when it comes to the preservation of spatial invariants.

By comparison a lot of the more recent demos are not only capable of polyframe structure preservation, but also do a very good job at preserving invariants even of subjects that are moving and deforming (such as a speaking human).

heyitsguay• 4 years ago

Cool! Any demos you can link to?

pyuser583• 4 years ago

Are there intellectual property concerns with naming a framework after a person? I’m assuming it’s a reference to Antoni Gaudi.

Gaudi: A Neural Architect for Immersive 3D Scene Generation

Related Stories