Meta's Vision for Superintelligence

https://www.meta.com/superintelligence/?_fb_noscript=1

by GlitchRider47 • 12 months ago

82 173 12 months ago

I don't buy these Superintelligence claims from Meta of 'abundance' and 'humans are free to do other things' as they are tied to Wall St and earnings.

It is always abundance for the super rich, scarcity for those in jobs.

How can I be free to do my gardening whenever I want when the landlord is asking for $11K rent in my SF flat?

So eventually they will do the opposite of this 'vision' and put this super intelligence to replace jobs.

Also, what happened to the Metaverse that Meta invested hundreds of billions as per their namesake?

jerojero• 12 months ago

The metaverse is an important part for this vision of the future.

With the metaverse it won't matter that you live in a 3x3m cubicle because you will use your VR headset to pretend you live in a spacious and comfortable place.

That's how it was in snow crash anyway, where the term comes from.

jazzyjackson• 12 months ago

Meta invested hundreds of billions as per their namesake

They bought a shit ton of GPUs before the LLM boom, which gave them a running start on training their own model. Zuck talks about it in an interview with Lex Friedman.

gishglish• 12 months ago

How can I be free to do my gardening whenever I want when the landlord is asking for $11K rent in my SF flat?

You can work his fields in exchange for most of the harvest of course!

lo_zamoyski3• 12 months ago

Or join a purgatorial society in exchange for free grazing on his land!

sorcerer-mar2• 12 months ago

How can I be free to do my gardening whenever I want when the landlord is asking for $11K rent in my SF flat?

This is the fatal flaw. It's been recognized explicitly for at least 140 years that the price of land rent rises in lockstep with productivity increases, guaranteeing there is no "escape velocity" for the labor class regardless of how good technology gets.

FirmwareBurner10• 12 months ago

regardless of how good technology gets

Technology increases aren't there so you work less hours for the same pay, they're there so your business owner gets more money form you working the same hours.

If a machine gets invented that can do your job it's not like you can now go home and relax for the rest of your life and still keep receiving your pay cheques. This utopia doesn't exist.

9rx5• 12 months ago

Of course, that's why experts started pushing college/university as the way to find escape, with an understanding that people could use its research facilities to create capital instead of falling into the labor class.

But it was ultimately lost in translation. The layman heard: Go to college/university to become a more appealing laborer to employers. And thus nothing improved for the people; the promises of things like higher income never occurred — incomes have held stagnant.

AIorNot• 12 months ago

Is he renaming the company again?

schmorptron• 12 months ago

if the way they are explicitly starting to optimize llm chats for engagements and friend-like behaviour, he'll just need to switch around some letters to call it Mate

throwmeoutplzdo• 12 months ago

Or Meat, if they were completely honest about their users’ role in the equation </compulsory matrix reference>

steve1977• 12 months ago

From Meta to Super? The next step would be Hyper and we have the modifier keys of the space-cadet keyboard covered.

khelavastr• 12 months ago

How is "superintelligence" defined?

lo_zamoyski3• 12 months ago

The first rule of marketing and hype is to never define your terms.

Instead, you insinuate and play into fantasy and wishful thinking.

wslh• 12 months ago

Same question. I don't think there's a universal definition of superintelligence.

Just to add some food for thought: Is superintelligence simply a very high IQ, a higher than top humans one? If so, we'd need a way to measure that, since existing IQ tests are designed for human intelligence. Or is superintelligence about scale/order-of-magnitude: many high-IQ minds working together? That would imply a different kind of threshold. But perhaps the key idea is that superintelligence is inherently uncapped, that is once we reach a level we consider "superintelligent" we can still imagine something even more advanced that fits the same label.

criddell3• 12 months ago

I define it as smarter than humans. The same way a dog will never understand L'Hôpital's rule, there are probably things that human beings will never understand but future AIs will. I'd call those AIs superintelligent.

alazoral• 12 months ago

I think it’s too easy to get anthropocentric and 1D about intelligence. That dog understands things about the world, important things, that mere humans like Bernoulli could never even dream of.

AIPedant7• 12 months ago

It is worth emphasizing that dogs wouldn't understand formal calculus even if they were smarter than humans! They are not physiologically capable of doing formal mathematics:

- their eyesight is too poor to read

- their paws are not designed for fine manipulations so they cannot write or type

- their throats and mouths are not nearly as nimble as ours, so they cannot vocally communicate detailed information

Even if there was an Newton-level dog, they wouldn't be able to access the ideas of an earlier Euclid-level dog. Human knowledge is not just about our big brains, we've developed many physical features that make transmission of information far easier than other species.

OTOH dogs do have a good intuitive "common-sense" understanding of arithmetic, geometry, and physics. It is the unique gift of humans that we can formalize and then extend this intuition, but this ability (and intelligence as a whole) relies on nonverbal common sense.

Barrin92• 12 months ago

Anthropic, to their credit, just published that pretty funny paper about how they couldn't get their chatbot to run a single vending machine profitably[1]. Admirable that Mark is so visionary he's skipped straight past Bodega-intelligence to super-intelligence

[1]https://www.anthropic.com/research/project-vend-1?ref=blog.m...

SpicyLemonZest4• 12 months ago

Anthropic also expects that superintelligence will be reached in the somewhat near future. The intuition is that there's just not that much distance between a chatbot that can manage a vending machine poorly and a chatbot that can manage it well.

blibble2• 12 months ago

that intuition is wrong

AIPedant7• 12 months ago

Even if that intuition is correct and they can fix the vending machine with a bit more data and RLHF, I fail to see where the "super" comes in here. How the fk are they going to get superintelligent training data? A time machine?

aschobel2• 12 months ago

I wonder if that is the right takeaway; that was Sonnet 3.7

Model since then have been able to run it profitably. Incredible how fast things are progressing.

https://andonlabs.com/evals/vending-bench

SpicyLemonZest4• 12 months ago

This isn't measuring the same thing, and recent results are so extreme that they call into question whether the results would map to the real-world implementation Anthropic tried. Is it really the case that Grok 4 can manage a vending machine many times more profitably than a human, or is it exploiting some property of the simulated environment?

jonplackett2• 12 months ago

When prompt injection is solved I’ll believe super intelligence is possible.

raghavtoshniwal• 12 months ago

Isn't that a bit like saying that if common cold is solved, you will believe that human intelligence is possible? Why isn't it super intelligent if there are security flaws in the system. [Not taking a stance on wether super intelligence is possible but your condition seems a bit arbitrary]

jonplackett2• 12 months ago

I guess what I mean is - if it can be easily derailed from its super intelligence - then it can’t be that intelligent. It’s just a tool, doing as it’s told.

twoodfin• 12 months ago

If trends continue, then you'd expect people to spend less time in productivity software, and more time creating and connecting.

Does the average American worker today spend a ton of time in productivity software?

I know and Zuckerberg surely knows the impact on labor will be much more pervasive than that, so it seems like an odd way to frame the future.

reaperducer2• 12 months ago

more time creating

Considering that the most common use for "AI" is to take jobs away from creators like artists, musicians, illustrators, writers, and such, I find this statement hard to believe.

So far, all I've seen is AI taking money away from the least-paid workers (artists, et.al.) and giving it to tech billionaires.

K0balt4• 12 months ago

But people have to keep creating to feed the AI! AI is extractive, not creative, so without people toiling away and adding actual creativity, current paradigm AI will become increasingly derivative and uninspiring… so the obvious answer is to put people into nutrient filled VR pods so they can imagine actually new things to power the AI hive-mind.

reaperducer2• 12 months ago

Does the average American worker today spend a ton of time in productivity software?

"Average?" No. But many millions of people, yes.

The majority of people in my company spend their day tied to Microsoft Office.

Which bring its own problems when managers don't understand that building a computer program isn't the same speed, complexity, and skill level as making a PowerPoint presentation.

ctippett• 12 months ago

I know your comparison to PowerPoint was probably not meant to be taken literally, but I'll just add that a good presentation takes just as much time, skill and effort as any creative endeavour (including programming).

meindnoch• 12 months ago

and more time creating and connecting.

Creating what? AI slop?

HDThoreaun• 12 months ago

I mean yea, Marks vision here is that genAI creates special personalized space in his metaverse for literally everyone in the world. Slop for the masses.

demirbey05• 12 months ago

We didn't even reach AGI and no sign with LLMs.

coldpie3• 12 months ago

Deeply embarrassing to see this coming from one of America's most powerful companies, especially after the metaverse faceplant from a few years back.

techpineapple2• 12 months ago

Why embarrassing? Having one failure means you can’t try again?

coldpie3• 12 months ago

LLMs are not going to fundamentally reshape society. Productivity will go up a couple percent, the profits from that productivity will go to the richest people. Some jobs will be made redundant, some new jobs will be created. That's it. Same as it ever was.

yodsanklai• 12 months ago

Nothing is surprising in the current Zeigest...

mrcwinn• 12 months ago

Personal superintelligence that knows us deeply, understands our goals, and can help us achieve.
We believe the benefits of superintelligence should be shared with the world as broadly as possible.

So... ads.

saubeidl• 12 months ago

Not just ads. Psyops, a propaganda machine unlike anything the world has ever seen. There's a reason Zuck and the US government are real cozy lately.

bigbadfeline• 12 months ago

We're already there, in this particular case, superintendence cant do any better than plain old LLMs.

ankit219• 12 months ago

That is the model everyone gravitate towards. Openai's Fidji too started with the note about how superintelligence is for everyone.

I think it would be back to income based tiers though. You want more assistance, pay $200 per month. Even more, maybe $2000 (for companies). Then, if you dont want to pay, you get contextual ads (which would work here because llms can contextualize far better), and a lower quality of service.

tropicalfruit• 12 months ago

“Personal superintelligence”

just running on metas servers with metas software and metas tracking and algorithms.

"This is distinct from others in the industry who believe superintelligence should be directed centrally towards automating all valuable work, and then humanity will live on a dole"

says the guy who spend most of the last 3 years laying people off.

theres just too much sliminess to dissect. i leave it at that.

one thing for sure, these evil megacorps will use this tech in a dystopian and extractive way. nothing ever changes.

subpixel• 12 months ago

"more meaningful impact on our lives will likely come from everyone having a personal superintelligence that helps you achieve your goals, create what you want to see in the world, experience any adventure, be a better friend to those you care about, and grow to become the person you aspire to be."

Meanwhile I can't properly find items that are listed on FB marketplace.

orochimaaru• 12 months ago

It’s a fluff piece for investors. I think the same may have been said for the metaverse.

lo_zamoyski3• 12 months ago

It is possible to hold the following two statements to be true without risk of contradiction:

1. LLMs and "AI" broadly can become a very useful and powerful technology that can have a transformative effect on industry and so on.

2. Talk of "superintelligence" is total horseshit.

techpineapple2• 12 months ago

I’m curious how many people are actually outside of this, most debates seem to boil down to, “ AI isn’t bullshit I’ve used it and I find I useful” and my argument as a skeptic isn’t that it doesn’t do the things people clearly see it does, nor that those use cases will improve, but that valuations and investment are at the levels of “solving scarcity”

AIPedant7• 12 months ago

This applies precisely to 1970s AI boosters getting way too excited about Prolog and Lisp.

croisillon• 12 months ago

the source code horror of this motherducking webpage

tantalor• 12 months ago

Hi Mark,

Can you put a date on this please?

Thanks, tantalor

Oras• 12 months ago

The art of writing so many words without communicating anything useful.

K0balt4• 12 months ago

Written by meta.ai

But at least he’s trying to signal benevolence. People getting trapped into their projected image is a thing, so in this day and age I’m going to take this as a win.

hnthrow903487652• 12 months ago

This stuff is naive. There's a bunch of people who want a large income (wealth) disparity, and they will fight to preserve it unless you give them an equivalent station in the 'new world'.

But you will still need to sustain ex-workers if they can't get normal jobs, and those same people at the top will not tolerate the taxes required to sustain a basic level of living for much wider population. They already can't tolerate the idea of a much smaller population using food assistance or healthcare from the government.

That leads me to think this is not really a visionary statement, but just a signal that Mark isn't intentionally trying to bring about a new dystopia, and here's his proof. And if a dystopia happens to come about, you can't blame him because he had pure intentions; clearly it was everyone else who just didn't agree with him and it's their fault.

Maybe make Meta a not-for-profit and there might be some credibility here.

lvl1554• 12 months ago

Last time I commented on Zuck on HN I got a warning. That said, this stuff confirms for the 100th time that he is out of touch with reality. Perhaps that’s why he wanted to make VR work so badly. I think he might try to change Co’s name again since Meta doesn’t fit the bill anymore. How about they buy Intel and reverse merge just for the name?

benterix7• 12 months ago

he might try to change Co’s name again since Meta doesn’t fit the bill anymore.

If so, the logical choice would be to change the name from "Meta" to "AGI".

Mars008• 12 months ago

He needs to keep investors optimistic about Meta. Moonshot projects, fairy tales work if there is nothing else. Musk uses them too when promotes Tesla.

ta12653421• 12 months ago

this would be then "Mintel" :-D

FirmwareBurner10• 12 months ago

There's a bunch of people who want a large income (wealth) disparity

Apart form you of course, so I'm sure you'd be ok if the government would tax your higher than average tech wage till your take home pay would match that of a train conductor's or bus driver's, like in Western Europe, and therefore fix the wage gap you hate so much. Would you like that solution?

Caption this: It's only a problem when the people who earn more than me are greedy, but my greed is fine, it's OK for me to out-earn others because "I've earned it", not like Zuckerberg, he didn't earn it.

DanHulton3• 12 months ago

Unless you are yourself a robber baron the likes of Zuck, you should look up this little concept called "class solidarity."

hnthrow903487652• 12 months ago

Sure I would, as long as they tax billionaires even more and guarantee it. I do CRUD app development, I'm not even responsible for anything as potentially dangerous as a train. Superintelligence would very likely take my job anyway, so I won't get taxed for long.

benterix7• 12 months ago

the government would tax your higher than average tech wage till your take home pay would match that of a train conductor's or bus driver's, like in Western Europe

I live in Europe and earn ca. 6 times more than my friend who is a bus driver in the same city. We both have access to free education and, if we wish, also free healthcare, for which I am paying slightly more, but I really don't mind.

tanduv• 12 months ago

perhaps we can create a sort of a bracket that scales based on the income?

queenkjuul6• 12 months ago

I could comfortably live on a bus drivers wage here, obviously I'd prefer they make as much as tech workers, given their job is much harder; your solution is fine with me too, though.

blinkbat• 12 months ago

there's a cap on the bracket around 600k. there are people who make many times this and their percentage owed does not go up. they are also uniquely positioned to avoid paying what low comparative amount they owe. let's start there.

antfarm• 12 months ago

I believe that in the long run, that solution would be preferable to the effects of income and wealth disparity on US society.

deepfriedchokes• 12 months ago

I think perhaps it would be useful to completely ignore the nice words people use and just judge everyone based on their behavior.

From Zuckerberg’s behavior, since the beginning, it’s clear what he wants is power, and if you have the kind of mental health disorder where you believe you know better than everyone and deserve power over others, then that’s not dystopian at all.

Everything he says is PR virtue signaling. Judge the man on his actions.

lcnPylGDnU4H9OF• 12 months ago

completely ignore the nice words people use

Kind of an unrelated topic but I'm reminded of a video essay in which the creator talks about this. They put it very kindly, IMO:

Rich and powerful people have quite a different attitude and approach to truth and lies and games compared to ordinary people.

Which sounds like a really nice way of saying that rich and powerful people are dishonest by ordinary standards.

https://youtu.be/m6lObdE3s10?t=245

ProofHouse• 12 months ago

Mark has never had pure intentions born out and proven by 2 decades of decisions. Mark is NOT who we want shepherding in Superintelligence.

lenerdenator• 12 months ago

If there's one person I trust to raise a superintelligence, it's Mark Zuckerberg.

EDIT:

to clarify, this is sarcasm

azinman2• 12 months ago

I don’t know who will buy this puff piece of a utopian future brought to you by… Meta? Filled with scandal after negative world changing behaviors that they don’t stop? The ones that want to make money no matter what harms it does? Why would the future with even more powerful technology be any different?

alittletooraph2• 12 months ago

ngl that felt like reading a lot of fluff

grimpy2• 12 months ago

why does this page have the same look as ssi.inc? feels kind of strange to copy that of all things?

abxyz2• 12 months ago

its a stylistic choice, it’s a statement: content is all that matters. Brutalist websites have been around for a long time.

https://motherfuckingwebsite.com/

grimpy2• 12 months ago

im quite of aware of what it is. this isn't just "make a brutalist website" it is "make a website that looks like ssi when meta has multiple platforms and means to publish the same message." it is much more intentional than "lets make it look like web 1"

bonoboTP• 12 months ago

If you "view source", you'll see that the difference is day and night. ssi.inc is a simple html website. This Meta memo is a JS framework monster.

jameskilton• 12 months ago

Facebook / Meta and Mark in particular are an amazing case of someone who is, at least at this point, incapable of learning from past mistakes, or even recognizing the mistakes they have made and are continuing to make.

Facebook's mission of "connecting the world" turned out to be the absolute worst thing anyone should ever try to do. Humans are social creatures, yes, but every connection we make costs energy to maintain, and at a certain point (Dunbar's Number) we apply the minimal amount of energy and effort. With Internet anonymity, that means we are actually incapable of treating each other as people on the Internet, leading to the rise of toxicity and much, much worse.

Mark has never understood this, and as his fortune is built around not understanding this, he never will.

There is nothing good that will come from Meta's "superintelligence" and this vision is proof.

9rx5• 12 months ago

that means we are actually incapable of treating each other as people on the Internet

Well, that's because there aren't people on the internet! I mean, yes, us technologists understand that there are often people pulling knobs and levers behind the scenes as an implementation detail, so technically they are there. But they are only implementation details, not what makes it what it is. If you replaced the implementation with another algorithm that functions just as well, nobody would notice. In that sense, it is just software.

leading to the rise of toxicity and much, much worse.

It is not so much that it has lead to anything different, but that those who used to be in the forest yelling at animals as if they were human moved into civilized areas when they started yelling at computers as if they were human. That has taken their mental disorders to where it is much more visible.

dinfinity• 12 months ago

I don't think the "connecting the world" was the problem. IRC also has tons of toxicity and connects people all over the world.

The core problem is gamification of social interaction. The 'Like' button and everything like it for things people say or show is hands down the worst thing to happen on the internet. Everywhere they can, people whore for karma (unless they spend a lot of mental effort to fight back that urge). How primitive the related moderation systems are directly affects how much primitive shit gets rewarded and alas, most moderation systems are ridiculously primitive.

So, dopamine hits for saying primitive shit.

dupsik• 12 months ago

Over the last few months we have begun to see glimpses of our AI systems improving themselves. The improvement is slow for now, but undeniable.

Does anyone know what this is referring to?

Archonical• 12 months ago

If I told you "I've begun to see glimpses of my sobriety", would you be convinced I'm committed to not being an alcoholic?

I don't think anyone knows what he is referring to. Maybe AlphaEvolve? Certainly not Llama.

shortrounddev2• 12 months ago

The effect of Meta products from 2006~2022 has been disastrous for humanity. Social media companies are the new big tobacco. Allowing them to play a leading role in the development of AGI would probably be fatal for democracy around the world. I would not trust a single word that comes out of Mark Zuckerberg's mouth

abxyz2• 12 months ago

“As recently as 200 years ago, 90% of people were farmers growing food to survive. Advances in technology have steadily freed much of humanity to focus less on subsistence and more on the pursuits we choose”

More people today are dying from starvation than people existed on earth 200 years ago. Celebrating our achievements in making shareholders rich is one thing, but to take credit for freeing the people. Yikes. Mark is more out of touch than seems possible.

queenkjuul6• 12 months ago

Yeah he says stuff like that as if the vast majority of people even in his own country don't work continuously for their subsistence, to say nothing of the people in the less powerful countries his company exploits

tim3335• 12 months ago

Because there are more people. Life expectancy etc is way up.

qprofyeh• 12 months ago

Reads as RIP Metaverse to me.

Any time a CEO publishes such empty, wordy essays, it's probably earnings reporting time. I can't shake the feeling it's a public subreply at one of or a cluster of doubting investors, who started to doubt the CEOs vision for the company, or find the lack of one on a certain topic concerning.

laweijfmvo2• 12 months ago

FWIW, today is Meta’s earnings report

lvl1554• 12 months ago

That’s exactly why he published this. To justify his insane investment spend. I am not sure if investors will continue to give him a blank check. He’s not spending his money. He’s spending shareholder money to pursue personal projects and endeavors.

aschobel2• 12 months ago

We believe the benefits of superintelligence should be shared with the world as broadly as possible. That said, superintelligence will raise novel safety concerns. We'll need to be rigorous about mitigating these risks and careful about what we choose to open source. Still, we believe that building a free society requires that we aim to empower people as much as possible.

So maybe no more open source because of "safety"?

sailingparrot2• 12 months ago

We'll need to be rigorous about mitigating these risks and careful about what we choose to open source.

Here we go, predictably pulling the oldest trick in the book, just two weeks after it was reported [1] that the Superintelligence leadership was discussing moving to closed source for their best models, not for any risk mitigation reason, but for competitive reasons.

Also,

As recently as 200 years ago, 90% of people were farmers growing food to survive. Advances in technology have steadily freed much of humanity to focus less on subsistence and more on the pursuits we choose. At each step, people have used our newfound productivity to achieve more than was previously possible, pushing the frontiers of science and health, as well as spending more time on creativity, culture, relationships, and enjoying life.

Yea about that... Sure Mark can choose to just fly on his private Hawaiian Island, or is Tahoe bunker and mess around with metaverse and AI and whatever he chooses. 99.9% of the population has an old regular job that they go to for subsistence. Michael from north dakota has not been doing bookeeping for SMEs because this was always the pursuit of his dreams. I also see no reason at all to believe we spend more time on creativity, culture, relationships or enjoying life than before. Especially that last point is in free fall over the last 50 years by the look every single mental well being metric around.

[1] https://www.nytimes.com/2025/07/14/technology/meta-superinte...

simonsarris• 12 months ago

Here we go, predictably pulling the oldest trick in the book, just two weeks after it was reported [1] that the Superintelligence leadership was discussing moving to closed source for their best models, not for any risk mitigation reason, but for competitive reasons.

That's not pulling a trick, that's doing precisely what Zuck said he would do. In April 2024 Zuck on Dwarkesh said that models are a commodity right now, but if models became the biggest differentiator, that Meta would stop open sourcing them.

At the time he also said that the Model itself was probably not the most valuable part of an ultimate future product, but he was open to changing his mind on that too.

You can whine about that anyway, but he's not tricking anyone. He has always been frank about this!

sailingparrot2• 12 months ago

July 2024:

Open Source AI is the Path Forward.
Meta is committed to open source AI. I’ll outline why I believe open source is the best development stack for you, why open sourcing Llama is good for Meta, and why open source AI is good for the world and therefore a platform that will be around for the long term.
We need to control our own destiny and not get locked into a closed vendor.
We need to protect our data.
We want to invest in the ecosystem that’s going to be the standard for the long term.
There is an ongoing debate about the safety of open source AI models, and my view is that open source AI will be safer than the alternatives.
I think it will be better to live in a world where AI is widely deployed so that larger actors can check the power of smaller bad actors [...] As long as everyone has access to similar generations of models – which open source promotes – then governments and institutions with more compute resources will be able to check bad actors with less compute.
The bottom line is that open source AI represents the world’s best shot at harnessing this technology to create the greatest economic opportunity and security for everyone.
I hope you’ll join us on this journey to bring the benefits of AI to everyone in the world.
Mark Zuckerberg

Pulling the "Closed source for safety" card, once it makes economic sense for you, after having clearly outlined why you think open source is safer, and how you are "committed" to it "for the long term" and for the "good for the world", is mainly where my criticism is coming from. If he was upfront in the new blog post about closing source for competitive reason, I would still find it a distasteful bait and switch but much less so than trying to just put the safety sticker on it after having (correctly) trashed others for doing so.

https://about.fb.com/news/2024/07/open-source-ai-is-the-path...

insane_dreamer3• 12 months ago

spending more time on creativity, culture, relationships, and enjoying life

I wish this were true for the average person, but I'm not sure that it is.

aeon_ai• 12 months ago

I read Careless People recently.

I don't think the author of that book is unbiased, and after some healthy debate with friends, imagine there are a number of different perspectives on the facts. But it seems clear that, well before it was public knowledge outside of the company, there was clearly visibility of and ignorance over harms being caused by the platform inside of it.

Facebook (now Meta) turned human attention into a product. They optimized for engagement over wellbeing and knew that their platforms were amplifying division and did it anyway because the metrics looked good.

It's funny, because I aspire to many of the same things cited in this vision -- helping realize the best in each individual, giving them more freedom, and critically, helping them be wise in a world that very clearly would prefer them not to be.

But the vision is being pitched by the company that already knows too much about us and has consistently used that knowledge for extraction rather than empowerment.

DanHulton3• 12 months ago

The improvement is slow for now, but undeniable. Developing superintelligence is now in sight.

Oh, is it now? So you know for a fact that intelligence comes from token prediction, do you, Mark?

Look, multi-bit screwdrivers have been improving steadily as well. I've got one that stores all it's bits in the handle, and one with over three dozen bits in a handy carrying case! But they're never going to suddenly, magically become an ur-tool, capable of handling any task. They're just going to get better and better as screwdrivers.

(Well, they make a handy hammer in a pinch, but that's using them off-spec. The analogy probably fits here, too, though.)

My POINT, to be crystal clear, is that Mark is saying that A is getting better, so eventually it will turn into B. It's ludicrous on its face, and he deserves the ridicule he's getting in the comments here.

But I also want to go one step further and maybe turn the mirror around a bit. There's also an odd tendency here to do a very similar thing: to observe critical limitations that LLM tools have, that they have always have, and that are very likely baked into the technology and science powering these tools, and then to do the same thing as Mark, to just wave our hands, and say "But I'm sure they'll figure it out/fix it/perfect it soon."

I dunno, I don't see it. I think we're all holding incredible screwdrivers here, which are very impressive. Some people are using them to drive nails, which, okay, sure. But acting like a screwdriver will suddenly turn into precision calipers (and a saw, and a level, and...) if we just keep adding on more bits, I think that's just silly.

tim3335• 12 months ago

That's not really what he said.

cootsnuck• 12 months ago

Isn't it though? He's provided zero evidence to suggest otherwise. So of course we are all going to assume he's talking about the current, popular, SOTA architectures still as the foundational piece.

adrianbooth17• 12 months ago

Meta's business model requires:

- Maximum data extraction - Behavioral modification for profit - Attention capture and addiction maintenance

"Personal superintelligence" serves all three perfectly while appearing to do the opposite.

koakuma-chan• 12 months ago

Meta is yet to release a competitive model.

laweijfmvo2• 12 months ago

Meta has a lot of users (for better or worse). AFAIK they give away all the current “AI” features for free (via ads) like all of their products, right? That must take an enormous amount of compute to be able to offer all of their users the ability to generate AI Slop at any time… there’s no way they can continue to do that with anything close to a “super intelligence”, right? Do they have that much faith in ads?

akomtu• 12 months ago

If Meta invents superhuman AI and Mark gets to own it, we'll effectively enter the era of Antichrist. Imagine a human as greedy, as capable and as hollow as Mark, but made 1000x smarter than anyone else on the planet? Corporations are kept in check by competition between them, they can't be too abusive, but this brittle balance will end if one of them creates AI.

kelseyfrog• 12 months ago

If trends continue, then you'd expect people to spend less time in productivity software, and more time creating and connecting.

Sorry, but Jevon's Paradox[1] returns yet again.

If you make workers more efficient, then we won't be freed up to spend more time creating and connecting. There will be more work.

Creating more efficient steam engines didn't reduce coal consumption, it just made there be more steam engines. The second order effects of efficiency don 't work the way we think they work.

1. https://en.wikipedia.org/wiki/Jevons_paradox

Henchman21• 12 months ago

Meta has shown us that their goals are antithetical to healthy societies.

The company should be broken up, its assets auctioned, its IP destroyed.

polynomial• 12 months ago

What phase of the AOL lifecycle is Meta currently in? (Seriously asking.)

osti• 12 months ago

Looks like no more open source models :(

"We believe the benefits of superintelligence should be shared with the world as broadly as possible. That said, superintelligence will raise novel safety concerns. We'll need to be rigorous about mitigating these risks and careful about what we choose to open source. Still, we believe that building a free society requires that we aim to empower people as much as possible."

nashashmi• 12 months ago

Equipment and hardware being used to do basic stuff like farming, clothing, and housing can become weaponized to both drown local industry with efficiently produced varieties and as carrot and stick to force countries to comply with globalist ideals (that seek to consolidate power into the hands of a few).

sifar• 12 months ago

> an even more meaningful impact on our lives will likely come from everyone having a personal superintelligence that helps you achieve your goals, create what you want to see in the world, experience any adventure, be a better friend to those you care about, and grow to become the person you aspire to be.

What has intelligence (let alone superintelligence) or lack of, got to do with the last two. All these discussions about AGI seems to have reduced what it means to be a human being to a token generator.

amradio1989• 12 months ago

Makes you wonder who owns the data that powers a "personal superintelligence that intimately knows all the details about you".

It also makes you wonder what they do with all of that information. But surely this is altruism.

tim3335• 12 months ago

Just to take the other side of most of the comments here, I mostly agree with Zuck. Superintelligence is on it's way and we will probably all have access in the same way we call all access ChatGPT and the like. I'm not sure how the "intersection of technology and how people live" will go but it's not a bad thing to work on. I'm not sure Meta is the one do to it though - glad to have other people working on it too.

sandspar• 12 months ago

You can quibble about timelines and percentages and all that. But you gotta admit that this is a treat to watch. What a fun time to be alive.

pbrum• 12 months ago

What if superintelligence isn't even a thing? I was watching an interview with a Chinese-American specialist the other day (I'm sure it's been shared here on HN at some point) and she explained in the Chinese AI community they don't operate under the assumption that something such as AGI or superintelligence exists, and therefore don't work toward that goal. I'm sure people in this community can comment to a much more informed extent on this than I though

fzzzy• 12 months ago

Do we have narrow superintelligence in chess and go and jeopardy?

graphitez• 12 months ago

Superintelligence is not in sight. Zuckerberg is either lying or he is delusional.

insane_dreamer3• 12 months ago

What happened to the Metaverse?

Meta's Vision for Superintelligence

Related Stories