Baidu CEO: AI 'bubble' will burst 99 percent of players

https://www.theregister.com/2024/10/20/asia_tech_news_roundup/

by teleforce • 2 years ago

52 48 2 years ago

more_corn• 2 years ago

My bet is on unverified AI going the way of the dodo. I’m sorta sick of hallucinated nonsense. I also don’t see a business use case for a lot of “cool” ai products.

underseacables• 2 years ago

I don't know, remember the controversy over the wildly inaccurate historical AI images? That could serve some satirical products.

mc32• 2 years ago

Weren't the majority of those induced by manipulated politics rather than it being a base characteristic of the technology?

rodgerd• 2 years ago

In my optimistic moments, I think that.

In my realistic moments I think that we will rewrite medical law, banking law, and privacy law and so on to accomodate the shitty AI children of billionaires. Misdiagnosed by "AI"? Too bad. Lose a job because of AI? Too bad. Sentenced to death by an AI-powered criminal investigation? Too bad.

dboreham• 2 years ago

I don't know if you're familiar with how LLMs work, but after diving a bit into that space, I'm a "realistic enthusiast" after a lifetime as a deep skeptic. For me it's like the beginning of the internet (yes...old). It's clear there's something profoundly different and potentially enormously useful going on. Exactly how it will end up being used and who will make money from it is unclear. We know from experience that those questions ended up having answers different than we anticipated with the internet and I'd expect the same to happen with AI.

rossjudson• 2 years ago

The parent post is very orthogonal to yours. That isn't saying that LLMs won't be useful -- it's saying that unverified LLMs are of limited value.

This rings true. There's a low economic value for performing activities when it doesn't matter if the output is true or accurate.

Unverified LLMs can generated unlimited output that cannot be trusted; this is output that can approximate truth at times.

I suppose the long term question is whether the approximation is sufficient for value-generating purposes. It clearly is sufficient in cases where it outperforms the status quo (example: summarizing customer feedback).

monero-xmr• 2 years ago

But YC just funded hundreds of AI companies. This would mean the world’s smartest investors are wrong. This is, frankly, impossible.

IAmGraydon2• 2 years ago

I'll have to assume you don't understand how tech investing works. Give a dollar to 100 companies and you've spent $100. 99% fail, but one ends up returning $1,000 and you've 10x'ed.

candiddevmike• 2 years ago

Why would it be 10x in this example? Isn't it 1000x? Or 900x if you remove the initial investment?

Do 1/100 companies really experience that kind of windfall?

conductr• 2 years ago

Even if these younger vintage batches fail completely, the existing portfolio will benefit from AI being hyped.

jrflowers• 2 years ago

What if they aren’t the world’s smartest investors

myprotegeai• 2 years ago

Case in point https://x.com/paulg/status/1845936708488970606

red-iron-pine4• 2 years ago

what if they're just rich guys who got lucky, and at the right time, and now have more money than they know what to do with?

nitwit005• 2 years ago

If you asked, I'm sure they'd admit it is a gamble. The world's best gambler is still gambling.

evilfred• 2 years ago

very amused at this obvious sarcasm getting grey-texted

red-iron-pine4• 2 years ago

you're assuming people don't get that it's sarcasm, and are downvoting it because lazy sarcasm doesn't add anything to the discussion.

vdfs• 2 years ago

90% is the startup fail rate even before AI

dmix2• 2 years ago

After around 7yrs of company life it's about 90%

Doesnt mean they won't make money in the prior years then still shutdown by the 7th year because markets change or competitors beat you

sfmz• 2 years ago

It takes so much money to be a player in this space; the ante went from ~$100k (GOOG, FB) to like $4B or 100k H100s. That's how I arrive at the statement as 99% don't have the cash.

dmix2• 2 years ago

There's a lot of people making AI companies outside LLM model development

hn_throwaway_992• 2 years ago

There are, but then the question really becomes "what is the moat"? I.e. lots of these companies are essentially just providing wrappers around the best models coupled with some type of RAG approach.

FWIW, I believe there is a defendable moat for the players that have really good UI and are really focused on end-user solutions. E.g. I pay for Cursor.sh because I believe it is an easy net win for my productivity. But I do really wonder if these "AI application" companies can support their lofty valuations. I feel like most of them will have limited pricing power because if they try to price too high it's easy for someone to say "OK, we'll just go to a competitor, or even pull it in house."

n_ary3• 2 years ago

The barrier to entry has always been the winning factor for lot of rapid growth businesses. In previous era, it was ability to afford massive cloud infra and army of expensive SWE to build global scale distributed systems. AirBnB, Uber, Lyft, Stripe, Paypal, Google, Netflix and all the “internet” tech had many competitors but only these could afford the cloud scale growth and overtake the market.

In LLM era, it is the compute cost of the hardware that is differentiating the barrier to entry for winners and anything that do not have massive budget for both training and marketing are never heard of unless they are in self-hype narrow field(Cursor).

It is also sad that, AI is hyped to progress environmental and medical research and there were some impressive feats, but all the hype and money is literally going to chatbot shops, hence marketing budget is also another barrier to entry.

kjellsbells• 2 years ago

I'm wondering if we are now in the Low Background Steel transition, as far as Internet content goes. I already see material on the open Internet that has very obviously been generated by AI. As the next round of Common Crawl or whatever is slurped in for training, AI ends up eating its own output. Does the quality of the material degrade at that point? Maybe we'll end up searching for an Internet that existed before AI started rewriting it.

https://en.wikipedia.org/wiki/Low-background_steel?wprov=sfl...

etrautmann• 2 years ago

Yes - this insight has been repeatedly discovered by many, but remains a great analogy.

klipt• 2 years ago

There are two main types of data for training intelligences (natural or artificial):

1. Self play

2. Data left behind by other intelligences' self play.

The Internet is 2, but is generated by the self play of humans - who were themselves trained on the self play of previous humans.

That's how civilization is bootstrapped.

Once you have bootstrapped sufficiently smart AI, they can possibly bootstrap themselves further on their own self play, instead of continuing to rely on human self play data.

dinfinity• 2 years ago

Training data is preprocessed, you know. I don't understand why everybody making this argument ignores that.

It's not as if the internet before LLMs did not have tons of trash content (which also includes things written by humans who sincerely think they're right, but that is factually incorrect). Of course the input data is preprocessed and curated/weighted. Of course newer training data will also be curated.

Think for a second about what you said: "I already see material on the open Internet that has very obviously been generated by AI." Why would any AI company worth its salt _not_ ignore such data?

n_ary3• 2 years ago

With the AI progress, we will probably finally see a slowing down of the “js framework of the month” and other rapidly changing things.

To a bunch of very junior devs using LLMs to generate code and build something, speed is now main factor, it is irrelevant whether the new Airbnb prototype or even prod version was being generated in Svelte 3 as long as it works.

The fine tuning and fixing up happens later on “if needed” basis.

Similar apply for similar knowledge where AI is also being utilized in similar manner. A slightly outdated info is sufficient for the task.

Also, internet will continue ti have decent content as there will always be passionate people who want to build and share knowledge, then there is the need to advertise your knowledge(consultant/freelancer) who still need to generate content in decent quality to be discovered.

The maximum slop will be in sales/marketing/social media sphere where content quality is irrelevant and more clicks/engagement brings profit.

Anything else will be continuously get locked behind paywall, so either exclusive contracts with AI companies to supply training data and sell on open market with strong copyright or drm to general consumers.

xk_id• 2 years ago

Can’t believe people still treat this kind of messaging about AI as expert opinion and not as advertising in its purest form. I guess those are the same people who see something profoundly meaningful in machine generated strings.

hn_throwaway_992• 2 years ago

Getting beyond the title, which I definitely agree with (https://news.ycombinator.com/item?id=41896346), there was this nugget about hallucinations:

I think over the past 18 months, that problem has pretty much been solved – meaning when you talk to a chatbot, a frontier model-based chatbot, you can basically trust the answer

Can't decide if he actually believes this, or he's just spewing his own hype. While I definitely agree the best models have reduced hallucinations, going from, say, 3% hallucinations to .7% hallucinations doesn't really improve the situation much for me, because I still need to double check and verify the answers. Plus, I've found that models tend to hallucinate in these "tricky" situations where I'm most likely to want to ask AI in the first place.

For example, my taxes were more of a clusterfuck than usual this year, and so I was asking ChatGPT to clarify something for me, which was whether the "ordinary dividends" number reported on your 1040 and 1099s is a superset of "qualified dividends" (that is, whether the qualified dividends number is included in the ordinary dividends number), or if they were independent values. The correct answer is that the ordinary dividends number (3b on the 1040) does include qualified dividends (the 3a number), but ChatGPT originally gave me the wrong answer. Only when I dug further and asked ChatGPT to clarify did I get the typical "My mistake, you're right, it is a superset!" response from ChatGPT.

Anybody who says that LLM output doesn't need to be verified is either willfully bullshitting, or they're just not asking questions beyond the basics.

n_ary3• 2 years ago

In your case, you ask but then verify. Most people(i.e. IRL people outside tech circle) just want to get things done and believe anything, which is why the “Best top 5/10/20 Y in 20xx” articles work or the top advert gets many hits on google, or social media misinformation spreads and works.

Before AI, people used to “google” things and vehemently believe and support the whatever content that were first and second on their search result, which is why google probably replaced all above the fold results with ad/sponsored and businesses throw plenty money and SEO to be the top.

maeil• 2 years ago

I think over the past 18 months, that problem has pretty much been solved – meaning when you talk to a chatbot, a frontier model-based chatbot, you can basically trust the answer

Yes, I'm sure if we ask a question about The Party to your (Baidu) model, we can trust the answer.

wkat4242• 2 years ago

Hallucinations exist because people are using LLMs as knowledge oracles which they are not. I doubt it'll ever be solved unless a new type of model is invented for this.

anonzzzies4• 2 years ago

With current models it cannot be solved. Maybe it cannot be solved at all; humans lie/make up things (as in; they might not know they are telling a non truth) all the time and that's the best example of intelligence we have.

anonzzzies4• 2 years ago

He thinks you can trust the answers of chatbots? That is disturbing. Sure I use them all the time, but only for coding ; code I can review and verify after ; many other things are either a lot harder or impossible and I know it really does make up stuff with Confidence, so I do not even try. This guy must know that is how it is as CEO of this massive company?

lostmsu• 2 years ago

Ironically, you can't trust code of junior developers in exactly the same way.

Gigachad• 2 years ago

At least the junior devs run the code before submitting it for review.

anonzzzies4• 2 years ago

Not of many 'seniors' either; most people are just terrible and lazy. Also, see the article yesterday about the deflation of developer titles. Everyone here basically agreed the titles are nonsenses, so how does junior mean anything suddenly? Junior vs what?

red-iron-pine4• 2 years ago

jr devs will tell you when they're not sure, or can ask for help.

GPT will dead-ass spew wrong answers right at you and sound 100% confident about it. when you correct it, it will do the exact same thing the next day when you try with a different account.

v3ss0n• 2 years ago

When did hallucinations were gone? Which model?

siliconpotato• 2 years ago

probably an incorrect perception about internal/private models which haven't had rigorous testing by the public. but on the other hand i do think that there's quite a few companies with more advanced models than the commonly known public ones but they are just keeping them secret.

Baidu CEO: AI 'bubble' will burst 99 percent of players

Related Stories