Google Search Is Now a Giant Hallucination

https://gizmodo.com/google-search-ai-overview-giant-hallucination-1851499031

by rntn • 2 years ago

197 128 2 years ago

jerojero• 2 years ago

Honestly it's becoming impossible to find information on the web.

A friend of mine wanted to find some lyrics and the lack of proper verbatim mode has made it impossible to know if he had the wrong lyrics or if the information is not there or if the search itself is failing.

If there are no matches whatsoever then tell me there's no matches. If there's partial matches tell me how close it is to my search terms. Like you might match all but one or two words and so on. These are the kind of useful features I'd expect on search.

The usefulness of AI, on my mind, might be more towards interpretation of the questions rather than generation of the answers.

If I were Google I'd try something like using genAI to rephrase the question to extract keywords and so on that can be used to enhance search. But then again, I think I put myself in a position of "how do we make search better and more accurate" and that's simply not the position Google finds themselves in.

leduyquang753• 2 years ago

Your friend can still enclose the phrases of the lyrics with double quotes to force an exact match on each of them.

cma• 2 years ago

Now with verbatim if you have a typo they no longer show the number of results up front so you often don't notice and only get sources with the same typo, furthering the impression that Google's results suck.

"Google hides search results count under tools section"

https://searchengineland.com/google-hides-search-results-cou...

the_snooze4• 2 years ago

Honestly it's becoming impossible to find information on the web.

It's because everyone is trying to sell you something, no matter how irrelevant it is to you. The cost of transmitting information at scale is effectively zero, and gen AI makes generating information at scale also zero. It's noise at scale crowding out the non-scalable things that are of actual value to humans. Something has to give.

flenserboy• 2 years ago

I don't think that's the only factor. There is a strong impetus toward obfuscation, both from the direction of a search engine (more clicks, more "interaction"), and from corporate & govt interests (the less people know, & know to be actually true, the better).

bambax2• 2 years ago

It's still possible on Google to use Tools > All Results > Verbatim, and it won't extrapolate and try to find exact matches to the query.

chubot• 2 years ago

Yeah the other day I was browing the NYC central park website - https://www.centralpark.com/

And I noticed my 2021 Macbook was unable to scroll to the bottom of the page. It was just chugging like crazy, and I couldn't see the content I wanted because of it.

Then I remembered I didn't install AdBlock on this browser. I installed it and went back to the page, and OK now I can actually use the website.

---

What concerns me is not so much that there are lots of low quality sites looking to scrape pennies from Google or whatever.

It's that this kind of software development culture is normalized -- where government agencies and hospitals are sending data to Google and Facebook.

I would be interested to hear from somebody who works in those areas what the incentives are.

If you are working on the central park website, why are you adding ads to it? Isn't it funded by the government?

Specifically I opened up dev tools and I see like 297 blocked requests to

https://securepubads.g.doubleclick.net

I see ads for Lowe's Hardware Memorial Day sales and such. OK fine, but why are they locking up my computer and making the site unusable?

(Also does anyone remember the days when Google was "morally" against invasive image ads and irrelevant ads? They preached non-invasive and relevant, helpful ads. Those days seem SO far away now ...)

fragmede• 2 years ago

https://www.google.com/search?q=%22jridhxjiej%22

gives no matches for me, what does it show for you?

spaceman_20203• 2 years ago

Google's results are now just plain baffling.

I live in India, haven't been to the US in 17 years, don't use a VPN.

Yet when I search for "St Petersburg Airport", it directs me to the airport for the city in Florida, and now the much older, much more densely populated, and much more culturally significant city in Russia (a city where I HAVE been once - and Google would likely know).

jasonjei3• 2 years ago

Google today feels nothing like the Google 24 years ago. It was magic and reliable and no nonsense.

I understand technology needs to change with gamification of SEO but I get so much frustration in my searching and often have to use Google in combination with site filtering keywords (e.g, site:stackoverflow.com). But it would be even more difficult to use if I didn’t even know what sites were trustworthy ``authorities.''

I just wish somebody would disrupt Google like Google did with search and email 2 decades ago. Searching on Alta Vista or Yahoo was a nightmare until Google came into our universe.

pmlnr• 2 years ago

It was magic and reliable and no nonsense.

The web was different as well.

jasonjei3• 2 years ago

I agree, but I remember when I was a university student I was easily able to search for answers for my queries. I was actually reliving some of my past and I tried to find the same info for a useful epiphany from many decades ago, and I couldn’t find it (even though the same engine gave me the answer decades ago)

the_snooze4• 2 years ago

The garbage web today is partially Google's own doing. They're the ones who created the incentives for websites to have cruft to satisfy the Google bot. They're the ones who capture all value from news outlets by aggregating and summarizing articles so people don't need to click on links.

Google isn't some dainty little startup. They're the dominant interface (search and browser!) through which most of the planet uses the internet.

agmater• 2 years ago

Another good operator to know now is `before:2023`

rjbwork• 2 years ago

Been using Kagi for a couple months. Seems pretty good to me.

al_borland• 2 years ago

Been using it for a year and I hope I never have to go back. It is so much better in every way. It’s amazing how many nice features can be added when there isn’t any worry about how it will impact ad revenue.

CaptainOfCoit3• 2 years ago

Same here, ~7 months with Kagi and replaced Google search 100% for me. Felt weird at first to pay for it, but after trialing it for a month or two, I now feel like I'm proud to pay for it, to ensure long-levity and sustainability. Best feature for me is probably the ability to rank domains up/down as I wish.

lolinder• 2 years ago

I have high hopes for Kagi precisely because they're not trying to disrupt Google. As long as they stick to their current niche, they can do things to filter out the nonsense and surface good content without ever running the risk that their algorithms become the game that every website must play to compete.

chrisweekly• 2 years ago

I got tired of poor search experience on Google and switched to DDG, used it by default for a couple years (resorting to !g maybe 10-20% of the time). But for the last 6? months with Kagi, it's literally 0 times I've even been tempted. Paying $5/mo to be a customer and not the product, having my privacy respected, and enjoying consistent access to excellent search results is IME equivalent to switching from browsing without an adblocker to using ublock plus, or trying reader mode for the first time. It's transformative.

graboid• 2 years ago

Yup, to anyone reading this, I want to second-recommend Kagi. Also super-customizable.

ziml77• 2 years ago

I started using it 2 years ago. In the first few months I would flip to Google when I wasn't getting results out of Kagi. However I now have enough experience with Kagi that I trust if a query returning nothing useful on Kagi then it wouldn't on Google either. I have no reason to ever return to using Google search.

ofrzeta2• 2 years ago

Sounds great, although it is not super cheap. Also interesting to note that they are creating the Orion browser (I recently downloaded on iOS).

ramenbytes• 2 years ago

Yet another vote for Kagi. When I was on the free plan it felt like a secret weapon that I pulled out for tough searches. Happy to pay for it now. Now, they do have a similar AI summary feature, but it actually links the sources it used to come to its answer so you can check its work. You can turn it off too. I've also found Kagi staff to be fairly quick about bug fixes, though I've only reported one bug.

mancerayder• 2 years ago

Google won because it was simple. Just type in the text box. Yahoo was a page full of junk and alta vista had a difficult to navigate search results. If I remember, it's been a while!

Google remains simple, but its output is corrupt.

marcosdumay• 2 years ago

Google won because it didn't fill your result pages with trashy unrelated answers on the hope to show you more ads.

There were plenty of engines where you could just type a query and they would list sites for you.

steve1977• 2 years ago

AltaVista was actually pretty good if you knew how to use its search operators. Google just enabled search for the masses so to speak. A bit like the iPhone of search engines.

bluGill2• 2 years ago

AltaVista was great until they quit running the crawler for a few months - I gave up when I searched something and the first 10 results were dead links. I'm told they got it running again just after I left, but I never looked back to see. (there is a lesson here)

bluGill2• 2 years ago

I'm not sure we can. In 2000 everyone had a homepage that they (poorly) maintained with links to places they found useful. This gave google a large set of data to mine for places that are useful and worth searching for. Not such things are not common and so google can't find the signal as easily. (people share links on social media but that isn't google searchable)

underlipton4• 2 years ago

You used to be able to see Twitter results in real time on Google. Facebook, too, early on, IIRC. Google could pay them to get access again, but... won't.

I suppose Google would have to somehow exit the personal data broker business to pull this off, too.

masfuerte• 2 years ago

According to this article [1] last month, Google deliberately made search results worse in 2019 because they get more ad revenue from the spammier sites.

[1] https://news.ycombinator.com/item?id=40133976

safety1st• 2 years ago

I joined Facebook pretty early on, back when you needed to have an email address issued by a university to join. My posts from back then are pretty wild, all very personal stuff and conversations with friends.

I logged in today, not a single mention of a friend in any way, shape or form on my feed. No posts from friends. No comments from friends. No "here's what your friend liked."

Half of the content wasn't even stuff I was following, it was posts that were "similar" to something I liked or to some group I was in.

It's amazing what a bait and switch these companies pulled. They really leaned into it. Google barely resembles a search engine now. Facebook is basically just a billboard.

ben_w• 2 years ago

I've noticed the same with Facebook. It's why I've stopped even bothering to log into the website.

the_snooze4• 2 years ago

Those in-the-know use private group chats as social media. No "useful" recommendations that tend towards selling you stuff. No trolls swooping in to derail conversations. No capricious design changes. Just simple human-scale interaction.

underlipton4• 2 years ago

It's immensely frustrating, as if you're of a certain age (I am), a non-trivial amount of your formative young adult relationship-building took place through Facebook. I remember having the prescience to lament that this wouldn't allow old relationships to fade away quietly, but instead, through the magic of social media, rot slowly. Joke's on me, it was that and worse.

Zuckerberg and co. muscled their way in and extracted value out of the dismantling of traditional social dynamics and cohesion, and left us with a hole where the scaffolding of youth should have been. Very Uber-esque. Actually, it describes any number of start-ups from the last 2 decades. Maybe "disruption" has a negative connotation for a reason.

joenot443• 2 years ago

I think we just grew up. When I joined Facebook as a teenager in 2008, we essentially had no filter. Every thought, every photo, every relationship update - all of it was immediately shared to Facebook because at the time it was fun and novel and innocent.

For better or worse, millennials have become much more discretionary in what they post online than they were 15 years ago. I imagine Facebook had organic content from your real friends to show you then it probably would, the well's just run dry.

mrtksn• 2 years ago

I actually remember the first time I begin struggling with Google results and it turned out that Google was simply switching to an answer machine instead of a search engine.

As a long time Google user, I was used to search for phrases that might be written in articles related to the stuff that I’m looking for. I had to switch my mental model on how Google works, so instead of typing what might have been written in an article about the stuff I’m looking for I had to type my question.

Maybe it’s time for another unlearning phase and learn how to use the LLM dominant Google? I’m not sure yet, LLMs seem too unpredictable.

jsheard2• 2 years ago

That deal they made with Reddit to use their comments as training data is paying dividends: https://x.com/Very__Regular/status/1794010853257126316

nimeetshah9• 2 years ago

This is not how you use Google or search though. All these examples seem like deliberate attempts to get weird/nonsense answers back.

kevingadd2• 2 years ago

The one I saw that recommended a dangerous mix of cleaning chemicals to clean a washer seemed pretty bad, I've performed that exact search before.

moralestapia• 2 years ago

Can you point me to the Google Operating Manual?

gspencley• 2 years ago

All these examples seem like deliberate attempts to get weird/nonsense answers back.

I'm not sure that I agree.

If a child hears a rumour, or sees some joke online, that claims that gasoline cooks spaghetti faster they may search to find out if it's legit.

During Obama's term, there was a right wing conspiracy theory that gained popularity that claimed that Obama was Muslim. Someone coming across that conspiracy theory years after the fact, completely devoid of any context (ex: a pre-teen who wasn't even alive yet during Obama's term), might do a search to find out if it's true.

There WAS an NPR article that cited a study claiming that parachutes are no more effective than regular backpacks. AI results have not been enabled for my Google account yet, and currently if you search for "are parachutes effective?" you get a feature snippet that clips that article and links to it. Now take that link, with all of its context, out of the picture and imagine that someone hears that claim casually and wants to search to see if it's true. Currently, in MY search results, you get the link to the NPR article that not only explains where the claim comes from but gives you the full context with all of the "gotchas." It sounds like with Google AI the first thing you get is a definitive, authoritative claim that no, parachutes are not effective at saving your lives and you might as well jump out of an air plane with your carry-on pack-back on.

aldousd666• 2 years ago

that's openAI, not google

jsheard2• 2 years ago

https://www.theverge.com/2024/2/22/24080165/google-reddit-ai...

stevebmark• 2 years ago

Whoever at Google thought this was a good idea should no longer be involved in search! Reddit is a terrible source of information, it's all confirmation bias and unqualified people giving advice upvoted by unqualified people to vet it. It's worse than Yahoo Answers because it looks more trustworthy on the surface but has worse quality of information.

berniedurfee3• 2 years ago

That describes the whole internet. It was never meant to be anything more, so that's what we got.

Which was fine, until we had the bright idea of feeding it all into a neural network as a collection of facts.

Then we gave that neural network a voice and a personality. It spoke with the utmost confidence as the expert on any subject.

Truth, lies, facts and falsehoods all blended together and regurgited in an infinite stream of babble.

I vacillate between LLMs being an interesting fad with limited usefulness and an apocalypse that'll throw the world into chaos. I'm back on the fence again I suppose, leaning towards the latter.

busymom02• 2 years ago

"google execs hearing the feedback that 'adding reddit to the end of every search is the only way to get information that you need' and immediately destroying their business trying to automate that"

dpflan2• 2 years ago

OpenAI is excited about their deal with Reddit too, it's a game of one-upmanship in the current AI hype cycle. It also makes Reddit seem very valuable for the AI arms race, could influence its stock price, and there are certain stock holders who are benefiting greatly if this does increase the price.

partiallypro• 2 years ago

I just saw an interview with Sundar Pichai and someone showing him the mobile Google search results and how bad they are. It was pretty embarrassing. It's like he doesn't even use his own product. https://youtu.be/lqikP9X9-ws?si=0NAJX5GhzXfhP1t0&t=1524

Also discussed AI junk and how it is crowding out real content. https://youtu.be/lqikP9X9-ws?si=HknLDI_yaByLoqRO&t=1310

Also, Google eating other sites/putting them out of business https://youtu.be/lqikP9X9-ws?si=IXm5MrAj7glGsLC2&t=452

Overall a good interview.

shombaboor• 2 years ago

It's funny (as in not funny) google is blaming the users for uncommon or unusual queries.

JetSpiegel• 2 years ago

It's like he doesn't even use his own product

Why would he? He has an army of slaves to do his bidding, why would he settle for a crappier version of that?

ancien• 2 years ago

Still I like Google, more than bing (copilot) or perplexity! I couldn't be where I am now without google

insane_dreamer2• 2 years ago

Example from a few days ago, the first time I decided to use the AI Google Search: I Googled for how to reset the time on my Nixon Ripley watch (I forget the exact search term I used). Google "AI" helpfully brought up a list of instructions, prefaced with a helpful "to reset the time on a Nixon Ripley watch ..." But the instructions referred to a mode that's not on this watch, which was suspicious. It helpfully included a link to a website with a set of instructions that looked like what the AI had generated. Except that the website didn't reference the Nixon at all, but some other watches (Casio gShock, I think), and so the instructions of course didn't work.

So I went back to the "old fashioned" way of searching the links for the actual Nixon website, finding the watch manual, with the correct steps.

pimlottc• 2 years ago

That seems pretty par for the course with Google these days. “Hmm, you want to know something about a specific watch? Well, I know something else about watches!”

busymom02• 2 years ago

It seems like LLM is good at broad and generic things but fail miserably at precision. And instead of admitting it doesn't know something, it confidently responds with nonsensical answers.

berniedurfee3• 2 years ago

My favorite part of Copilot is when it auto-completes a call to a function that does exactly what I need to do, like magic!

Except that function doesn't exist and never did.

LLMs don't know what they don't know, so they just make something up because they have to say something. The danger is that most people don't understand that's how they work and don't known when to call BS.

This is where I think companies have a responsibility. To ensure that _every_ response has a disclaimer that the answer from their AI could be right or completely wrong and it's up to the user to figure that out, because AI can't at the moment.

mensetmanusman• 2 years ago

The end of the internet came sooner than expected. I wonder how long it took on alpha centurion.

It’s not obvious ‘attention is all you need’ would have been a public disclosure by a corporation in parallel worlds. Usually such inventions are buried.

duringmath3• 2 years ago

It's not even hallucinating it's just correctly summarizing the wrong thing.

Also we're only talking about a handful of examples out of billions of queries, that doesn't stop the usual media hyperventilating though.

kevingadd2• 2 years ago

It only takes a reply to a handful of queries to get a handful of people actually hurt by telling them to do something dangerous.

The average person doesn't necessarily have the media and AI literacy to know not to trust papa google's answer at the top of the result page.

duringmath3• 2 years ago

Despite some evidence to the contrary I believe most people aren't that stupid and the "average person" isn't actually typing in these queries, these are marginal cases played out for meme value.

agilob• 2 years ago

I stopped using google search a few years ago, for 95% of the time I use DDG (and then sometimes I do a fallback !g), but as it was down yesterday (thanks to Microsoft) I had to use GS a few times. Never before I had to add `-phrase` so often to eliminate results I didn't want to see. I was looking for some podman tips and had to keep adding -kubernetes and -openshift to every single query. It really just showed me how much worse GS became since I left it, but also no regrets.

routerl• 2 years ago

Never before I had to add `-phrase` so often to eliminate results I didn't want

Remember when Google broke boolean search operators because they wanted "Google+" to come up first?

They've been making unspeakably bad decisions about search for a looong time, at this point.

dang• 2 years ago

Recent and related:

Google AI recommends adding Elmer's glue to pizza cheese after scanning Reddit - https://news.ycombinator.com/item?id=40448074 - May 2024 (122 comments)

jpmattia• 2 years ago

My favorite so far: https://mastodon.social/@JoeUchill/112493317168967705

Can I use gasoline to cook spaghetti faster?

JJMcJ• 2 years ago

I laughed but I can imagine circumstances where errors of this magnitude could cause serious problems.

spaceman_20203• 2 years ago

Absolutely ironic that Google for years penalized websites that didn't have all that good "authority" when it came to topics like health and finance ('Your Money or Your Life' - YMYL), and now it ranks its own seriously harmful results right at the top of the page.

nickpsecurity2• 2 years ago

It’s disturbing how many of these either see humans as worth destroying, could harm us, or would kill us.

Getting this AI to Skynet’s morality probably just takes one, fine-tuning run.

SoKamil2• 2 years ago

If you want to get rid off that, try https://udm14.com/. It will redirect you to tab "Web" which Google secretly added[0] pretty recently. It will show you only text-based links.

You can also edit your browser search settings to add this parameter &udm=14 to query automatically.

[0] https://x.com/searchliaison/status/1790473952256786805

bambax2• 2 years ago

“The thing with Search — we handle billions of queries,” Google CEO Sundar Pichai told The Verge on Monday when asked about the AI overview rollout. “You can absolutely find a query and hand it to me and say, ‘Could we have done better on that query?’ Yes, for sure. But in many cases, part of what is making people respond positively to AI Overviews is that the summary we are providing clearly adds value and helps them look at things they may not have otherwise thought about.”

That's a really weird and risky way of putting it.

There is a huge difference between being a search engine that finds (external) pages, and coming up with answers in your own name. If some page on the Internet says Obama is a Muslim, who cares, it's not important. But if Google says that Obama is in fact a Muslim, suddenly it's a very big deal. And that's true for every query, on every topic imaginable.

Every answer they get wrong attacks their image a little, and out of billions of queries it's inevitable they will get many wrong.

This forced, radical change motivated only by fear feels like Google+ all over again. Or New Coke.

throwitaway222• 2 years ago

It is highly unlikely it will say that, there's 10000x more articles on the fact that he isn't, and more specifically, the LLM would be "aware" (aware in this sense in that it would have possible next words with high rank) that there is a specific controversy over this.

It's the long tail and new stuff that it will get wrong.

trehalose• 2 years ago

Google saying Obama is Muslim is not a hypothetical. It did say that.

awkwardpotato• 2 years ago

It is highly unlikely it will say that, there's 10000x more articles on the fact that he isn't

Except this was an actual response that it was giving. Tweet from a related HN thread ~yesterday on Google search hallucinations: https://x.com/TVietor08/status/1793768913245020502

nerdjon3• 2 years ago

It’s such a flawed and dangerous perspective.

It’s one thing for the search results to bubble up a wrong result. You go to it, and then you go back and look at more results to get a more complete picture. See where those different sites disagree and where they agree.

But these AI results don’t do that. They are providing a single answer and confidently trying to come off as that is the answer. No fuzziness about its reliability.

Every time it is right, it slowly could be deemed as reliable to a general population until it is dangerously wrong. But then you don’t question it since it was right so many other times.

CaptainOfCoit3• 2 years ago

You go to it, and then you go back and look at more results to get a more complete picture. See where those different sites disagree and where they agree.

Me and others I know follow this workflow when we try to find out the answer to some question we don't know the answer to.

But the vast majority of people outside of my own personal friend circle don't seem to approach it like this. Their approach looks more like:

1. Search for thing

2. Read the first info-box that pops up, if it does. That's what they think is 100% the correct information. If no info-box:

3. Read the short description for the first link that appears (sometimes an ad) and take that as the correct answer.

Ideally, people would be more careful, but I haven't seen that in practice.

rurp• 2 years ago

Right, the domain itself is a huge signal. Information can have a very different meaning and trustworthiness if appears on the blog of a known expert vs the NYT vs some spam site like Quora. Google wants the only context to be Google. Even if the AI results are as good as organic ones, which is not a terribly high bar these days, it will be much less useful and trustworthy because nobody knows the provenance of the information.

It's really unfortunate that Google is going to torch so much of the open internet in order to shovel this nonsense onto people. Of course as organic search traffic dries up and reduces new high quality content, and AI slop floods the internet, the GenAI results will get even worse.

disqard• 2 years ago

Excellent point! Shah and Bender have explicitly called this out:

Contrast this with posing the query as a question to a dialogue agent and receiving a single answer, possibly synthesized from multiple sources, and presented from a disembodied voice that seems to have both the supposed objectivity of not being a person (despite all the data it is working with coming from people) and access to “all the world's knowledge”

[0] https://dl.acm.org/doi/fullHtml/10.1145/3498366.3505816

Hasu• 2 years ago

This forced, radical change motivated only by fear feels like Google+ all over again. Or New Coke.

A year ago everyone was trashing Google for being ahead for years on the science of AI, but completely failing to productize it. "OpenAI is going to eat Google's search business for lunch", was the prevailing narrative. This is what people said they wanted!

I'm sure it's clear to everyone now[0] that genAI is not a search solution, and Google's former approach of quietly putting AI into phones and products without it being flashy and in-your-face was actually a better strategy.

[0] Just kidding, I'm certain that the industry and especially the people running Google will learn all the wrong lessons from this.

CaptainOfCoit3• 2 years ago

A year ago everyone was trashing Google for being ahead for years on the science of AI, but completely failing to productize it. "OpenAI is going to eat Google's search business for lunch", was the prevailing narrative. This is what people said they wanted!

People say a lot of shit. Doesn't mean you should put your poorly performing Q&A AI to provide people with outright false answers, I'm pretty sure no one asked for that.

After all, Google is running their own products, and when they make shitty choices, I think it's perfectly fair to question how they can make so bad decisions, no matter if I personally might have said "Google is failing to productize LLMs properly" or whatever.

TylerLives• 2 years ago

Idk, Perplexity sometimes gives me very good results compared to Google. Their AI also provides links to where the information is coming from.

meiraleal• 2 years ago

"OpenAI is going to eat Google's search business for lunch", was the prevailing narrative. This is what people said they wanted

One thing isn't related to the other. Actually most people noticing OpenAI/LLMs gonna displace Google enjoy the idea. Nobody is asking Google to give LLM results.

renegade-otter• 2 years ago

The problem is that Google effectively destroyed its classic search and is playing catch-up with AI. AI is the only lunch out there to be had in the first place. There is nothing else.

lithos• 2 years ago

All the meme-y wrong answers Google's AI is giving is really making them look like IBM. (Too large to die no matter how badly they fall behind).

Some of the answers are insanely gross like recommendations to jump off the golden state bridge for depression.

just_sayin1• 2 years ago

That turned out to be a doctored photo, someone had just changed the script to make a fake answer

QuantumGood• 2 years ago

Large organizations expect to cause some harm as a "tax" built into the system; they are not very harm avoidant, they are more psychopathic (and often led by psychopaths). So new tech is used without much concern about creating harms.

Sure, LLMs do amazing things, but so did all the previous once-disruptive technologies later widely adopted. Electricity, flight, nuclear energy, transistors and integrated circuits, the internet; AI is joining a very competitive list.

We've just never seen a disruptive technology with this much media buzz behind it so quickly, and such rapid technological advances. Disruptive technologies are never "ready for prime time" ... until they are.

Kye• 2 years ago

The Google+ comparison is apt: a product rushed out in response to a perceived threat, on which the entire company is aligned and bet, with no regard for how that full-power triangulated focus killed whatever potential it had, if any. They flipped from missing the boat on transformers, a thing they created, to playing catchup on something that's probably mostly fad.

It's like they decided to speed run the trust thermocline they were already in. We're a long way from this Yahoo killer making the rounds on AOL chats and IM.

1vuio0pswjnm7• 2 years ago

"Or New Coke."

With New Coke, the public reaction was negative.

In The Verge interview and elsewhere, Google claims the reaction to the current Google is positive.^1

No need for "Google Classic".

1. It's unlcear how Google concludes that people are happy with Google Search. It does not ask them.

duhast2020• 2 years ago

Google Opinion Rewards. It definitely asks them.

yndoendo• 2 years ago

Section 230 of the Communications Decency Act currently protects Google, and others, when they link to other html posts within their search results. Wouldn't it become ineffective with AI acting as a publisher? Wouldn't false statements about individuals be liable and open them up to lawsuits? For example, AI making the statement some is a pedophile through hallucinations versus actual court outcomes.

cdme• 2 years ago

It went from search to making up utterly unusable dreck. It's not helpful, it's machine-generated nonsense that's more expensive to operate than search.

snorremd2• 2 years ago

And this is why I subscribe to Kagi. They also have AI based summary, but you have to invoke it manually on a specific search result (in which case you know where the info is coming from).

I feel like we're on a race to the bottom. All of Silicon Valley and beyond have big FOMO on the AI hype train and any and all use of AI pleases investors. I guess we'll see how it all pans out in a few years.

One thing is for sure, generative AI and LLMs open up a whole can of worms in terms of disinformation and information noise on the Internet. The signal to noise ratio will greatly shift with these new initiatives.

spaceman_20203• 2 years ago

Kagi is just too expensive for non US folks. The family plan costs more than my family's monthly wifi, netflix, and phone bills combined.

snorremd2• 2 years ago

I can empathize with this. If not for my decent salary by European standards, I’m not sure I would prioritize paying for search when there are free options available.

It would be nice if more services used purchasing parity based pricing so more people could benefit.

dingaling• 2 years ago

It also stings that I can't pay by PayPal, so not only would I have to pay the currency exchange margin to US Dollars but my bank also changes an out-of-currency fee.

I understand that they're probably focusing on US market growth first, but the UK and EU surely have potential too.

robotnikman• 2 years ago

Saw this post on reddit today where google recommended jumping off the golden gate bridge

https://www.reddit.com/r/ChatGPT/comments/1czif9o/willing_to...

SoKamil2• 2 years ago

This is fake.

https://x.com/NorthstarBrain/status/1793977912942575772?t=Mo...

otterley• 2 years ago

It's fake. https://x.com/NorthstarBrain/status/1793977912942575772?t=Mo...

silverquiet• 2 years ago

It occurs to me that I don't know who Alex Northstar is; he could quite simply be an AI creation as well. I now understand why the greybeard dream is to move to an off-grid cabin.

exitb• 2 years ago

Reads like the Golden Gate Claude.

cortesoft• 2 years ago

I am not as worried about these sorts of ludicrous results as I am the ones that are close enough to correct to be believable. That is where you will get in trouble.

I have a similar experience using GitHub Copilot… it usually gets it right, which is great, and sometimes gets it really wrong, in which case I don’t use the suggestion and move on with my work.

However, every now and then it will give me a result that really looks correct, but is wrong in some minor way, and I end up getting burned because it takes me way too long to realize where the error is.

squarepizza• 2 years ago

The uncanny valley of generated software: utility is inversely proportional to distance from the correct answer, with a huge drop into the dangerously believable.

Aloisius• 2 years ago

I'm not sure how this won't get worse.

It seems inevitable that LLMs will be training on more and more data generated by other LLMs creating a hallucination feedback loop.

berniedurfee3• 2 years ago

Recursive garbage in, garbage out.

arnklint• 2 years ago

Google is imploding under AI

dpflan2• 2 years ago

No wonder these models weren't getting production attention and commercialized when they were invented...

ChrisArchitect• 2 years ago

[dupe]

More discussion: https://news.ycombinator.com/item?id=40448074

https://news.ycombinator.com/item?id=40461580

jayd16• 2 years ago

They could really just present it as what it is, a _search result_ summary, not an answer summary. Its not like searching for satirical comments should go away. As its presented now it feels very flawed but it doesn't need to be.

ofrzeta2• 2 years ago

FWIW those pull-out answers always were dubious. For instance Google has pulled out answers out of forum threads that were plain wrong, even the original poster conceded that in the thread later but Google just didn't get it.

Optimal_Persona• 2 years ago

I have been struggling to arrange lawn care for an out-of-state relative while they're incapacitated. While Google search populated some tables in its search results with a bunch of lawn care companies saying the address was in their service area, each and every company I contacted said it was not and asked where I got the info.

Visiting each company's site showed they didn't serve this town/address so it's really not clear how/why Google returned those results. In some cases the address was 20 miles from the nearest town served. Whether or not due to AI hallucination, or just general Googlenshittification - not a good result.

nojvek• 2 years ago

For all the halballoo about AI safety and laws, Google released it knowing very well about the hallucination.

Also it’s so prominent that you can’t even turn it off.

How is Google making money on this? It takes so much space, the ads are pushed down even further.

delduca• 2 years ago

I'm surprised Google hasn't put AI on YouTube: "Feeling a bit down? Here, have some depressive suicidal black metal."

Google Search Is Now a Giant Hallucination

Related Stories