Gmail AI hallucinates, distorts email contents

https://www.t-online.de/digital/aktuelles/id_100811852/gmail-fantasiert-googles-mail-programm-verfaelscht-fremde-inhalte.html

by disentanglement • 1 year ago

31 8 1 year ago

t-online.de

ggm2• 1 year ago

I smell class action. The first time smart mail hallucinates something like an appointment cancellation or flight changes which leads to a real world loss, across a big enough surface of users, lawyers are going to be circling.

If this causes corporate loss, it's even more likely. GSuite is behind a lot of things.

croes• 1 year ago

I bet they have disclaimer in the ToS

pixelbash• 1 year ago

Wouldn't that turn out to be a candle in a hurricane situation given the level of risk involved?

maxbond• 1 year ago

I didn't find one about generative AI, but I suppose this is it:

    To the extent allowed by applicable law:
    - Google is liable only for its breaches of these terms or applicable service-specific additional terms
    - Google isn’t liable for:
      - loss of profits, revenues, business opportunities, goodwill, or anticipated savings
      - indirect or consequential losses
      - punitive damages

https://policies.google.com/terms (this is titled "Google Terms of Service" & is presumably broader but is what I got by going to Gmail and clicking "Terms".)

The terms may be different for corporate users.

ggm2• 1 year ago

Disclaimers are only as strong as the bank balance behind or defending the assault. Loss of custom typically follows a breakdown in trust as well. I suspect anyone seeking to fall back on ToS would find reasons to discuss matters round a table rather than test the strength at the bar.

I'm not a lawyer.

rvz• 1 year ago

So does "AI overviews".

I guarrantee you that you're now having to waste more time double checking even the sources hallucinated from these AI systems.

Gmail AI hallucinates, distorts email contents

Related Stories