AWS's (De)Generative AI Blunder

https://www.lastweekinaws.com/blog/aws-degenerative-ai-blunder/

by dlgeek • 3 years ago

29 13 3 years ago

lastweekinaws.com

QuinnyPig2• 3 years ago

Author here. I'm sorry; I can't stop giggling at the image captions. It's my favorite part of the piece.

shamiln• 3 years ago

unannounced upcoming region launches...

ericpauley• 3 years ago

The point on unannounced region launches seems to imply that Q is leaking information, but is there any evidence that this isn't just hallucinating?

QuinnyPig2• 3 years ago

No; it could easily go either way. The challenge is that an authoritative statement (y'know, most people don't assume that the marketing website is lying to them as a general rule) that a region launch is coming puts AWS themselves in a very uncomfortable position of having to either deny it, or remain silent and start getting inquiries from the region's governing bodies.

It's just a mess. I don't know for a fact whether it was lying or leaking.

HanClinto• 3 years ago

They are on point. Nicely done. :)

urbandw311er2• 3 years ago

I think your article makes plenty of valid points and was an interesting read. Given the number of times you pre-empt criticism, I suspect you’re aware you are being a little unfair on something that’s openly declared to be beta/preview. But equally you rightly observe that Amazon are pushing this as if it’s production ready!

wg0• 3 years ago

Late it might be, but lame it is not.

Amazon Q has been pretty useful for AWS console and I find it using more and more to clarify different ways to architect a solution. Most of the times, it can generate command line, API calls and IAM policies pretty okay.

Rest - all models are actually fakers, hallucinators. It's just that those hallucinations coincidentally mapping on to the reality.

No model even ChatGPT has any understanding of anything whatsoever, the fundamental building blocks and algorithms are all the same. Pretty much.

mdaniel3• 3 years ago

I'm glad you've had positive experiences with it -- mine have 100% been squarely in the same tone as TFA: it is UI intrusive and absolutely stunningly useless for the reasonable questions I've asked it

The example I have on-hand because we laughed about it in Slack is:

  > how much does a db.r7g.4xlarge cost per hour?

  Q: Visit the Amazon EC2 pricing page at https://aws.amazon.com/ec2/pricing/on-demand/ for current On-Demand pricing

geez, thanks, asshole; did you perhaps mean https://aws.amazon.com/rds/postgresql/pricing/?pg=pr&loc=3#O... [1] instead of just making up some shit? I voted its dumb answer down, and actually submitted an explanation in their textbox, which I'm sure will go into some training run of something and at next year's re:Invent they'll reinvent Amazon Q as Amazon Q Prime or such, now with more RLHF!11

1: or, of course, huge props to https://instances.vantage.sh/rds/ which gives the no-bullshit version unlike AWS's dog vomit pages

cebert• 3 years ago

I’m becoming convinced that using AI from a company that has any ulterior business incentives than providing AI services is a recipe for bias like this.

mdaniel3• 3 years ago

Be sure you don't overlook the linked post at the bottom of the page: https://www.lastweekinaws.com/blog/how-to-stop-feeding-awss-... (lightly discussed a few times last month, but I didn't see it go by)

urbandw311er2• 3 years ago

It periodically opens a giant chat window that obscures content.

Hard to ignore the irony of this complaint appearing on a site that itself obscured half the content with an enormous advert featuring a duck.

AWS's (De)Generative AI Blunder

Related Stories