HNGlance

Top Best New Show

Why do LLMs fail at the basic visual tests

https://twitter.com/ai_for_success/status/1913262025956098343

by chaitimes • 1 year ago

1 2 1 year ago

TW

Related Stories

Loading related stories...

Comments

2

chaitimes• 1 year ago

I would assume there's enough training data now to extrapolate from the visuals the answers to these basic tests. Why do they fail miserably on such trivial questions while appearing to perform very well on complicated tests like 3d object generation

yorwba• 1 year ago

There are unlikely to be many six-fingered hands in the training data. So there's little reason for the model to develop the ability to recognize one when it encounters it. Maybe the result improves if you break the task down into two steps of listing the bounding boxes of all fingers in the image and then counting the number of bounding boxes.

Source preview

twitter.com

HNGlance

© 2024-2026 HN Glance. Story content belongs to its original sources.

Privacy
Terms