HNGlance

Top Best New Show

Real Signals or Artificial Stereotypes?

https://kucharski.substack.com/p/real-signals-or-artificial-stereotypes

by edent • 2 months ago

11 1 2 months ago

KU

kucharski.substack.com

Related Stories

Loading related stories...

Comments

1

internet_points• 2 months ago

I’d created 2000 free-text responses and labelled them ‘UK’. Then I copied and pasted the exact same 2000 responses but labelled these ‘US’. Finally, I combined them to create a dataset of 4000 total responses, and jumbled them up.
Despite the responses being identical for the UK and US, Copilot produced a rich, detailed summary of how US and UK respondents differed.

I'll bet there are lots of people trying to use llms to "discover" differences in datasets and just seeing whatever biases were in the base training data instead. Good that someone is out there showing how badly it can go, though I doubt the people who need to see it will :-/

Source preview

kucharski.substack.com

HNGlance

© 2024-2026 HN Glance. Story content belongs to its original sources.

Privacy
Terms