LLemdashes

by birdculture • 2 months ago

4 1 2 months ago

fallpeak• 2 months ago

This phenomenon (and/or the fear of being falsely accused) is why I find myself being an annoying unpaid evangelist for Pangram every few days.

Right now a lot of people are developing their own heuristics, some much more well-calibrated than others, for sniffing out AI generated text but it's kind of an unfalsifiable accusation since you're really just saying "this sounds like slop, I can tell from the words and from seeing lots of slop in my time".

Linking to an AI writing detector serves as a somewhat objective second opinion, but half the time if I say "Pangram confirmed it" I'll see at least one person pulling the old "yeah but GPTZero is crap so that means AI writing detection can't work in principle" maneuver, which strikes me a lot like someone who tried ChatGPT in 2023, decided AI was all hype, and never re-evaluated that stance.

It would be really helpful for the discourse if we could get to a point where people generally accept one or more _actually-good_ LLM writing detectors as a reliable tool such that a "this is AI" judgement from them is accepted as reasonable proof of guilt, solely so that we can then extend the benefit of the doubt to anybody else.

LLemdashes

Related Stories