HNGlance

Top Best New Show

Delving into "Delve"

https://pshapira.net/2024/03/31/delving-into-delve/

by perfunctory • 2 years ago

4 1 2 years ago

PS

Related Stories

Loading related stories...

Comments

1

joegibbs• 2 years ago

My own guess as to why GPT overuses delve is that it’s an artefact of RLHF. When you’re training a model to respond as a chatbot rather than the next most probable token you’ve people marking responses as good/bad. You’ve got some other criteria as well, like what sounds good.

What’s probably happened is that the “delve” responses sound better to the people doing RLHF, so they’re disproportionally included in the output.

It’s not just delve, there would be a whole list of overused words that you could find by comparing a large corpus of GPT output (or any LLM) to a large corpus of human-written text. You could use that as heuristic for an AI detector, only problem being that you’d need a different corpus for each LLM.

Source preview

pshapira.net

HNGlance

© 2024-2026 HN Glance. Story content belongs to its original sources.

Privacy
Terms