HNGlance

Top Best New Show

ChatGPT Survey: Performance on NLP Datasets

http://opensamizdat.com/posts/chatgpt_survey/

by empiko • 3 years ago

3 1 3 years ago

OP

opensamizdat.com

Related Stories

Loading related stories...

Comments

1

empiko• 3 years ago

Abstract: The popularity of ChatGPT and its various impressive capabilities lead some people to believe that it is a significant step forward for linguistic capabilities over existing systems, that the field of NLP will soon be consumed by generative language models, or even that it foreshadows AGI. To test these claims, I conducted a survey of the arXiv pre-prints that compare ChatGPT with other approaches, mainly with smaller fine-tuned models. ChatGPT’s performance is not as impressive as I expected, as it is often outperformed by significantly smaller models.

Source preview

opensamizdat.com

HNGlance

© 2024-2026 HN Glance. Story content belongs to its original sources.

Privacy
Terms