HNGlance

Top Best New Show

Stupid Filter Corpus (2007)

https://huggingface.co/datasets/mofosyne/stupidfilter

by mofosyne • 2 years ago

1 1 2 years ago

HU

Related Stories

Loading related stories...

Comments

1

mofosyne• 2 years ago

I wonder if anyone remembers the stupid filter project around 2007.

There was an attempt to filter out stupid comments in social media using a vector filter as a plugin for wordpress initially. Project somewhat fell though since it turns out it's quite hard to filter out stupidity in the internet.

While the main source code may be outdated, the corpus may still be of some use in training modern LLMs based content moderation or at least a historical curio of humanities attempt to stem the tied of stupidity.

I've converted the original MySQL dump into an sqlite database and csv file so it should be easier for anyone interested to give this corpus a shot with new machine learning advances these days.

Source preview

huggingface.co

HNGlance

© 2024-2026 HN Glance. Story content belongs to its original sources.

Privacy
Terms