Good results fine tuning a local LLM like Qwen 3:0.6B to categorize questions 30 days ago
It's the same dataset as the original experiment, but could be interesting to dig into it more.
HN user
dev-experiments
92 karma
Posts2
Comments3
As a follow up to the original article, I added a new experiment using Logistic Regression and the results are very good. It actually improves on the accuracy by a few points.
More details here: https://www.teachmecoolstuff.com/viewarticle/using-logistic-...
Expanding on this experiment using logistic regression is an interesting continuation, detailed here: https://www.teachmecoolstuff.com/viewarticle/using-logistic-...
In summary: Using logistic regression actually improves accuracy, but also performance during both runtime and during training.