Ask HN: What tiny LLMs are you getting the best results from?
https://news.ycombinator.com/item?id=43760256Curious if anyone here is having any success with running smaller LLMs locally on constrained hardware, such as laptops or GPU-less devices. If so, what kind of utility have they brought you?