HNGlance

Top Best New Show

Local Models in Mid-2026

https://coles.codes/posts/local-models-mid-2026

by colescodes • 1 month ago

3 3 1 month ago

CO

Related Stories

Loading related stories...

Comments

3

denn-gubsky2• 1 month ago

Thank you for sharing. I'm running Gemma4:12b and qwen-coder-next MoE on my local RTX5080 (yes, 16Gb). Using them for local agentic tasks with tools and MCP tools usage. Both hallucinating on my setup. Do you have a rating for most appropriate local models for local agenting tasks? I also tried kimi2.6, qwen3.6 - no luck.

colescodes• 1 month ago

I'd try Qwen 3.6 35B-A3B or 27B with a temperature of around 0.6. You'd need to offload some of it to RAM though. I've had okay luck with Gemma 4 12B with a temperature of 1.0 but it will miss things a lot :(

denn-gubsky2• 1 month ago

Thank you. Gemma4:e4b with temperature 0.9 works pretty good with tools (Bash, Glob, Red/Write and WebFetch) And it is fast. Will try the Qwen 3.6 later today.

Source preview

coles.codes

HNGlance

© 2024-2026 HN Glance. Story content belongs to its original sources.

Privacy
Terms