After GLM and Z.ai releasing huge models. Thanks to Qwen team, we have models which could be run on low end devices.
Especially that Qwen3.5-35B-A3 looks great for cheaper GPUs. Since a quant version of it would need a <32 GB RAM.
HN user
Software Dev,India.
Homepage: anuragk.com
Reach me at: kanurag 0 7 8 'at' the most popular google mail site.
After GLM and Z.ai releasing huge models. Thanks to Qwen team, we have models which could be run on low end devices.
Especially that Qwen3.5-35B-A3 looks great for cheaper GPUs. Since a quant version of it would need a <32 GB RAM.
Hey, Can you please point out explain the inaccuracies in the article?
I had written this post to have a higher level understanding of traditional vs Taalas's inference. So it does abstracts lots of things.
I don't post blogs often, so haven't added RSS there, but will do. I mostly post to my linkblog[1], hence have RSS there.
Yeah, I had written the blog to wrap my head around the idea of 'how would someone even be printing Weights on a chip?' 'Or how to even start to think in that direction?'.
I didn't explore the actual manufacturing process.
That's the kind of hardware am rooting for. Since it'll encourage Open weighs models, and would be much more private.
Infact, I was thinking, if robots of future could have such slots, where they can use different models, depending on the task they're given. Like a Hardware MoE.
I'd say that they're super confident about the GLM-5 release, since they're directly comparing it with Opus 4.5 and don't mention Sonnet 4.5 at all.
I am still waiting if they'd launch GLM-5 Air series,which would run on consumer hardware.
https://www.anuragk.com/linkblog/
My linkblog is a collection of interesting ideas and snippets I've found around the web. It is tech and non-tech both.
I think you're quoting the Sci Fi author - Ken Liu from his article in some major news outlet.
I related with that analogy too, infact that whole piece is worth reading. I can't seem to find it's link though!
Location: Bengaluru / Gurugram/ Noida/ Delhi NCR, India
Remote: Yes
Willing to relocate: Willing to travel quarterly outside India. Open to relocate in India or similar time zone.
Technologies
Programming: Java, Python, Go, SQL
Frameworks: Spring Boot
Databases: MySQL, Clickhouse, Cassandra
Misc: Docker, Kafka, Microservices, OOPS, REST, Redis, Data Structures.
Résumé/CV and other details available at: https://anuragk.comEmail: kanurag078+hn@gmail.com
-------
I'm a software engineer with 5+ years of experience in backend development with expertise in building low-latency applications. I have mostly worked with Java and bit of Python.
Recently, I've been learning Go and been building my Link blog at https://www.anuragk.com/linkblog .
Am primarily looking to work with a smaller team where I can see the impact of my work. Feel free to mail me to discuss more.
I came across KOReader when I was trying to jailbreak my kindle. It's UI looked great on e-ink screen. And it handled almost all ebook formats properly.
Lately, I've used it on Android, and UI which is more suited for e-ink screens, look not so polished on phones, but that's just nitpicking. It's fully usable and keeps adding support for new platforms.
Location: Bengaluru / Delhi NCR, India
Remote: Yes
Willing to relocate: Willing to travel quarterly outside India. Open to relocate in India or similar time zone.
Technologies
Programming: Java, Python, Go, SQL
Frameworks: Spring Boot
Databases: MySQL, Clickhouse, Cassandra
Misc: Docker, Kafka, Microservices, OOPS, REST, Redis
Résumé/CV: https://trailblazerr1.github.io/resume.pdfEmail: kanurag078+hn@gmail.com
-------
I'm a software engineer with 5+ years of experience with expertise in building low-latency applications. I have mostly worked with Java.
Recently, I've been feeling as in Java is used mostly by 'legacy' companies and to work on more cutting-edge tech I learnt Go and have been exploring opportunities in it too. I sometimes tinker with open source codes and read of tech in my free time.
Am primarily looking to work with a smaller team where I can see the impact of my work. Feel free to mail me to discuss more.
Location: Bengaluru / Delhi NCR, India
Remote: Yes
Willing to relocate: Willing to travel quarterly outside India. Open to relocate in India or similar time zone.
Technologies
Programming: Java, Python, Go, SQL
Frameworks: Spring Boot
Databases: MySQL, Clickhouse, Cassandra
Misc: Docker, Kafka, Microservices, OOPS, REST, Redis
Résumé/CV: https://trailblazerr1.github.io/resume.pdfEmail: kanurag078+hn@gmail.com
-------
I'm a software engineer with 5+ years of experience with expertise in building low-latency applications. I have mostly worked with Java.
Recently, I've been feeling as in Java is used mostly by 'legacy' companies and to work on more cutting-edge tech I learnt Go and have been exploring opportunities in it too. I sometimes tinker with open source codes and read of tech in my free time.
Am primarily looking to work with a smaller team where I can see the impact of my work. Feel free to mail me to discuss more.
https://www.experimental-history.com/
I found Adam Mastroianni's blog through a HN post titled "How to debog Yourself". Unlike another pop-sci articles, this one had actual depth and enjoyed reading it.
Since then, I've read and digested most of his posts and comments. He usually writes about human behavior, not really offering the solutions, but the reasons.
He is the one author I've screenshot-ed most in 2024. I'd recommend starting with this post:
https://www.experimental-history.com/p/you-cant-reach-the-br...