I think I was just following along with the previous post about running Gemma on a Xeon. Next I’m going to see which model can give the highest tokens/sec
HN user
neomindryan
Founder of https://neomindlabs.com
hey, I’m the author. That box has 384gb, but loading the model “only” uses about 80gb.
Thank you for sharing!
Thank you for sharing / linking!
Author here, it looks like my original comment was flagged for some reason. The fix is open upstream as PR #2138 (https://github.com/ikawrakow/ik_llama.cpp/pull/2138)
Author here. The short version: a viral post ran Gemma 4 on a 2016 Xeon; my Xeons are 2013, and the fork it used assumes AVX2, which Ivy Bridge doesn't have. The build failure was easy. The fun bug was the silent one: two MoE graph ops with no dispatch case on non-AVX2 builds, so every expert FFN output was uninitialized memory. Deterministic, NaN-free, fluent-looking multilingual gibberish.
The fix is open upstream as PR #2138 (https://github.com/ikawrakow/ik_llama.cpp/pull/2138), awaiting review. Fair warning on the AI angle: the patch was written by Claude at my direction. The post is explicit about which parts were me and which weren't. Happy to answer questions about either the bug or the workflow.
As engines got more efficient, coal became cheaper to put to work, and so people found far more things to do with it. The same thing is happening with developer hours.
We've been running Rails apps in production continuously since 2007. If you treat software as anything other than completely disposable, it's been a no-brainer for the entire 19+ years I've been paying attention (not despite its age, but because of it).
The premise that you get meaningful efficiencies from JavaScript on the back-end just because you have to use it on the front-end has been pretty thoroughly debunked at this point. Instead you mostly get a larger blast radius when the front-end ecosystem has its monthly identity crisis. OP's "stacks-du-jour" and programming language "flavour of the month" framing is exactly right. A shocking amount of web software architecture is just following fashion trends dressed up as technical decision-making.
Most of the churn in tech stack isn't driven by engineering requirements, it's driven by résumé optimization and Hacker News anxiety. Rails has quietly been powering serious businesses the whole time. Does anyone think NPM's 3.1 million packages enable more functionality than RubyGems' 190,000 packages?
This looks interesting, but I'm stuck on step 4 of the web setup: where do I get agents to start with? Shouldn't there be a default one that can help me get other ones?
FWIW I've had success with self-hosted [LinkDing](https://github.com/sissbruecker/linkding) and the firefox SingleFile plugin (so it archives what I'm seeing / gets around logins etc). LinkDing also links directly to Internet Archive for any URL.
Studies show that patients who played the[se] games responded better to chemotherapy, and had a much better understanding of the treatment process on the whole.
Don’t Believe The Hype, AI Will Increase Jobs
Neomind Labs | Elixir Developer | Remote | US | Full or Part Time
https://www.neomindlabs.com Neomind Labs is a fully remote team providing stewardship services for Ruby on Rails and Elixir applications. We're currently looking for people with 3+ years experience in Medical benefits and 401k match are available for full-time and part-time developers.
Please read more and apply here: https://30hourjobs.com/jobs/325/neomind-labs-elixir-develope...
-------------------------------------------------------------
Neomind Labs | Ruby on Rails or Elixir Full Stack Developer | Remote | US | Full or Part Time | https://neomindlabs.com
Neomind Labs is a fully remote team providing stewardship services for Ruby on Rails and Elixir applications. We're currently looking for people with 3+ years experience who enjoy mending as much as making.
Medical benefits and 401k match are available for full-time and part-time developers.
Please read more and apply here: https://30hourjobs.com/jobs/326/neomind-labs-rails-developer...
Neomind Labs | Elixir Developer | Remote | US | Full or Part Time
https://www.neomindlabs.com Neomind Labs is a fully remote team providing stewardship services for Ruby on Rails and Elixir applications. We're currently looking for people with 3+ years experience who enjoy mending as much as making. We offer medical benefits for full-time and part-time developers.
Please read more and apply here: https://weworkremotely.com/remote-jobs/neomind-labs-elixir-d...
Neomind Labs | Elixir Full Stack Developer | Remote | US | Full or Part Time | https://neomindlabs.com
Neomind Labs is a fully remote team providing stewardship services for Elixir applications. We're currently looking for people with 3+ years relevant experience who enjoy mending as much as making.
We offer medical benefits for full-time and part-time developers.
Please read more and apply here: https://30hourjobs.com/jobs/322/neomind-labs-elixir-develope...
Neomind Labs | Elixir Full Stack Developer | Remote | US | Full or Part Time | https://neomindlabs.com
Neomind Labs is a fully remote team providing stewardship services for Elixir applications. We're currently looking for people with 3+ years relevant experience who enjoy mending as much as making.
We offer medical benefits for full-time and part-time developers.
Please read more and apply here: https://30hourjobs.com/jobs/322/neomind-labs-elixir-develope...
Neomind Labs | Ruby on Rails or Elixir Full Stack Developer | Remote | US | Full or Part Time | https://neomindlabs.com Neomind Labs is a fully remote team providing stewardship services for Ruby on Rails and Elixir applications. We're currently looking for people with 3+ years experience who enjoy mending as much as making. We offer medical benefits for full-time and part-time developers. Please read more and apply here: https://30hourjobs.com/jobs/319/neomind-labs-ruby-on-rails-d...
Neomind Labs | Ruby on Rails or Elixir Full Stack Developer | Remote | US | Full or Part Time | https://neomindlabs.com
Neomind Labs is a fully remote team providing stewardship services for Ruby on Rails and Elixir applications. We're currently looking for people with 3+ years experience who enjoy mending as much as making.
We offer medical benefits for full-time and part-time developers.
Please read more and apply here: https://30hourjobs.com/jobs/319/neomind-labs-ruby-on-rails-d...
I couldn't resist chiming in here: we're doing this at Neomind Labs. We don't act as steward for front-end frameworks yet, but we're considering supporting React (I saw that you're a front-end developer).
“[I]n many ways nonsense is a more effective organizing tool than the truth. Anyone can believe in the truth. To believe in nonsense is an unforgeable demonstration of loyalty. It serves as a political uniform. And if you have a uniform, you have an army.” -- Curtis Yarvin
Thanks for making me feel like slightly less of an insensitive clod for my choice of words.
Thank you, this is great feedback.
I love this, thank you
Thanks for this perspective. I believe it takes developers at all levels to maintain a piece of software. A developer of 10 years experience may not get professional fulfillment out of form validation changes, but a bootcamp grad shouldn't run the SOC2 audit.
I love this, thank you
Anyone know why they gave a whole section to "Web" and omitted Ruby? Even C and Visual Basic are present.
XRDP server for Linux can be configured to send sound, so I’ve been using that setup for a cloud dev box. In a pinch, it works reasonably well from an Asus c101pa chromebook plugged into a 4K monitor.
Edit: forgot to mention that the latest versions of the official RDP client for macOS, iOS, and Android are pretty good and “just work”.
FWIW, I started with LaTeX a few years ago, and Overleaf.com really helped. Even though I prefer local development and generally work that way, Overleaf has Git integration, sharing features, and works when I've messed up my development environment.
All of this was arguably true two weeks ago.
Today, Litecoin has locked in support for Segwit, and in about a week it will be possible to create Lightning Network transactions using Litecoin.
This is largely due to the efforts of the creator, Charlie Lee, who was able to build consensus among the community to activate Segwit.
Contrast this with the inability of the Bitcoin Community over the last few years to get any improvements added.
You may think this is a bad thing because Litecoin has a more centralized authority governing it, or you may think it's a good thing because Litecoin has a way to improve itself, but either way I'd argue Litecoin has very recently become more than what you described.
1) Try this? https://www.bitgo.com