LeBit

26B-A4B?

How did they do that?

People are rough here.

Thanks for your work, thanks for sharing, thanks for the fork.

I’m an idiot who is unable to project itself in situations I’ve never experienced before.

So, I always thought local LLMs were toys not worth pursuing.

Only once have I tried something decent like Gemma 4 31B and Qwen 3.6 27B did I realize how incredibly useful they are.

You stop fearing you are sharing sensitive information.

You stop fearing you will run out of tokens.

You stop fearing about the availability of the remote AI.

Local LLMs are extremely valuable.

This is very cool. The example is thorough and well documented.

I am trying smolmachines this weekend.

Thanks.

Can smolmachines run devcontainers? K3d?

Colima just seems to be easier to work with using Docker.

Devcontainers work without having to pass special arguments and deal with inconsistent stuff once in the devcontainer itself.

K3d is easier to work with Docker.

Docker locally just makes sense.

We are talking about an agent harness here, not a model.

Nevertheless, Americans thinking they are morally superior to China is always quite funny.

This administration is corrupt, cruel and doesn’t care about human rights.

And the worst is… Americans have voted for that administration…. twice!

I digress…

If I made 500M$ using an Open Source library and didn’t send at least 1M$ to the author, I would be an objectively bad person.

Which components are you thinking about?

I think it is because desktop computers with GPUs with enough VRAM to run interesting models are insanely expensive, hard to source and consume a lot of electricity and dissipate a lot of heat.

True. But at some point you got to close your eyes and take a step forward.

It’s like with VPN providers. Is Mullvad actually collaborating with law enforcement? They very well could be. It is a calculated risk.

Is DeepInfra actually logging and training or selling the logs? They could be.

I Me My Me Me I I

Wow, the comments are generally negative. That’s sad. I was about to create a POC to present to my team.

What else could be used to abstract away your CICD from the launcher (Jenkins, Argo Workflows, GitHub Actions, etc.)?

Lazygit can do that too.

I don't understand the hate regarding K8s.

What's wrong with developing software knowing it will be hosted on a k8s cluster?

You can install a local k8s cluster will plenty of tools helping you with secrets management, observability, ingress, scaling, storage.

Why the hate?

Ah! I was able to open the link in a proper browser. I'm using HACK on iOS.

Thanks for the condescending comment.

The link doesn't open on my side.

Yeah, I am aware writing my own scripts isn't ideal, but this is the current state of affair.

I could use mise to install most tools though. I would need to figure out what the overhead would be.

I just gave that link to someone else who commented here. :)

You are right, but at the end of the day, I prefer to write my own installation scripts or "features" than dealing with Nix.

Maybe some day I'll go back to a nix tool to help writing a complex devcontainer.json with everything I need.

There are more and more tools making use of the dev containers spec: https://devcontainers.github.io/supporting.html

I tried devbox and some other tool in that field.

I then tried dev containers.

Dev containers won. Hands down.

You mean "dynamically" push routes and DNS configurations while the tunnel is already up?

Because you can definitively configure routes and DNS at connection time.

ncdu is focused on telling you who takes disk space. nnn is more like a file manager with lots more features.

I agree with you.

But I think for python you could also deploy a binary with pyinstaller.

Bash is fine for small scripts.

Once you use it to manage complex data structures and flow, you are simply wasting time because you will have to rewrite it in Python or Go.

I think the hot trend these days is to bash on microservices. I hear that a lot here, random blogs, youtube videos by self proclaimed top guns.

If hacker news is correct, microservices is the #1 worst idea of software engineering.

And whoever promotes them is either a kid with no experience or a complete moron.

Some productivity guru would say you have the correct mind set.

Chasing the perfect productive setup is a big sophisticated procrastination trap.

But tmux does bring in value. The fact it makes it possible to keep a remote session running even when you lose connectivity is worth learning at least 5% of that tool.

Same here.

I have always thought it was super sexy to have all these panes available with an editor, logs, debugger opened at the same time ; but the reality is that I cannot work with 20 characters columns.

I use a 4k display set to HiDPI (1080 lines) and simply switch between my full-screen panes.

Sometimes I will split my tmux window vertically because I can deal with fewer lines but I never split horizontally.

Like what?

But then you cannot scale.

You do not see the problem because you probably manage less than 5 nodes.