HN user

jsilence

1,916 karma
Posts12
Comments1,038
View on HN
OpenPrinter 16 days ago

Or get a good old LaserJet 4050 used somewhere. Indestructible workhorse.

User @thin_signal developed a tool for mixed precision quantization on MLX. They perfoemd a sensitivity analysis across the model layers and applied less radical quantization on the layers more sensitive and more quantization tomlayers that are more robust.

The tool, which is documented here (https://mlx-optiq.pages.dev/) also implements the recently aanounced TurboQuant KV-Cache optimization, so in total this should greatly improve the quality of locally run LLMs.

Looking forward to an OptiQ release of the Gemma 4 family.

That is part of the ‚first mover advantage‘. Sometimes operating and experimenting in grey zones before they become regulated.

The European and especially German approach of regulating pre-emptive might be more fair, but apparently it also stifles innovation, as we can observe. Almost no significant players from Europe and Germany.

Have been using Spacemacs and Doom Emacs some time ago, but turned off evil mode, bc I was not used to vim style editing. Lately I understood that vim key bindings is actually an editing language and finally found joy in vim [0]. Surely going to return to Doom-Emacs with evil mode on. Maybe switching to evil god mode later.

[0] https://www.youtube.com/watch?v=wlR5gYd6um0

I have been using a similar tool, Clipea, on a regular basis and I find it really helpful. I am CLI proficient enough to know whats possible on the shell, but I use it too infrequently to remember all the ins and outs and flags. At this point these tools really improve productivity.

Have not used shllm, but from the docs it looks good. Clipea and others have not been updated for quite some time, except llm from Simon Willison, the datasette developer. His llm implementation has a llm-cmd plugin which provides what shllm does. Works like a charm.

Over all a very useful category of AI programs.

I have a similar situation, managing a lot of different threads in very different contexts (teaching and projects) at our university.

I miss the state of flow very much, not being able to focus on one thing and diving deep for a couple of hours or even a couple of days. The constant context switch and firehosing of incoming messages I have to fend off is draining.

Just as you say, some days feel like having been completely busy while not achieving anything of substance. I know I am lubricating others work, but I'd love to be with my own toughts for a while also.

For the next project I am attempting to dedicate full and exclusive days to the different contexts, so that at least on that single day my mind is not concerned with all the contexts, threads and their TODOs.

I am already tagging my incoming emails with "TODO" and "waiting for reply" and sorting them into their respective folders and then afterwards heading for the tag stacks and working on them. I think I will add tags for contexts and set up filters, so that I can open the right TODO stack for the topic of the day I am working on, to conceal any "not today" work.