frwickst

What you learn at a uni is not really about learning a trade, sure it gives you a taste of the basics in many areas, but you will never be an supeb developer (or another profession) when you get out by only attending classes. However, what uni teaches you is how to learn, how to think critically, how important sources are, what to look for to get the most knowledge out of what you read. Or at least that is what it has always been about for me, the process of learning effective learning.

It is a tokenizer artifact most likely (https://github.com/huggingface/transformers/issues/4786). So the output is not properly decoded in this case, it should just be a space.

Since the output is quite long, here is a link: https://pastebin.com/k76wiVGP

I'm getting 6.55t/s using the Qwen3.5-397B-A17B-4bit model with the command: ./infer --prompt "Explain quantum computing" --tokens 100

MacBook Pro M5 Pro (64GB RAM)

Last posted 16 days ago: https://news.ycombinator.com/item?id=46661308

You can use Every Code [1] (a Codex fork) for this, it can invoke agents, but not just codex ones, but claude and gemini as well.

[1] https://github.com/just-every/code

Hi! Creator of the pyhuum library and the Huum integration here. If you need someone else to double-check anything, please let me know. I would be more than happy to help out here, as the current API approach is not ideal.

Some things that bother me regarding the current integration are that their API does not return the set value of the sauna unless it is on, nor does it return the target value of the sauna unless it is on. However, they do have this information, as one can circumvent this limitation by turning off the sauna, and then it will return these values. I talked to their CTO about this, and it seems like they don't want to spam the sauna with requests all the time; this is the reason the status endpoint does not return this value. In the end, one can get around this, and now the library spams two requests if the sauna is off: first to check if the sauna is on, and if it is not, then we call the "off" endpoint and get the correct value. This all leads to some unexpected behavior as well, since the status of the sauna does not update fast enough, causing the sauna to turn off after it has been turned on at times. This is not a problem when used exclusively with Home Assistant, as it keeps internal state, but it can be annoying when it is used via the physical controls in combination with HA.

You can find my contact info in the pyhuum package if you want to discuss anything.

Thanks for a neat project! I tried it on one of our more complex pipelines and created a few issues for you ;)

Hi, one of the developers here. Happy to answer any questions that you might have.