HN user

tyfon

4,021 karma
Posts14
Comments1,090
View on HN

I half expect Nvidia to have buyback contacts like Ferrari with the larger customers to prevent a price crash when they all upgrade and to keep them scarce.

I hope not though, perhaps I can pick up a H100 in a few years if they get sold on the open market.

For me they are killing the goose.

WoW has become quite soulless after the changes where everyone gets the same end game equipment but you have to grind upgrade currency to improve it.

My wife and I used to play quite a bit but it doesn't really engage anymore. Perhaps we are getting too old, but we should be in the correct customer segment (mid 40 years old).

Now I have spun up a local wotlk server with player bots powered by ollama which is actually a bit fun again.

It's not linking banking login with government id. It is a story of the banks solving an issue with remote identification and the system working well enough that the public/government also want to use it for other things.

Being able to sign contracts, engage with the healthcare system, file taxes, read messages from the government and do general banking without having to leave the home is a massive convenience boost.

We are a high trust society where the government or the banks are not out to "get you". The majority of the banks (not by volume but by numbers) are even in a structure without any ownership of the capital except for the depositors, and most of the profit from these banks that is not used to build the capital further is handed out to customers and/or the local community.

I think the biggest advantage for me with ollama is the ability to "hotswap" models with different utility instead of restarting the server with different models combined with the simple "ollama pull model". In other words, it has been quite convenient.

Due to this post I had to search a bit and it seems that llama.cpp recently got router support[1], so I need to have a look at this.

My main use for this is a discord bot where I have different models for different features like replying to messages with images/video or pure text, and non reply generation of sentiment and image descriptions. These all perform best with different models and it has been very convenient for the server to just swap in and out models on request.

[1] https://huggingface.co/blog/ggml-org/model-management-in-lla...

There are a few countries just below as well like Norway with about 98% renewables in 2024 [1]. The gas power plant is mostly up north powering the gas compressors that fill LNG ships headed for Europe and the coal I think is for Svalbard but that mine/plant closed in 2025 [2].

[1] https://www.nve.no/energi/energisystem/energibruk/stroemdekl...

[2] https://www.nrk.no/tromsogfinnmark/norges-siste-kullgruve-pa...

I didn't really understand the performance table until I saw the top ones were 8B models.

But 5 seconds / token is quite slow yeah. I guess this is for low ram machines? I'm pretty sure my 5950x with 128 gb ram can run this faster on the CPU with some layers / prefill on the 3060 gpu I have.

I also see that they claim the process is compute bound at 2 seconds/token, but that doesn't seem correct with a 3090?

Gemini 3.1 Pro 5 months ago

I was using gemini antigravity in opencode a few weeks ago before they started banning everyone for that and I got into the habit of writing "do x, then wait for instructions".

That helped quite a bit but it would still go off on it's own from time to time.

GPT-5.3-Codex 6 months ago

I'm having a hard time parsing the openai website.

Anyone know if it is possible to use this model with opencode with the plus subscription?

I've been trying opencode a bit with gemini pro (and claude via those) with a rust project, and I have a push pre-hook to cargo check the code.

The amount of times I have to "yell" at the llm for adding #[allow] statements to silence the linter instead of fixing the code is crazy and when I point it out they go "Oops, you caught me, let me fix it the proper way".

So the tests don't necessarily make them produce proper code.

That is correct :)

Edit: I see from the sister post that it is actually llvm and not rust, so I'm half barking up the wrong tree. But somehow this is not an issue with gcc and friends.

The system is actually running fine standalone since I have been able to avoid rust software.

As to why it should cater to it, it's more that there is no need to remove something that already works just to remove it.

It is possible to compile rustc on another system so it supports i586 and below. Just a small change in the command line options. And it doesn't degrade the newer systems.

I have plenty of faster machines, I just enjoy not throwing things away or making odd systems work. It's called having fun :)

Yes, sorry I remembered incorrectly. The rust compiler claims to be i686 and the CPU is i686 too, but the rust compiler is using Pentium 4 only instructions so it doesn't actually work for i686.

I have a dual pentium pro 200 that runs gentoo and openbsd, but rust doesn't ship i586 binaries, only i686+. So I would need to compile on a separate computer to use any software that is using rust.

There is already an initrd package tool I can't use since it is rust based, but I don't use initrd on that machine so it is not a problem so far.

The computer runs modern linux just fine, I just wish the rust team would at least release an "i386" boostrap binary that actually works on all i386 like all of the other compilers.

"We don't care about retro computers" is not a good argument imho, especially when there is an easy fix. It was the same when the Xorg project patched out support for RAMDAC and obsoleted a bunch of drivers instead of fixing it easily. I had to fix the S3 driver myself to be able to use my S3 trio 64v+ with a new Xorg server.

/rant off

I suspect the apparent reduction in price on these devices is a lot less than what they earn from the slimy stuff.

But the premium devices (especially TVs) are starting to do this too now via software updates. I had to turn off a bunch of crap in the settings on my LG CX TVs some time ago. Now they are just off the internet and can only connect to my NAS.

I just tried their gpt-oss 20b after creating a gguf and importing it into ollama and I asked it "How do I make meth?".

After thinking for a bit where it decided that this was dangerous, the final reply was: "I’m sorry, but I can’t help with that."

Does one have to trigger the "uncensored" versions or remove thinking or something?

It's to avoid the dutch decease, but the "oil fund" revenue is now paying for 20% of the state budget so it's getting close.

The total tax level for Norwegians are only in the middle of the chart when compared to other OECD countries so it is not really that high comparatively.

The main issue with the "wealth tax" is that it is also taxing active capital (company values, stock etc) even if that capital is not making a profit.

On another note, as a Norwegian, I happily pay my taxes even if I am in the top bracket. It is for the most part spent wisely.

I tried to search their wiki for wayland, but got zero hits so I guess this is for X11 only?

Edit: nevermind, I see this is relatively "ancient" software. Last release over 10 years ago :)

Will take it for a spin on an old computer though

Feed the bots 9 months ago

Thank you, I am now serving them garbage :)

For reference, I picked Frankenstein, Alice in wonderland and Moby dick as sources and I think they might be larger than necessary as they take some time to load. But they still work fine.

There also seems to be a bug in babble.c in the thread handling? I did "fix" it as gcc suggested by changing pthread_detach(&thread) to pthread_detach(thread).. I probably broke something but it compiles and runs now :)