HN user

zbendefy

263 karma
Posts12
Comments75
View on HN

I dont have estimates on the cost of running models, but I think openai and anthropic are running on subsidized prices. At actual prices it might be worth it in the future.

How LLMs work 2 months ago

Good point!

There is also the case for Markov chains being theoretically able to do these if tuned well. Or even SAT problem.

This reminds me of stuff like interns wiping the production servers.

The solution in the comments there is always "have backups" and "why can an intern do that stuff? why arent policies set".

But I dont think these can be applied to something like openclaw agents

Tangential, but Flash had a nice side effect that the "app" could be exported in a self contained way via SWF.

Exporting this site for example in a future proof way is not that obvious. (Exporting as pdf wont work with the webgl applets, exporting the html page might work but is error prone depending in the website structure)

50 years from now, flash emulators will still work on swf files, but these sites might be lost. Or is there a way to archive sites like this?

No Graphics API 7 months ago

The user writes the data to CPU mapped GPU memory first and then issues a copy command, which transforms the data to optimal compressed format.

Wouldnt this mean double gpu memory usage for uploading a potentially large image? (Even if just for the time the copy is finished)

Vulkan lets the user copy from cpu (host_visible) memory to gpu (device_local) memory without an intermediate gpu buffer, afaik there is no double vram usage there but i might be wrong on that.

Great article btw. I hope something comes out of this!

My takeaway is that sandboxing should be more readily available, and integrated into the OS.

I used sandboxie a while ago for stuff like this, but afaik windows has some sandbox built into it since a few years which I didnt think about until now.

Thing is (correct.me if Im wrong), that if you use modules, all of your code need to use modules (e.g. you cant have mixed #include <vector> and import <vector>; in your project). Which rules out a lot of 3rd party code you might want to depend on.

How different is CBOR compared to BSON? Both seem to be binary json-like representations.

Edit: BSON seems to contain more data types than JSON, and as such it is more complex, whereas CBOR doesn't add to JSON's existing structure.

3-JSON 12 months ago

offtopic: why is the Copyright © icon shake like crazy at the bottom of the page?

Edit: Oh I guess it seems to be intentional, I clicked around and I like the rgbcube site map.

Not just that, they had specific renderer backends, one for GeForce, one for GeForce3, one for Radeon 8500 that they had to cut out as they used proprietary information or code perhaps.

Aren't registers fixed by x86_64, while cache is a CPU hardware specific thing (e.g.: newer cpus have more cache than older ones, bit register count is fixed 8 on x86 and 16 on x86_64)?

So I think the compiler can work with registers at compile time but cant work with an unknown structure of cache

No, the full R1 model is ~650GB. There are quantized version that quantize it down to ~150GB.

What you can run locally are the distilled models, that is actually LLama and Qwen weights further trained on R1's output

Note: you are probably running a distilled version of R1, which is actually LLama or Qwen further trained on the input/output of R1.

The full R1 is huge (~700GB), altough there are still quantized versions, the smallest one is around 150gb (1.58bit)

I think some state is also being given (or if its not, it could be given) to the network, like 3d world position/orientation of the player, that could help the neural network anchor the player in the world.

Software galaxies 2 years ago

Reminds me of the 3D file browser user interface in Jurassic Park, which was an actual application. Looks cool but its not good to use (I mean the 3d file browser, not this software galaxies, which i found quite good).

3D interfaces rarely plan out, wonder if something like a vision pro or quest could make a 3D user interface work better than a 2D counterpart.