HN user

jetbalsa

417 karma
Posts2
Comments182
View on HN

I also noticed they where not using XML for game state output, from what I understand most LLMs still benefit from having outputs like this put into XML tags

GLM 5.2 Is Out 1 month ago

I found it hard stops on /anything/ Ghidra related at all, its annoying...

I have not very well treated AuADHD and being alone with my thoughts very long is generally not very productive, At least Coding LLMs have helped me get things I wouldn't of had the attention span to make in the past come to life. and a good bit of vibe coding is just yelling at the LLM that what its doing sounds good on paper so keep going, please do the needful, make no mistakes :V

RISC-V Router 2 months ago

VPN and DNS Packages in OpenWRT eat a good bit of ram. and sometimes can be cheaper for faster speeds needed to higher packet processing.

I've been mostly using Kimi has a hacker of sorts, putting it places I want to attach AI directly as their API for their plans are not completely user hostile. Need to do OCR for scanning Magic the Gathering Cards. Sure!, have it attached to X4: Foundations as a AI manager for some stuff. sounds fun. Can't really do that with claude

ChatGPT Images 2.0 3 months ago

Yep, Its pretty damn good compared to classic OCR and even more lightweight ones as well that I can run locally. the cards just vary too much over time.

I'm unsure of the sizes needed for prompt cache, but I suspect its several gigs in size (A percentage of the model weight size), how would the user upload this every time they started a resumed a old idle session, also are they going to save /every/ session you do this with?

The cache is stored on Antropics servers, since its a save state of the LLM's weights at the time of processing. its several gigs in size. Every SINGLE TIME you send a message and its a cache miss you have to reprocess the entire message again eating up tons of tokens in the process

So to defend a litte, its a Cache, it has to go somewhere, its a save state of the model's inner workings at the time of the last message. so if it expires, it has to process the whole thing again. most people don't understand that every message the ENTIRE history of the conversion is processed again and again without that cache. That conversion might of hit several gigs worth of model weights and are you expecting them to keep that around for /all/ of your conversions you have had with it in separate sessions?

The cache is on Antropics server, its like a freeze frame of the LLM inner workings at the time. the LLM can pick up directly from this save state. as you can guess this save state has bits of the underlying model, their secret sauce. so it cannot be saved locally...

ChatGPT Images 2.0 3 months ago

Oh god yes, I've been trying to make a LLM Assisted Magic the Gathering card scanner... its been a hell of a time trying to get it to just OCR card names well....