HN user

mrbnprck

8 karma
Posts6
Comments17
View on HN

Fixed :) Turned out to be a race condition where the groq inference task completed before the sse client could subscribe to that inference, and internally the sse connection couldn't be used to fetch already completed inferences.

Thanks for trying out!

I haven't caught that back button bug yet, thanks for letting me know.

The search engines/crawler aspect is just a personal preference, less a "nice side effect". The chat interface happens to fit that preference better.

open-source models with up to 120 billion parameters

Sad, 120b models are definetely feasible to self-host. I'd be more interested in cloud providers (especially one with computational resources like the Schwartz group) hosting the larger 500B+ models. Probably just too expensive/unsustainable if one could 5x fold the cost by serving smaller models solving the needs of the 90% customer.

Arguably its only a matter of making lsp features available to the coding agent via tool calls (CLI, MCP) to prevent the model start doing such changes "manually" but rather use the deterministic tools.

Very true. ASN.1 is mostly not a great fit, yet has been the choice for everything to do with certificates and telecommunication protocols (even the newer ones like 5G for things like RRC AND NGAP) Mostly for bit-level support and especially long-term stability. * and looking back in time ASN.1 has definetly proven its LTS.

actually never heard of thrift until today, thanks for the insight :)