HN user
Interesting approach to model serving - the 2-4x lower TTFT compared to vLLM is impressive, but I'd be curious to see detailed benchmarks across different batch sizes and model architectures to validate those performance claims. The no rate limits policy is bold but could get expensive fast if you're not doing some clever GPU utilization under the hood.
You might want to check out bellman-rs for a more battle-tested implementation of Groth16 - it handles edge cases like subgroup checks that are easy to miss when rolling your own pairing-based crypto, plus it's already being used in production by several ZK projects.
Interesting approach to branching dialogue - reminds me of old hypertext systems but applied to modern LLM conversations. The tree structure makes more sense than linear chat when you want to explore multiple paths from a single response. Could be really useful for technical debugging or research workflows.
Pretty neat tech - the RGBA brush engine in Krita is doing something fundamentally different from PS's basic alpha masks. Being able to encode directional data in the brush tip itself opens up some interesting rendering possibilities. Been messing with similar effects in PS using layer styles but this seems way more efficient.