HN user

PhilippGille

1,237 karma

https://github.com/philippgille

meet.hn/city/de-Leipzig

Posts15
Comments385
View on HN
Transcribe.cpp 4 days ago

Handy already supports streaming transcription models, and you can see the words in the small Handy pop-up while you are talking.

So in general this definitely works. Handy is just missing the feature to insert these streamed words into the app where the cursor is.

GPT-5.6 13 days ago

That was the case for early models (Llama etc), but they got much better since then. Not perfect, but good enough.

This is from Ministral 3 14B, a 2025 model without reasoning, that you can run on your PC:

Write a Haiku involving HackerNews, and the capability of large language models like you to reply in an exact number of words or syllables.

    Silicon whispers,
    exact words in code’s embrace—
    Haiku blooms anew.
Across multiple tries it got it wrong a couple times (by ~2 syllables). But syllables are extra tricky (because of how LLMs use tokens) and the point is that for things like "summarize in 5 bullet points" you will mostly get 5 bullet points, maybe 6, but not 10 or 20, and no need for a tool that count bullet points.

Currently this is for payments with stablecoins.

For Bitcoin / Lightning these kind of pay-per-request API paywalls have existed for many years already (e.g. my own from 8 years ago [1], but others as well).

Flattr [2] existed for non-crypto micropayments.

None became mainstream. I think the friction is always the extra setup on the client side. In all 3 cases the user (API consumer) has to set up a special wallet (browser extension or something for the agent) and deposit some money/crypto on the client side first. This part needs to become simpler.

[1] https://github.com/philippgille/ln-paywall

[2] https://en.wikipedia.org/wiki/Flattr

Kimi and GLM models have coined a new term: Thinkslop. [...] So for now I'm happy with just two models: GPT and DeepSeek.

1. DeepSeek V3.2, V4 Flash, V4 Pro, at high or max thinking, ... when recommending a model it should always be a precise model, not just an AI lab

2. DeepSeek V4 Flash at max thinking is the most verbose model (among top models) in the AA benchmarks. See the "Intelligence Index Token Use" chart: [1]

[1] https://artificialanalysis.ai/models?models=gpt-5-5-high%2Cg...

The interesting bits on how they achieved it:

On the model side, we applied FP4 quantization

introduced DFlash, an efficient speculative decoding method based on block-level masked parallel prediction

On the system side, TileRT perfectly adapts to the dynamic characteristics of these algorithms

1000+ tokens/s output [...] using just a single standard 8-GPU commodity node

It's in the article:

HTTP also allows the DuckDB-Wasm distribution to speak Quack natively! So DuckDB running in a browser can e.g., directly connect to a DuckDB instance running in an EC2 server using Quack.

Both the original Markdown spec [1] as well as CommonMark [2] clearly specify support for inline HTML. With that you can kind of get the best of both words depending on your use case.

For the most parts you just write the regular Markdown headers and paragraphs, embed images, insert tables etc without the need for any HTML tags, making it readable in source form. And if you want to embed an SVG file for example, which the author of the article mentions as one use case, you just embed the SVG directly, and people can render the Markdown in their favorite viewer.

Let's say you're viewing a raw Markdown file in VS Code. You come onto an HTML tag, so you hit Cmd+Shift+V to open the preview and that's it.

Of course for full-fledged web pages with interactive buttons and fully customized styling and all of that, which the author shows in some examples, this is not feasible. But you can get very far when you have mostly text/images/tables and just want to add some extras here and there.

[1] https://daringfireball.net/projects/markdown/syntax#html

[2] https://spec.commonmark.org/0.31.2/#html-blocks

DeepSeek v4 3 months ago

When you say "Gemini", which exact model do you mean? You know there are several and they vary a lot in how capable they are? Pro 3.1 Preview, 2.5 Pro (their latest non-preview pro model), Flash 3 Preview, ...

Same with GPT-5: Latest 5.5, prior 5.4, or actually the original 5 (.0)?

You can't talk about model performance without specifying the exact model.

it is possible with some software to have everything massively cached, with the cloud doing that, with the origin server in my basement, only accessible from the allowed cache arrangement

Do you mean a setup like:

    client -> cloud(HAProxy+Varnish) -WireGuard-> basement(backend)
Or something else?
Docker Offload 4 months ago

The article tries to sell it to people who can't run Docker locally (e.g. locked down permissions in enterprise environments, slow old laptop), but hasn't it already been possible to use remote Docker engines?

So the news is that they're offering to host those remotes now, right?

The article does list what Tailscale adds on top of WireGuard:

WireGuard by itself is mostly the data plane. Tailscale adds the control plane on top: identity/SSO, peer discovery, NAT traversal coordination, ACL distribution, route distribution (including exit node default routes), MagicDNS, and fast device revocation.

In the cryptocurrency world this has existed many years already. For example with the Lightning network on top of Bitcoin it has always been easy to let the server generate an invoice, which the client pays and then the client sends another request including cryptographic proof of the payment. On layer 2 it was always cheap and fast.

For example I created this Go middleware at the time: https://github.com/philippgille/ln-paywall#how-it-works (currently defunct)

Similar projects implemented that into standalone API gateways.

All using status code 402 already.

Here Stripe's example is using USDC, so still crypto BTW.

would be nice to have a place that have a list of typical models/ hardware listed with it's common config parameters and memory usage

https://www.localscore.ai from Mozilla Builders was supposed to be this, but there are not enough users I guess, I didn't find any Qwen 3.5 entries yet