HN user

Palmik

2,794 karma
Posts125
Comments366
View on HN
ca.finance.yahoo.com 26d ago

Trump administration asks OpenAI to stagger release of new model

Palmik
2pts0
www.semafor.com 2mo ago

House Committees Probe Cursor Parent, Airbnb over Chinese AI

Palmik
2pts0
consumerrights.wiki 2mo ago

Anthropic Claude Code HERMES.md billing flaw

Palmik
1pts0
vllm-website-pdzeaspbm-inferact-inc.vercel.app 2mo ago

DeepSeek V4 in vLLM: Efficient Long-Context Attention

Palmik
2pts0
www.axios.com 3mo ago

NSA is using Anthropic's Mythos despite blacklist

Palmik
485pts348
www.phoronix.com 3mo ago

Mozilla Announces "Thunderbolt" as an Open-Source, Enterprise AI Client

Palmik
25pts11
www.reuters.com 3mo ago

Google, Pentagon discuss classified AI deal, the Information reports

Palmik
6pts2
www.bloomberg.com 3mo ago

OpenAI, Anthropic, Google Unite to Combat Model Copying in China

Palmik
3pts0
mistral.ai 3mo ago

Speaking of Voxtral

Palmik
19pts1
nvidianews.nvidia.com 4mo ago

Nvidia Nemotron Coalition of Leading AI Labs to Advance Open Frontier Models

Palmik
5pts0
twitter.com 4mo ago

Sam Altman AMA on DoD Collaboration

Palmik
20pts3
www.techdirt.com 4mo ago

Palantir Sues Magazine for Reporting That the Government Didn't Want Palantir

Palmik
13pts0
slint.dev 5mo ago

Slint: Cross Platform UI Library

Palmik
3pts0
sqldef.github.io 5mo ago

Sqldef: Idempotent schema management tool for MySQL, PostgreSQL, SQLite

Palmik
263pts61
safeql.dev 5mo ago

SafeQL: An ESLint plugin for writing SQL queries in a type-safe way

Palmik
1pts0
www.bbc.com 5mo ago

India and EU announce landmark trade deal

Palmik
207pts265
qwen.ai 6mo ago

Qwen3-TTS family is now open sourced: Voice design, clone, and generation

Palmik
744pts225
www.openresponses.org 6mo ago

Open Responses: specification for building interoperable LLM interfaces

Palmik
1pts0
github.com 6mo ago

DeepSeek Engram: Conditional Memory via Scalable Lookup

Palmik
3pts0
xcancel.com 6mo ago

Anthropic bans xAI from using Claude in Cursor

Palmik
36pts2
www.techradar.com 7mo ago

Denmark wants to ban VPNs to unlock foreign, illegal streams

Palmik
8pts3
huggingface.co 7mo ago

ChatterBox Turbo – Open Weight TTS Model

Palmik
2pts0
news.ycombinator.com 7mo ago

Ask HN: Is Cloudflare Down for You?

Palmik
20pts12
www.scmp.com 8mo ago

Anthropic Cuts Off Access for Another AI IDE

Palmik
2pts2
pytorch.org 8mo ago

Torchforge – a PyTorch native library for scalable RL post-training

Palmik
2pts0
www.reuters.com 8mo ago

Universal Music settles copyright dispute with AI firm Udio

Palmik
4pts0
jsonjoy.com 8mo ago

JSON-joy: build real-time collaborative apps

Palmik
2pts0
www.theverge.com 8mo ago

OpenAI completed its for-profit restructuring and new deal with Microsoft

Palmik
2pts1
temp.chrismorgan.info 10mo ago

Tesid: Textualised Encrypted Sequential Identifiers

Palmik
4pts0
newsletter.posthog.com 11mo ago

The benefits of being an open-source startup

Palmik
3pts0

So, this is 'open' as in 'OpenAI', not as in 'open source'. What's the benefit of this compared to something like NOW Payments for merchants (or the myriad of alternatives)? NOW Payments supports a wide range of crypto currencies as well.

Codex Resets 4 days ago

Commodity providers aren't a good indicator. They have margins too.

Remember they ~doubled the price going from GLM 5 to GLM 5.2, despite same [1] cost of inference.

[1] GLM 5.2 is actually slightly more efficient, thanks to baked in indexer cache.

DeepSeek V4's KV cache is very efficient due to its heavily compressed and sparse attention architecture.

DeepSeek V3.2 which uses DSA only (sparse attention, but without compression from HCA and CSA) is a smaller model but uses 10x more memory at 1M context window compared to DS V4 Pro.

Also, I have to say, DeepSeek's API has a very good cache hit rate. With the same workload, I see ~80% KV cache hit rate with the DS API vs ~50% with the major western inference providers for open weight models.

There are several things at play:

Inference stack efficiency: Many of these providers take off the shelf sglang / vllm / trtllm and hope for the best. Meanwhile DeepSeek team is known for pushing the boundary of optimizations.

Now, sglang and vllm are great pieces of software, but take DeepSeek's Sparse Attention (DSA). Introduced 1.5 years ago (https://arxiv.org/abs/2512.02556), used by DeepSeek 3.2, GLM 5, DeepSeek V4. Only now is it slowly strating to get optimized in the major inference engines: (https://github.com/sgl-project/sglang/issues/19380 https://github.com/sgl-project/sglang/pull/22851 etc.). Of course, DS V4 adds extra optimizations into the model architecture on top of DSA, and those will take more time to be taken full advantage of by the open source inference engines.

Privacy: Betting that people will pay extra for inference hosted outside China. This is especially true with DeepSeek, because DeepSeek is transparent about using API data for model improvements.

And few other things (scale (matters a lot for MoEs), reliability, soft enterprise lock in, etc.)

---

There is also, likely, tacit collusion at play here. Look at GLM 5 and GLM 5.1 prices. GLM 5 and 5.1 cost the same to run, but providers decided to charge much more for 5.1 because it is much better model, and because Z.AI raised their price as well.

I don't think "friendly" and "publishing benchmarks" are at odds with each other.

Model makers (both open and closed weight) typically publish benchmarks against other models and when they do not, people rightfully call them out.

Including comparison against "other OSS engine" is just not helpful (what if it's a sandbagged baseline like HF Transformers?)

Similar article for vLLM: https://vllm-website-pdzeaspbm-inferact-inc.vercel.app/blog/...

Bechmarks from InferenceX (they do not have apples-to-apples setups to compare the different engines for whatever reason): https://inferencex.semianalysis.com/inference?i_hc=1&g_model...

I find it odd that sglang, vLLM, TRTLLM don't seem to want to publish benchmarks comparing each other. They used to, but now there seems to be some unspoken rule against it.

At least we get comparison against "other OSS engine" this time, but that could be HF's Transformers as well :)

ChatGPT Images 2.0 3 months ago

Misleading conclusion.

This model is 8 times cheaper than Gemini for 1K images. Gemini is extremely overpriced.

1K image with Gemini is roughly $0.08 and only $0.01 with GPT Image.

ChatGPT Images 2.0 3 months ago

Did you enable thinking for your experiment? Are you sure you were on the 2.0 rather than 1.5 version?

Great work! There is maybe some bug. When you click on one of the 4 "opposing" countries (e.g. Czech Republic, Poland), it scrolls down and then shows that majority of the representatives from the country actually support it. Is that intended? Won't that make people from those countries "relax" even though they might have an impact by contacting their represenatives?

That issue exists with the current proposal as well or any proposal that leaves the enforcement on the website.

I think in addition to what OP said, the browser/device should let you set hard domain-level filters which are enforced by the browser/device.

This will not be ideal for applications / sites with mixed content, but gives the parent / guardian more control.

I would pay for a solution that aggregates these alternative payment systems that aren't tied to VISA and Mastercard and their rules.

Wero, RuPay, WeChat Pay / AliPay, Crypto (through 3p like coinbase or directly), etc.

And handles them in nice and unified API, with hooks for subscriptions, etc. (taking into account that some payment methods do not support recurring payments, so there should be some hook to send an email to the customer to renew manually, etc.)