jpau

Standard pricing is showing for me as $1.50 / $9.

(I suspect you're viewing the "flex" pricing).

For venue recommendations [...] we do not rely purely on the language model. We embed both user requirements and venues into vector representations and retrieve candidates using similarity search. Hard constraints such as capacity and dates are applied first, and results are ranked before being presented.

Huh this surprised me as a forgone opportunity.

I heard second-hand about the process for organizing our last offsite. Searching for venues was not the time-consuming part.

The time-consuming part was actually engaging with the venues to confirm specific details not available online. Our teammate who did this engaged with _hundreds_ of venues. It was a lot of work on their part ... and probably not the most fun part of their job.

That seems like an ideal agent scenario?

Interesting that this was released without a prior GPT-5.3 release. I wonder if that means we won't see a GPT-5.3?

Hey we're also a Vertex tuning customer in a similar spot. We're seeing other capacity issues, although not a leap in latency. Can you DM me? I'd love to trade notes. https://x.com/hellofromjames

I love Cerebras. I also love that they've started to scale rate limits to useful levels (which is relatively new).

I still don't know how long they'll support our chosen model.

On Oct 22 I got an email saying that

```

- qwen-3-coder-480b will be available until Nov 5, 2025

- qwen-3-235b-a22b-thinking-2507 will be available until Nov 14, 2025

```

That's not a lot of notice!

I don't want to spend all my time benchmarking new models for features I already built. I don't want my users' experience to be disturbed every few months.

A URL shortener that runs a lightweight model (gemini-1.5-flash)

I think gemini-1.5-flash is EOL'd from tomorrow (Sep 25th) https://cloud.google.com/vertex-ai/generative-ai/docs/learn/...

RIP gemini-1.5

Google[1] also has a "long context" pricing structure. OpenAI may be considering offering similar since they do not offer their priority processing SLAs[2] for context >128K.

[1] https://cloud.google.com/vertex-ai/generative-ai/pricing

[2] https://openai.com/api-priority-processing/

Interesting!

Is there anything to read into needing twice the "Avg Attempts", or is this column relatively uninteresting in the overall context of the bench?

Seems to be a nod to each size being treated as their own product.

Claude 3 arrived as a family (Haiku, Sonnet, Opus), but no release since has included all three sizes.

A release of "claude-3-7-sonnet" alone seems incomplete without Haiku/Opus, when perhaps Sonnet is has its own development roadmap (claude-sonnet-*).

Sorry to hear the challenge.

You and your friends should email me with your resume and anything you're proud to have built. I'll extend that to any MIT senior/recent grad who wants to discuss moving to SF and helping us apply LLMs to build product features that solve interesting customer problems.

I'm at james.peterson@fathom.video. Include "[responding to HN thread 43614795]" in the title. I'd love to chat.

I am grateful for GCP's quotas that help us prevent similar own-goals.

While this specific error is something we know to avoid, I'm sure quotas have helped us avoid the pain of other errors. So I'm somewhat sympathetic.

I think it's important to read the language of and judgements in the post in the context of someone who just got a large unexpected bill (expensive lesson).

I use screen.studio

I noticed Anthropic updated their prices, but haven't seen this posted anywhere.

Claude Instant is now 10% of Claude 2's pricing: $0.80 per million input tokens, and $2.40 per million completion tokens (down from I think $1.63 and $5.51 respectively).

Altman mentioned[1][2] earlier that they were working on a "stateful" API for release this year.

2023: A stateful API — When you call the chat API today, you have to repeatedly pass through the same conversation history and pay for the same tokens again and again. In the future there will be a version of the API that remembers the conversation history.

Maybe it's an RAG-based thing, but that'd be underwhelming given the promise.

Wizard of Oz, or true magic?

(In the same interview, Altman also claimed progress toward releasing million-token context windows this year. Wowzers)

[1] https://humanloop.com/blog/openai-plans, removed at OAI's request

[2] Archived at https://web.archive.org/web/20230531203946/https://humanloop...

Replacing them with null seems like a weird decision (that hopefully they will iterate on).

Can anyone suggest why they might have chosen null and not a wkt/text cast?

I was seeing 500s, but it seems back for me now (Melbourne, Australia)

Inflation means tomorrow’s money is worth less; it impacts cashflows more when they are further out.

When the cost of money is near-zero, today’s values of near and distant cashflows are similar. When the cost is high, they are very different.

I’m not sure if you mean in your question that a project shown to track inflation will be unaffected. This is somewhat true — we see this in inflation-adjusted bonds etc. But inflation is far from a uniform effect, and I’ve never seen a pitch include inflation in its estimates…