HN user

purplepatrick

70 karma
Posts2
Comments73
View on HN

Commenting wholesale on some folks who are asking for hard evidence. I cannot provide that either but can contribute some empirical data.

I have been working on a project with about a dozen generation tasks, each of which comes with a fixed token budget. The nature of this system requires that most tasks be completed by distinct model families.

As a result, I tested ~50 models across as many model families as I could gather, frontier and open weight, API (gateway and direct) and self-hosted. Evaluation was based on a set of cosine similarity validations that was repeated across ~50 different embedding models.

Interestingly, frontier models did worse on the tasks than open weight models. However, when it came to costs, the picture was reversed: frontier models were much, much more token-efficient. In fact, almost no open-weight model was able to meet the initial token budget, while almost all frontier models did. Moreover, open weight models struggled massively with reasoning, in terms of latency and token consumption.

I also found that the latest models did not perform better than older models. And any a priori benchmarking data was utterly useless.

So, I ended up using a set of open weight models without reasoning, as it turned out reasoning as well as frontier negatively correlated with the tasks. However, before I knew this, I had spent a lot of time running each available reasoning level for each model.

Lastly, as an aside, when it came to embedding models, size (dims as well as model size) did not correlate with quality, once a hurdle figure (~2k dims) was met. In fact, sweet spot was 3-5K, and for my (text-based) set of tasks, dense models tended to outperform MoE ones.

Good article. Appreciate the bread (machine) analogy.

One thing to add: software maintenance costs. The build has never been the bottleneck.

The notion that most companies will suddenly institute developers to build all kinds of software inhouse and maintain it is silly. Most companies are not google et al, even in 2026.

The insurance industry built almost everything custom in the 70s and 80s, simply because that was the only option. The more software became commercially available elsewhere the more this effort was pruned back.

Another thing: knowing what to build — another big bottleneck. Most people cannot articulate what they want and even fewer can articulate it at a level that would enable them to build durable software, even with AI. Case in point: the majority of AI-built stuff you see are point solutions or small productivity items, etc. “Systems thinking”, as some people call it, is hard, even for most software engineers.

Yes, you can “rebuild” tools you’ve previously purchased as SaaS but at some point you gotto use your brain to come up with something new. Systems thinking on blank-page challenges is even harder…

These articles on using AI for writing are all very binary. You can use AI in a variety of ways when writing: improve grammar, correct typos, better organize ideas/concepts/sentence structure/sentences, and dozens of other “how applications (as opposed to “what”).

It’s not like people feel the need to explain that they used a spellchecker or thesaurus or googled the correct use of an idiom, etc.

There seems to be a general need for some people to dunk on valuable AI use by refusing to acknowledge that there are a many ways to use a tool. (Similar story on using AI for coding.)

Echoing a comment from above, why would I care whether a sentence was formulated by AI or John or a ghostwriter or John who asked Jane for feedback before rewriting? I care about the content. If I don’t like the way it’s written or if I’m irked by how it is written (ooh, an emdash — how embarrassing!) then I don’t need to read it.

Personally, I’m much more annoyed when I click on an article that sounds interesting, and the author tries to show off their penmanship by starting with five pages of “a history of X” or a tangential but redundant personal story before getting to the point. IMHO most non-fiction writing on the web could be accomplished in bullets. But again, that’s just my very personal preference…

I keep seeing articles like this that extrapolate from token pricing onto token costs. This is wrong.

Companies don’t sell their goods/services at cost. A model’s being priced at, say, $30/M for output tokens doesn’t say anything about what it costs the company to provision the 1M tokens via the model.

And no, you cannot extrapolate from any company margins that someone may have overheard in an SF coffee shop onto individual product line margins or their trajectory either. This information is usually unknowable even in most SEC filings for public companies.

It’d be great if people who wrote these articles used, say, AI to look up some basics on how a business operates. It’s really easy to do, believe me ;)

SaaS’s competitive advantage is not tech but distribution.

Just because the stock market dips, and a bunch of media outlets ascribe this to AI doesn’t mean that AI ‘caused’ the dip.

If people really think non-tech businesses will start running their own software organizations and maintain all these tools themselves is an idiotic assumption at best.

The “building” of software has never been and will never be the bottleneck.

I’ve found that task isolation, rather than preserving your current session’s context budget, is where subagents shine.

In other words, when I have a task that specifically should not have project context, then subagents are great. Claude will also summon these “swarms” for the same reason. For example, you can ask it to analyze a specific issue from multiple relevant POVs, and it will create multiple specialized agents.

However, without fail, I’ve found that creating a subagent for a task that requires project context will result in worse outcomes than using “main CC”, because the sub simply doesn’t receive enough context.

As someone mentioned already, list prices are completely fictitious. Their purpose is to anchor medical payers during reimbursement negotiations and satisfy PBMs (see below). The allowed price (the price that the payer pays to the drug company) is much, much lower, 70-90% or so in many cases. Thus, juxtaposing OTC and list price is not an apples-to-apples comparison.

That being said, US drug prices are 2-4 times higher than they are elsewhere. In fact, the US market essentially subsidizes international drug markets, where it is much more difficult to charge higher rates due to regulations and lower purchasing power. This also means that, even if the allowed price in the US were known in this example, it would still have to be PPP adjusted to be compared.

Prescription card coupons such as those you get from GoodRx et al apply only to cash prices. These are sometimes lower and sometimes higher than what you’d pay out of pocket with your insurance. to compare, you’d basically have to ask the pharmacy to ring up a drug twice, once with cash price + coupon and once with insurance price.

“Copay assistance” are programs by drug manufacturers, PBMs, or employers to defray the cost of drug prices. This is usually done for specialty drugs that are much more expensive and can often only be purchased from a mail order pharmacy designated by the payer. For example, United Health (left pocket) will only cover the drugs if you get them from their Optum Specialty Pharmacy (right pocket).

As for numbers, here an example: I’m receiving a monthly specialty drug that my insurance is billed ~$9,000/month. In order to arrive at that figure, the drug company proposed, say, a $50k/month list price, and my insurer countered with $9k, using the size of their member pool as leverage. Of course, the drug manufacturer knew they would arrive at approx that figure, which is why they started negotiating that high. Well, sorta. The PBM gets compensated based on a % of the “savings” (spread between list price and final price), so naturally, they want as high as possible a list price, because 5% of a big amount (in my example: $50k-$9k = $41k) than 5% of a smaller amount. Because the PBM often has most of the leverage, the drug manufacturers (most of whom actually dislike PBMs) have to go along with this stupidity.

How much of the $9k I pay depends on a variety of factors, including my insurance plan, which has a specialty drug tier. This means the drug is not handled via the cost sharing accounting mechanism (deductible/copay).

Now, through that specialty tier, my monthly responsibility is set at approx $1,300. I’m not privy to the math behind this, because my insurer has outsourced all drug-related administration to a PBM, which is only loosely regulated and doesn’t even have to issue explanation of benefit statements that would normally disclose the full accounting.

Of the $1,300, I pay nothing, because the drug manufacturer provides me with a copay assistance card. Again, they must keep the list price high to placate the PBM.

I’ve simplified a few things here. For instance, there are now alternative comp models for PBMs. But for those, PBMs have also found ways to manipulate the system in their favor (eg colluding with drug manufacturers). There’s also often a wholesaler involved in the “value” chain.

But by and large, this is roughly how it works…

And yes, individual market plans are substantially inferior. Not only do they have lower actuarial values and higher cost per $ of coverage (which is unavoidable, because they are not risk pools) and narrower networks, but they also usually have built-in mechanisms to further prune away coverage in many subtle ways (they have that in common with self-insured plans): - more prior approvals, - “step therapy” (must first not tolerate cheaper drugs before can receive pricier drug), - not covering the pricier drug tier at all, etc.

These things shave some dollars off the premium, which appeals to price-elastic consumers and employers.

It may not be a sustainable business with current business models. But if cures came with a "post-scription" model where the cured patient paid, say, 0.5% - 1% of their income to the drug company in perpetuity, then incentives are aligned. (Of course, administration is a problem here.) As someone with an incurable disease, I would happily pay for a cure in such a way...

Operating Margins 8 months ago

Thank you! I was just about to rant about this and decided to scroll to see if anyone had already called this out.

The article is quite embarrassing - it’s ok if you don’t know how P&L statement and balance sheet work, but writing an entire blog post without ever feeling the need to verify basic terminology is either very lazy or very ignorant…

I would prefer no rewards. Rewards transfer wealth from poorer people to wealthier people, because the latter spend more absolute dollars on rewards cards. This regressive effect is a big turn off imho in addition to the stupid points optimization games that rewards card owners have to play.

IrfanView 2 years ago

My dad introduced me to it after he started using it when it came out in 1996. It’s great, quick image editing. My only gripe with it is that cropping is unnecessarily convoluted…

Dead Man's Switch 2 years ago

I’ve been using DMS for years and think it’s excellent. It’s not a hassle at all: once a month, I get an email and all I need to do is click on the link in it. That’s it.

Also, I use it to email only one designated person who receives an email with a password hint to an encrypted folder containing all my important stuff in life such as passwords etc.

OPT hires are easy. You’ll just do an at will contract as you would for any employee or consultant who’s not a foreigner. In other words, nothing needs to be filed or done by you.

The only caveat is for the OPT graduate (I assume your friend is no longer in school). They will lose time against their OPT allocation that they could otherwise save.

That being said, it depends on the details of their OPT and the kind (pre / post completion, etc) at which rate their remaining time in the US gets deducted when they don’t work. You can look up the details online.

This means your fiend needs to evaluate whether it may be potentially better to be able to stay in the US longer and not work vs. working for you and getting something in their resume but that work time may potentially deduct from their OPT allocation faster.

Not a lawyer, just a former student who worked in OPT a few times. This stuff has changed since I went through this so don’t take my world for it. What has not changed much is that OPT is pretty easy for employers (as opposed to, say, a visa) - because that’s the point of OPT.

I just want any map provider to make the compass feature work reliably and easily visible. That’s all I want. But for whatever reason both Google and Apple seem incapable of doing this. I’m puzzled…

Hmm. So, we don’t know if working and short term memory are even the same thing. We also cannot say for sure that the same type of processes would be handled by short term and long term memory, so it’s not clear that you can substitute one for the other or for the same stuff. Both memories could just be feeding working memory and other structures for processing but serve different things.

It also may well be that the opposite is true — STM is prioritized by people who haven’t learned to properly recruit for profound structures. Speed may well have been a survival advantage a million years ago, but it’s not clear that this hasn’t changed since.

We also don’t know if the computing model of the brain is even appropriate at all. Humans have always assumed that the latest state of technology can represent the brain: clay and waterworks, mechanics, computers, etc.

At the end of the day, we don’t know how much we actually know about how the brain works because we don’t know what we don’t know…

Only saw his opening remark and was immediately tuned off by the fact that he announces his opposition to classic liberal ideas and education, while getting his Greek and Latin syllables as well as their meaning confused. Classics 101, dude…

Sounds like you don’t wanna do it and are just looking for confirmation of that. If that assessment is incorrect and you do wanna do it, then what are you waiting for? Get going and do the great job you suggest you’d be doing. Being neurotic on HN isn’t gonna build a business ;)

Yeah, I have personally made that experience and received the same feedback directly from hiring companies and headhunters.

A close friend of mine had to emigrate to another country after successfully exiting his startup with tens of millions in the bank. Top recruiting firms in the US didn’t know what to do with him and considered him not “specialized enough” for the US market.

Other markets such as Europe hire very differently. There, employers aren’t necessarily looking to fill narrow roles with “bandaid employees”, but want people to have breadth and grow within the business across future roles.

In fact, this is precisely the feedback I also got from a top headhunting firm where I worked with the head of US tech recruiting and the EU counterparts.

Put differently, the “founder penalty” isn’t as much of an issue overseas.

I’m still baffled by it…

You’d have to ask a tax attorney, but this exact scenario happened to a friend of mine who held his equity through a foreign entity. When he wanted to cash out, he was hit by an extra US tax penalty specifically for when you hold your equity through a foreign entity.

I was in the same boat as you when I started my company and looked into the same kind of setup. I researched it at the time but cannot remember the details.

The answer is No (as you can easily confirm by googling this). You should hold the shares personally.

Holding your shares through a US entity is not an advantage. Holding your shares through a foreign entity will cause you to get penalized if you continue to remain a US tax citizen.

The only situation where I could see an advantage would be if shares were held through a foreign entity and you hold them there (without an liquidation event) until you have surrendered your greencard and no longer meet the substantial presence test for US tax purposes and the resulting tax situation for you would be better than it was when you were a US citizen for tax purposes.

For example, if you held equity through, say, Malta, Panama, or the Caymans and you leave the US permanently, surrendering your greencard, and become a resident of a tax-advantaged jurisdiction for long enough that you are no longer taxable by the US, and only THEN your company exits, generating capital gains that could/would be distributed to you would be tax advantaged.

Appreciate many of the points made in there. However, I still don’t see why intelligence should make one happier, and why when we don’t observe that in data it should be worth mentioning.

I grew up in a culture that did not talk about being happy or cared about objectifying happiness in any way. In fact, we don’t even have good words for it that would be separate from other notions. Growing up, I only ever experienced people talking about if they were healthy or satisfied or enjoying life.

This is a long way of saying that perhaps, it’s not only about calling out the vagueness and ambiguity of “intelligence”, but about considering that the term “happiness” also deserves the same degree of scrutiny. It, too, lacks a clear objective definition and comes with a lot of subjective and cultural ambiguity.

Maybe asking why one ambiguous undefinable thing doesn’t cause or correlate with another ambiguous undefinable thing is a futile statistical exercise to begin with?

Not sure I can add much to the answers below but will try.

You are not going to be able to increase your quality of life above that of Germany by moving closer to the equator, at least not by most general quality of life metrics.

However, it sounds like you are specifically looking for the combination of sun + lower cost. In that regard I’d look at the following. Keep in mind you will likely end up moving back to Germany eventually from most of these, be it because you require health or elder care or certain educational opportunities for your kids if you have any.

Panama, Nicaragua, Ecuador, Costa Rica, Malta, Malaysia, Bali, Spain & Baleares, Portugal.

If you’re willing to compromise on the “sun factor”, I would take a closer look at the following:

Austria, Slovenia, Estonia, Czech Republic, South Korea, Taiwan.

It sounds to me that you also want a country where you get by in English and/or German easily. That should narrow down the first list above quite a bit.

“ The total power draw in a "stage 3" system like this could get as high as 1.38 gigawatts”

New York City uses ~11MWh per day (i.e. a capacity of 458 MW). This means the above would amount to ~3x that usage. I don’t know much about this and may misunderstand something here, but this seems infeasibly high for a mobile system, no?