HN user

cheema33

1,620 karma
Posts0
Comments611
View on HN
No posts found.

how is running servers supposed to be 0 cost, while running ai inferrence isn't?

For a SaaS business, running servers isn't free. But compared to the cost of running GPUs for inference that you are selling, it almost is. The company I work for is a SaaS company. We have a single production server. A couple of QA servers. All hosted on Hetzner. Monthly cost for servers is less than $400. This generates a few million dollars a year in revenue.

If we were in the business of selling inference, our cost of providing the service, for the same amount of revenue would significantly higher.

Even large businesses like Microsoft, Meta, Google have operated with similar margins. Cost of running servers, compared to revenue was very low. But inference changed that, in a dramatic way.

Podman v6.0.0 21 days ago

I have switched on production and QA servers. I used AI tools to help with the migration. Easy peasy. On the desktop, I am still using docker. Old habits die hard. Eventually I plan to switch on the desktop as well.

Podman v6.0.0 21 days ago

Agreed. My first thought after that page loaded was, "why is this page harder to read?"

I’d argue that this is more of a question of ‘do I need offline support?’ For Slack, sure, but for many apps, probably not.

I like offline support. I enjoy it when an app I use supports it. And I want to add support for it in my own app. But, it is a hard problem. And to the best of my knowledge there is no framework or library that that solves the hard problems for you.

I tested Fable through Cursor;

I tested Fable for a whole day. And my experience was quite the opposite. I was blown away. Admittedly, I did not try it through a middleman like Cursor. I used Claude Code CLI.

I recently moved from Obsidian to a self-hosted Outline. Primarily because I needed an easy to use solution for sharing a knowledgebase with the team. Obsidian doesn't do team. Notion appears to, but Outline fit the bill so well, and was free. It has an MCP server, just like Notion.

I do wish that there was a way to provide filesystem level access to the markdown files to an AI agent. I think that might be faster.

I have the RAM, but not the VRAM. What kind of speed/tps could you expect from a 3090 with 24GBs of RAM? I am somewhat tempted to pick a GPU with 24GBs of RAM.

I got pressure from the CEO saying it wasn't reliable to host our own infrastructure anymore even though our total internal down time over the last 5 years is significantly less than even a single of the larger recent AWS outages.

Same here. My job as a software dev does not require me to self-host services we need and use. Quite the opposite. But, I am reluctant to hand over all control to AWS or equivalent for several reasons that I will get into here.

I have found that Infrastructure as Code (IaC) and modern tools like opentofu, ansible, combined with frontier AI models and harnesses gives you superpowers in this space. Almost all of our self-hosted services are fully managed by these tools. e.g. We perform backups and test them more often now than we ever did before. Entirely because it is so much easier to do all of that now.

but now what characteristics do they share that some american cars don’t have?

The difference is quite big in my opinion. When given the option to pick a Japanese vs American vehicle for about the same price/features, most people will pick the Japanese vehicle. American vehicles have improved over the years, but quality and reliability are generally better for Japanese vehicles even today.

AKA what Relay does out of the box haha...

Relay does optimistic updates well. However, frustratingly, Relay does not do any persistent caching to disk, like Linear does. This means, first page load will always have to fetch data from the server.

Can't you simply ask codex in another tab to just do a code review?

You are likely to get better results if you do not use the same model for review that wrote the code. I typically use Opus for code editing and GPT 5.5 for peer review using an automation with skills.

Training set is different between models. If there are gaps in coverage in one model, you want a different model reviewing the work. The second model will its own gaps, but the gap list is not identical.

The ball is right there, bouncing alone in front of the goal

Their pitch is not to you, the dev. But, to the investor class. We are in this funny place in the market where you can make more money by catering to the investor class than to customers. In other words, an upside down world.

I would love to be able to get text alerts when an event occurs, from a location that is not connected to the Internet, about a mile away. The need is not critical, so there is no desire to spend money every month. And reliability of the solution does not have to be high either.

Something like this might work?

I fail to see how this is specific to a crypto company.

It is not specific to a crypto company. But the element of it being a crypto company cannot be ignored. Crypto companies are not like ordinary businesses. They have very unique qualities to them. Same with crypto industry as a whole. Ever been to a crypto conference for example? I have read about and have seen the videos. These things have the highest concentration of the scammers and the gullible any one place.

Lol what? You seriously think that the #1 Chinese AI company is not being subsidized by the Chinese government?

There are providers in the US who are offering Deepseek API for the same price. Is the Chinese govt. subsidizing those people too?