HN user

tgrowazay

98 karma
Posts1
Comments60
View on HN

Only when large group of people die and have to be switched to another timeline via quantum immortality.

This person died independently. Welcome to our timeline!

Yes you can, but usually:

1) installing a k3s is just one of the things you want to do with a fresh server, so you can have all of the things bundled as a ansible playbook and k3s will just be a step in it.

2) often you want your infra as a code and be reproducible

You won’t get shot down for merely taking off without a transponder.

Worst case scenario a fighter jet will be scrambled to investigate.

But in apocalypse scenario, chances are the fighter jets will be busy with tasks other than enforcing FAA rules.

$10/month was a too good of a deal.

The plan is to normalize spending hundreds/thousands on tokens per month for the productivity you gain.

See Jensen Huang’s comment that every $500k developer should spend at least $250k worth of tokens per year.

By this logic, Linux should switch to closed-source.

All your servers are Linux, so imagine how insecure you are - must switch to windows ASAP.

My daughter’s classmate’s father is a head of a non-profit hospital.

They have a 6k sqft house with a basketball court, pool and a pool house in the prime location in West Los Angeles.

They had to join two lots to build to their liking.

It is a bit different. What happened to openclaw:

He created a new org “openclaw” to reserve the name. Then he wanted to swap it with “moltbot” org.

So he opened two browser windows, one with “moltbot” repo settings another with “openclaw” repo settings.

Then he renamed “openclaw” to whatever, and quickly tried to rename “moltbot” to now available “openclaw”.

But in a second when “openclaw” was available, a bot snatched the repo.

I think Meta’s AI strategy is to advance AI/ML that is beneficial for them, no more charity.

They need a good-enough LLM (llama) to cut content moderation costs, they need a good segmentation model (segment anything) for photo filters, AR/VR and photo/video content moderation.

For LLM frontier, they can wait it out to see AGI become a commodity they can buy after it is ready.

M5 Pro supports up to 64GB of unified memory with up to 307GB/s of memory bandwidth, while M5 Max supports up to 128GB of unified memory with up to 614GB/s of memory bandwidth

Which roughly translates to 30B Q8 size LLM at 10t/s for the M5 Pro and 60B Q8 size LLM at 10t/s for the M5 Max

For reference, RTX 3090 24GB has a memory bandwidth of approx. 936.2 GB/s, DGX Spark 128GB features a unified memory bandwidth of up to 273 GB/s

Self-hosted 8xH100 is ~$250k, depreciated across three years => $80k/year, with power and cooling => $90k/year (~$10/hour total).

AWS charges $55/hour for EC2 p5.48xlarge instance, which goes down with 1 or 3 year commitments.

With 1 year commitment, it costs ~$30/hour => $262k per year.

3-year commitment brings price down to $24/hour => $210k per year.

This price does NOT include egress, and other fees.

So, yeah, there is a $120k-$175k difference that can pay for a full-time on-site SRE, even if you only need one 8xH100 server.

Numbers get better if you need more than one server like that.