HN user

r0b05

293 karma
Posts1
Comments192
View on HN

They are out of Ampere cloud instances as well. Where is a good place to get Ampere instances with similar cost and stability?

It would be more interesting to know how many simultaneous users this setup can serve. Otherwise I can just say it serves 500 users but not all of them use it at the same time which doesn't communicate the right level of detail.

It's an interesting point but local gpu efficiency is not something I think about when I'm being rate limited or when my subscription costs keep rising.

Yeah, the space moves so quickly that I would not want to couple the hardware with a model that might be outdated in a month. There are some interesting talking points but a general purpose programmable asic makes more sense to me.

I know right, it looks like they basically sent him to OAI and I'm sure Altman knows it!

One thing I will say is that this competition is good.