HN user

xyzsparetimexyz

446 karma
Posts0
Comments405
View on HN
No posts found.

broken statistical text generation software

I find this framing very annoying. Yes I understand why leftist hacker types hate LLMs. I don't disagree that their economics is precarious. I'm also annoyed by ai boosters.

But the whole 'stochastic parrot' thing is also very tired at this point. Idk what best describes the system that is outputting all these mathematical proofs but it is at least doing more than just parroting.

I think its more a case of, when/if this kind of LLM can be run on a normal desktop then it'll become a big deal. But its also not the kind of work thats economically transformative at all

Cheap is a relative term. How many people would pay $5 to reverse engineer a device in their home?

There's no way to make a profit off reverse engineering home devices so I expect while this is likely to be one of the most groundbreaking impacts of LLMs, it won't see a ton of adoption until token costs come down.

It's fairly simple. Sell GPU compute + extra margins as only some GPUs can load the models + extra margins based on how much better closed source models are from open source ones + hopefully reduced cost due to batching

I seriously doubt that we'll be running 1TB ram setups any time soon. I was hearing about people running 64GB back in 2014 or so