HN user
for those curious, regarding your first point, as far as I know any home that is dark red on this map has access to it, and any light red is planned to get access: https://ftth.init7.net/
I dont buy that, mainly because in blind tests where people dont know which model was used and choose a result, this does not seem to hold true
I find it difficult to compare LLMs in general. It will do better in some cases, worse in others. As far as I see it, most of it is marketing. You can try it out extremely cheaply though through their API and OpenCode. I personally would recommend it.
I would not call them idiots personally, they are just facing an extraordinary difficult situation with their open weight competition that's almost impossible to fix. They will have to aim for the high-end B2B market eventually, and attempt to lock out their competition through regulation or other means
I was wrong, I thought they would only go for B2B already. But instead they will remove it from the subscription and price it at 50$/mtok. Compared to GLM-5.2 for 4.40$ that's quite a gap
Probably not. But I also cant imagine the hardware not improving. Also there is surely a sweet spot regarding price and quality. I have strong doubts that much larger models will give much better results, which is not like disk space where every additional bit makes it one bit better
thats true. also, I watched the glm prices and it didnt take long before the prices dropped even lower for some providers. its like another layer of competition between hosters
I am quite certain that it is delayed on purpose to maximize the gains, but at some point some company will see the huge demand for local ai and will want to eat the cake (given that it is feasible)
thats pretty scary to me. what will the data centers be used for if people run that stuff offline? maybe new models? but will there even be any demand? I guess we will see
I feel like the gap is closing to be able to run good enough models locally even for coding and I would assume it could make some companies a bit nervous. Am I wrong about that?
best for who? for the cloud provider for all the vendor lockins? theres hardly anything i like about the popular cloud providers to be honest
its a big assumption that larger models bring any measurable benefit in the long term. there's a point where its not worth paying the expense of a bigger model and we dont know where that will be as both, models and hardware improves.
we do know however where evolution is at right now with our brains, but thats probably not comparable - yet the only thing I can see to make any kind of prediction at all
I'm pretty sure that's not linear, so I personally expect the benefits of larger models to diminish. The question is at what point that's the case. I guess a lot of variables play into it, but it is possible that the benefits of running larger models will be too expensive for the little benefit they provide
I personally believe that eventually manufacturers will want to sell more of their hardware and look for ways to sell hardware to consumers. isnt that situation quite similar to the days of early computers? I am for sure biased in hoping that will be the case
unfortunately the history of these big tech companies has shown that they do not care about data privacy and are even willing to lie about it. but I guess its irrelevant, in practice you have to assume the worst anyway since there is no way to verify it
I am personally okay helping them as long as they publish the models and dont keep them closed. And I dont trust the settings where providers say they wont train on it.
They're further from Communism than they've ever been since the PRC was founded. The gap between rich and poor is growing there, not shrinking.
I suppose it depends on what time frame you look at, it's shrinking since 2010, but inequality rose more than that in the 80s: https://www.theglobaleconomy.com/China/gini_inequality_index...
However, that's not my point - I did not mean to say that they are going to be successful but rather that it still appears to be a long term goal for them.
Like Bitcoin, freedom of capital flows may be restricted, but the wealthy seem to be evading these restrictions with impunity.
I don't know about that, without any source of data I guess I just have to take your word for it. I would not be surprised if you were right in this case though.
it's not necessarily capitalism, I personally believe any system that drives progress would cause this in one way or another. My prediction is that birth rate decline will accelerate further. There's going to be some kind of universal basic income in many places, such as Ireland made for artists. However, it probably will not be enough to feed a family, and therefore we will see birth rates decline further. It's because we evolved to prioritize resources over reproduction and we are becoming more efficient, which means less people are needed to sustain the same amount of resources
The one-child policy died a long time ago.
true, but as far as I understand it did because birth rates got too low. so they replaced it with a two-child policy and later with a three-child policy
Also, the accumulation of wealth by connected politicians and businesspeople flies in the face of what communism is supposed to stand for.
Yeah, I am sure there's a lot of cases for that. But as far as I know the amount of billionaires has started declining in China, and I don't see how that means that they as a country moved away from the goal, it just means there's issues
There is a reason real estate values in popular cities has skyrocketed, and it’s not due to the locals getting wealthier.
I don't know about that, you could be right. A google search for real estate prices in china reveal a lot of news articles how they are going down though.
It’s where Chinese and other oligarchs put their ill-gotten wealth (well, besides Bitcoin).
Wouldn't be surprised if rich people in china invest in real estate. They don't have free capital flow, so its not easy to invest abroad and it becomes an obvious choice. Bitcoin is banned in China for that reason too
But again, as far as I know that does not mean the country moved their goals of trying to reach communism one day
mythos is a mythos
workers seizing the means of production is by definition socialism and not capitalism though, that's the whole idea behind socialism
I dont think thats right, the models and the gpus are the means of production.
in capitalism the people with the capital get the profit, not the people who do the work. however, workers are said to benefit too through their salary, just less so
to support the companies that open source their models
what makes you think that china ever gave up its communist goals? I personally see that everything they do aims towards that goal. From the one child policy, the huge amounts of empty apartments they build, the stuff they produce for almost free, the fishing.. open sourcing the models perfectly fits that culture too, it's the means of production
yeah, that's true, a lot of stuff refers to it as a federation
is it though? I guess it depends on the definition you use. The line between federation and confederation is rather thin, and I believe those terms were historically even used as synonyms. Switzerland is at least called Confoederatio Helvetica, but you could probably argue it's a federation due to the centralized government. But then we also have to keep in mind that the sovereignty and the power of the country stays with the people and the cantons, and not the central government due to it's direct democracy.
I can share what we do, it might not suit everyone though. We manage the devices through ansible-pull, and we have a small Prometheus metrics exporter on the devices for what I think is good to monitor. Then we have a grafana dashboard, alerts and so on. This suits us because we can manage the servers as well as the devices with ansible. Most users don't have root. If anyone needs help, the person needs to be in the wireguard vpn and the someone helping can ssh into the machine.
There's also fleetdm, which we are not using, but might be something you want to consider
right given the product names I assume you are on windows. with kerberos people shouldnt have to type their passwords into apps at all, and if you use pkinit there are no passwords at all?
i give you the mobile part, I dont know how well it is supported - iOS claims to have support though, and android through third parties I believe. Never tried that. Its just that I personally have a preference for auth methods that dont require opening a browser for desktop apps
if you dont mind asking, what dont you like about kerberos? I personally like it quite with certs / hardware token
to be honest, most things you list can be setup with some research. The only one I am not sure about is integrated storage, but then I am also not entirely sure what that even is supposed to mean exactly