nightski

No you don't. I use the same passkeys for all my devices sync'd with bitwarden.

It's simple, the 395+ Max Strix Halo you bought for $1800 is now a ~$4000 build (at least the AMD AI dev unit). If only we had time travel right? Either way, the Nvidia unit comes with Connect-X 7. That may or may not matter to you, but the hardware for that isn't cheap. In general the Nvidia cards also have better support for models. I know AMD is trying to catch up but anything except their datacenter cards do not seem to be getting a lot of attention.

The baseline is the market average, not 0.

I mean I pay for a domain for my homelab. No one else uses it.

Except LLMs are not stochastic in nature. Correct me if I am wrong, but it's just the final layer which outputs a distribution across the output tokens. In reality, the rest of the model is deterministic.

This is not like a bayes model or something were it's distributions all the way down.

I mean, you are using BaseUI directly... The components on top live in your code base.

Only Asus from what I have seen. Acer/Dell units seem to run cooler than the Nvidia unit, by a noticeable margin. That said I bought the OEM units for the Gen 5 4TB SSD and the fact that it was on sale.

Open source isn't really open any more. It's just pre-acquisition. I'm happy to the creators for their payday but honestly just happy I opted out of BetterAuth building my latest product.

Meta's FAIR has several R&D offices in the EU, yes. So you are saying their labs can conduct R&D on models in the EU, potentially even train them there, they just can't have production LLM inference serving or release the model weights? I'm just not seeing it.

A not-insignificant portion of the AI/ML research community is in the EU.

So Deepmind/Meta/etc... would all have to cut off their EU offices even though they hold incredible talent? I'm just not finding this scenario likely.

They had it on sale last week for $3999, it will likely happen again. Also if you are willing to buy ASUS/Acer/MSI you can get them cheaper, in the same range as well. Those units are identical (mainboard/ram/chipset/connectivity), they only tend to differ in SSD being offered.

The spark also has 128GB VRAM (same type) and by recently I mean I bought them last week for $3999 each.

I recently bought a few sparks from Micro Center for the exact same price and it comes with ConnectX-7 200Gbps inter-connectivity. Not sure how AMD feels it can charge exactly the same for less.

That intellectual property argument goes both ways. The model might not exist without protection, but it also would not exist without the data.

I'm pretty sure you could do this with an AI card as well...

Hallmark built a brand on creating generic messages in card.

When the Minneapolis bridge collapsed there were no criminal charges involved. HN has this obsession with "licensed engineers" as if it completely prevents catastrophe and holds people to the highest standards. It's just a dog and pony show.

I don't think they are in a place to deny it if they are fighting a video game launch deadline.

I'm confused, wouldn't this incentivize crunch? You could make a lot more money that way.

It's also not an either/or, You can love both. I still love coding for the challenge, but I also love the productivity benefits AI brings me when producing things that benefit people.

At the end of the day I do not put my skills on a pedestal either, I can learn from AI the same way I learn from reading open source code.

How would you classify a datacenter GPU as standard/non-standard? That doesn't seem to be a meaningful distinction. It's click bait.

I found it rather on point to be honest, it was exactly how I felt when reading the article.

Right but that could be more evenly distributed. There is a circular trade right now giving these few players near infinite resources that is blocking that from happening.

Right now, yes but I am fairly confident this will change. Not only do I truly believe we will see massive efficiency gains in inference, I also believe the cost of hardware will come down. Again Nvidia's getting a 75% margin on this hardware. Usually hardware margins are significantly smaller. More supply will come online even if that takes years.

The labs have a perverse incentive to make things as expensive compute wise as possible. The only thing keeping this somewhat in check is competition, but it's intentionally being gatekept by locking up the supply of computing infrastructure. With 3 players it's pretty easy to collude even if indirectly. They can't burn trillions forever. Nvidia's 75% profit margins are not sustainable forever.

Things will normalize, but it will take time.

It's too valuable of a tech to remain in the control of any corporation. Open models will find a way. Compute requirements will go down and there will be many of us making it a priority to transform the tech into something open like the Linux kernel vs a closed cloud tech.

Nvidia has 75% profit margins right now. That won't continue forever. It may take quite some time but it will normalize.

Very little of what made the Flash culture so fun made its way into HTML5.

AI being a product is not the future. It's more like an operating system that deserves to be open and free (aka Linux). Unless that happens we are in for a very dystopian future. I wish I had the intelligence, resources and/or connections to try and make that happen.

Anyone else fearing Anthropic more and more each day? Not from a perspective that they are doing so well, but rather that it's like an industry tornado, sucking up and destroying everything in it's path.

Why can't they just partner with these companies? Why do they have to take all these products, open source projects, etc.. and just destroy all that value?