p1esk

It’s nice to be rich I guess

where do you see "twice the memory bandwidth"?

There’s noticeable accuracy degradation when they switched from fp8 to mxfp4

That’s how you get skills

Do a decentralized p2p one

We’re experiencing gpt-2 moment in robotics now. This means in about 2-3 years they will do useful work (cooking, repairs, cleaning, etc).

It’s got to be similar to Fable, which I experienced for 3 days, and which impressed me (compared to Opus 3.8)

VLAs are new LLMs. Give them 5 years to develop. But even good old LLMs are still improving every six months.

Unfortunately if your manager thinks something is your problem, it becomes your problem.

You realize llms as a field is barely 5 years old? Give it at least another 5.

Many people here spent a lot more than $300 on headphones long before AirPods appeared.

100×10^15 km

Do you feel that recent advances in AI can speed up such rare disease research?

I’d also like to read about your experience.

we are very far away from curing death

That’s fine - we just need to find a way to slow aging and wait until science advances. Strictly speaking we just need to find a way to keep our brains alive and stimulated, not the whole body.

Where do I sign up?

Do you mean Facebook to Yahoo?

Why can't I want both earning 1B and do good things for the world? Unless his diary directly contradicts what he has said in public (like "I don't care about money"), I see zero moral issues here.

I struggle to imagine how would something like that form, function, or become powerful enough to matter. Do you have any examples of such coalitions?

Don’t you think a far bigger threat to democracy is that government allows this influence? And voters seem to be perfectly OK with both 250M campaign contributions and widespread lobbying?

Other than researchers

Are you saying researchers are less interested in quality of life than other people? If this was true, frontier labs wouldn’t need to offer 7 digit compensation packages to their researchers.

We already have two such coalitions within Congress: Republicans and Democrats.

How is that working out?

The point is that modern CPUs are not as slow as most DL people think. Roughly 10x slower but with a lot more memory.

Even if you could achieve that, there would still be rich people. Musk would still be a billionaire even if he had to pay 90% tax.

Plus, many powerful people in government are not that rich.

To do that you first need to become more powerful than those powerful people, right?

We need to not have powerful people

What does this even mean?

No one in their right mind would use pure Python to do matrix multiplication. It’s like using a screwdriver to hammer nails into wood.

But this discussion is even more bizarre than comparing a screwdriver to a hammer, it’s like comparing a screwdriver to a nail.

Here’s a great book explaining microprogramming from ground up: https://www.amazon.com/Computation-Structures-Optical-Electr...

Easy to find a free pdf

Intel Xeon 6980P: 128 cores x 1024 FP16 FLOP/cycle/core x 3.2 GHz: 419 TFLOP/s

Theoretical FP32 performance of AMD EPYC 9965 is double that of A100: 41.2 TFLOP/s vs 19.5 TFLOP/s