nbraem

This is because currently deep learning is not a science, but engineering. There is no underlying theory why deep neural networks generalize as well as they do. Classical learning theory (VC) actually states that large models with millions of parameters should not work.

There are some academics working on this, but it pales in comparison with how much money is being poured into generative AI.

So today's state-of-the-art models are trained with trial and error, and experts who are building some intuition why some methods work and others don't.

That is, if you leave the storage cost of the nuclear waste for the next 100.000 years out of your business model.

A dice is rolled and you're born in the world in some country, borders drawn on a map centuries ago by a person from another country. A world sliced and diced by imaginary lines, making groups out of people that in the best case share some common "culture". You are saying that in this world, everyone needs to live in the little territory that they were born?

You're absolutely right, I moved to Belgium a few years ago from SV. The only way to make a decent salary, is to become self-employed.

I thought a lot of compiler and kernel research came from Europe?