HN user

vegesm

351 karma
Posts15
Comments30
View on HN

Pytorch and tensorflow is pretty big. It implies all state of the art research code is not written in Julia, so it is a non-starter for any neural network based project.

Because it only increases high single digit each release. If they keep up the 10% improvement for the next 10 release, we will reach a speedup of around 2.5 times. That's very small, considering how Python is like 10-20 times slower than JS (not even talking about C or Java like speeds).

The Long S 4 years ago

I always wondered where the integral sign was coming from. This gives a very simple explanation: it's just the letter 's', the shorthand for sum!

I don't really get the first part of your comment. You say an NN is "just" compression + kNN and does no representational learning. But finding a compression (a transformation in other words) that makes kNN feasible on the data is exactly what people mean when they say it finds a hidden representation. It is a highly non-trivial task: e.g. simple distance in pixel space between images would get you useless results.

Actually, MobileNetV3 is a supporting example of the bitter lesson and not the other way round. The point of Sutton's essay is that it isn't worth adding inductive biases (specific loss functions, handcrafted features, special architectures) to our algorithm. Having lots of data, just put that into a generic architecture and it eventually outperforms manually tuned ones.

MobileNetV3 uses architecture search, which is a prime example of the above: even the architecture hyperparameters are derived from data. The handcrafted optimizations just concern speed and do not include any inductive biases.

Back of a napkin calculation: showing OP 100 ads of blinds probably costs 0.1$ in the US. The cost of a blind is 100$ (I have no idea, don't live in the US). So if the probability of buying a second blind is at least 0.1% it was worth running the campaign.

The fact is, online ads are super cheap.

I remember my school ran a contest where you had to find obscure information on the net. Things like when the inventor of the saxophone was born? You had to submit an URL so using the library was not an option. It was insanely hard, nowadays it's just one wikipedia click away.

Why would shorting Gamestop mean making it to go bankrupt? The falling stock price of a company doesn't cause a company to go bankrupt, the causality is in the other direction. Putting downward pressure on price is useful only if you want to do a hostile takeover.

That's quite funny sentiment: basically you are saying the only reason for some people to use Linux if they are forced to use it by some library. An operating system shouldn't rely on that, if it wants to be truly general purpose.

NetBSD Code Study 6 years ago

That must have been really long time ago, I remember having no problem dual-booting XP with linux.

I think they also need the historical rules kept for whatever reporting/cross checking it is needed. So essentially they would have to rewrite the rules of the last 40-50 years.