hallqv

They promised us super intelligence - all we got was valid json

How does it differ from Poetry

E.g. msnbc, New York Times, cnn

https://arxiv.org/pdf/2402.00841.pdf

This discussion is so dumb - finetuning a base model costs ~$1 with LORA/QLORA and can yield same performance as gpt-4, but at 1/100 of the cost per token.

What Bloomberg did for $10M was not finetuning..

lol Emad was always seemed like an obvious fraud to me. Not quite SBF level but same vibe. Whenever someone goes overboard on the nerd look it’s always a red flag.

The incumbent US car brands barely does any manufacturing themselves anymore, they are mainly big procurement + assemly + marketing blobs.

Not very conducive to driving product innovation.

Afraid of what..? What’s the risk?

Whoever is dumb enough to invest in a company that hasn’t even bothered to come up with their own company name, but just copied the name of the current most hyped competitor in their category, deserves to lose their money.

Depends on your definition of winning - special-purpose tuning is vastly more cost effective since it allows you to train a smaller model that can perform specific tasks as good as a bigger one.

A good analogy is building a webapp - would you prefer to hire a developer with 30+ years experience in various CS domains as well as a PhD or a specialized webdev with 5 years experience at a tenth of the rate?

Gary Marcus is not a serious person

If I had a penny each time a human has confidently concluded something that is entirely incorrect… I’ve inadvertently done it countless times myself, and so has every person I know of.

What you are talking about I would call guessing :)

Fact of the matter is that sota LLMs are highly accurate predictors for many topics, certainly above any living human in terms of total AUC of correct predictions on fact based questions. Some humans are better on certain topics, but noone can match total AUC since LLMs has such breadth.

You must have a very peculiar definition of a hallucination.

Why would an LLM reciting a fact correctly be hallucinating?

Cancer loves sugar.

Seems fair

What do you mean? China is the major communist economy in the world and they have plenty of “markets“, but the CPC are the ones who pick the winners through legislation and/or subsidies.

As I stated above what I disagree is a system where legislation is used for other purposes than 1) protecting citizens from harm 2) combating anti-competitive practices by incumbent businesses.

The legislation in question clearly falls outside these two categories.

Of course it’s not beneficial per se to auto makers but it’s relatively more troublesome for smaller automakers than bigger ones. Unless they are focused solely on providing cars that are easy to repair of course. In that case they will be given a government mandated market advantage in true communist fashion.

History has clearly taught us that socialism doesn’t work - why do we keep forgetting?

This is the worst type of regulatory overreach - a true innovation killer - putting useless regulatory burden on all car manufacturers. It will only benefit the large incumbents that can afford to be inefficient.

In what world (except for a communist one) is it the role of the government to put arbitrary laws in place pandering to nische interests like this one? The role for regulations is in ensuring the safety of citizens and fighting mono/oligo-polies (instead of helping them, like in this case).

GM can’t do tech, what else is new?

Yeah HN is full of mids unfortunately..

It’s actually four times; zip2, PayPal, Tesla, SpaceX

Incredible to double revenue YoY on that level. Elon and Spacex team are truly extraordinary.

Public opinion definitely veers towards over-pessimism, see for example Hans Rosling book Factfullness. Here is a short summary from a psychological perspective: https://www.psychologytoday.com/intl/blog/sex-murder-and-the...

I agree, rational optimism is the way

Haha didn’t catch that. Spot on

I agree.

Why would we be in a sigmoid? What makes you think that?

Moderating optimism is overrated. Most people should make an effort to be more optimistic, due to our biological negativity bias. That will serve them better.