HN user

Icko

106 karma
Posts1
Comments34
View on HN

I'm 90% certain that OpenAI has some much beefier model they are not releasing - remember the Q* rumour?

I feel you should be able to keep the high level idea in your head at once; of course not the details. I don't think I've ever completed a piece of code without having a scheme in my head, and where it should fit in it.

I've seen at least 6 such papers, all being like "<popular architecture> are actually <a bit older concept>". Neural networks are generic enough that you can make them equivalent to almost everything.

I can't get a read on this guy. I have strong bullshit feelings, but I'm not 100% sure.

1. He seems to have an awful lot of referral links - $60 for a bottle of olive oil? 2. He has not posted why is his regime like that - e.g. "Here is a paper about iron deficiencies, so I'm taking an iron supplement". 3. 90% of his website is "look at how dense my bones are", "look at how healthy my liver is" - bro I just wanted to see the actual regime, and you can't even post that.

Primarily, they are pure functions that accept a sequence of tokens and return the next token. The model itself is stateless, and it doesn't seem right to me to ascribe "intent" to a stateless function. Even if the function is capable of modeling certain aspects of chess.

I have two arguments against. One, you could argue that state is transferred between the layers. It may be inelegant for each chain of state transitions to be the same length, but it seems to work. Two, it may not have "states", but if the end result is the same, does it matter?

Last I compared them, (1-2 years ago), Google OCR was much much better and supported more languages than tesseract. There was also an OCR in openCV, which was slightly better than tesseract, but not good enough to be useful.

Not to understate what Disney did, but I feel like most of their characters don't have much depth.

I recently rewatched 12 angry men, and was surprised at how quickly and efficiently they introduced 12 characters. Off-hand remark by one character, an expression by another, the way they stood and moved around; in around 5 seconds you knew the characters without even knowing their names.

Contrast to Marvel's characters, which have hours of development each, yet don't really feel alive. All of them have tragic backstory, all of them are heroic in the same way, most of the male characters are snarky/sarcastic/have big egos.

... destroyers of industries ...

if you don't want your industry to be destroyed, innovate it yourself. Otherwise, you lose the right to moan when someone else does.

Moral Machine 4 years ago

That's a very solid argument. My reasoning was that the car must protect it's owners; but you changed my mind.

Not sure if posting the paper only is even the best move. I personally never work with papers with no code published. Just not worth the effort to reproduce them, when I can use the second SOTA for nearly no performance penalty and much less effort.

All the groundbreaking papers in deep learning in the last decade had code published. So if you're aiming for thousands of citations, you need code.