HN user

fenomas

8,337 karma

One of those people who leaves their job to make a game.

"Heck no! I'm going to climb up a tree, cut the soles off my shoes, and learn to play the flute."

----

[ my public key: https://keybase.io/fenomas; my proof: https://keybase.io/fenomas/sigs/Atl3PLLibVbXFjUYH5sW3DCzCxSf-YFzXh3DB2fqs6k ]

Posts27
Comments1,835
View on HN
gamesfray.com 10mo ago

Nintendo awarded US patent for "summon and fight" mechanic

fenomas
6pts0
gun.eco 1y ago

Gun.js: real-time, decentralized graph data storage for the web

fenomas
2pts0
www.robinsloan.com 4y ago

Notes on a Genre

fenomas
1pts0
distill.pub 5y ago

Self-organising textures from cellular automata

fenomas
418pts59
andyhall.github.io 5y ago

Show HN: Wafxr – dynamic sound FX via WebAudio

fenomas
27pts19
github.com 5y ago

Show HN: wasgen, low-level sound effects for WebAudio

fenomas
7pts1
andyhall.github.io 6y ago

Show HN: Wafxr – sound effect generator for WebAudio

fenomas
6pts6
emshort.com 7y ago

Opening Inform [programming language for interactive fiction]

fenomas
3pts0
news.ycombinator.com 7y ago

Tell HN: Legacy WebAudio content will break in Chrome 70

fenomas
88pts27
aphall.com 8y ago

Show HN: 25 days of procedural music experiments

fenomas
4pts8
www.theguardian.com 8y ago

Kazuo Ishiguro wins the Nobel prize in literature

fenomas
2pts0
www.youtube.com 9y ago

The Unanswered Question – Leonard Bernstein (1973)

fenomas
1pts0
www.washingtonpost.com 9y ago

Tom Wolfe tries to take down Darwin and Chomsky

fenomas
29pts12
taktech.org 9y ago

Web FM synthesizer made with HTML5

fenomas
1pts0
www.youtube.com 10y ago

Dan Harris “10% Happier” Talk at Google

fenomas
2pts0
blogs.scientificamerican.com 10y ago

A skeptical look at Skepticism

fenomas
4pts0
asoftmurmur.com 10y ago

Asoftmurmur – mixable ambient noise

fenomas
3pts0
frend.co 10y ago

Frend – accessible, dependency-free web components

fenomas
78pts22
www.twitch.tv 10y ago

HandmadeCon videos – game programmer interviews

fenomas
2pts1
www.jeremy-duns.com 10y ago

The author who cyber-stalked me

fenomas
7pts0
medium.com 10y ago

Tokyo vs. the Bay Area

fenomas
58pts53
moderncrypto.org 11y ago

Modern anti-spam and E2E crypto (2014)

fenomas
34pts25
github.com 11y ago

BabylonJS – A JavaScript framework for building 3D games with HTML 5 and WebGL

fenomas
35pts15
github.com 11y ago

The great JavaScript box-intersection benchmark

fenomas
1pts0
0fps.net 11y ago

Collision Detection, Part 2

fenomas
35pts3
github.com 11y ago

Show HN: Evolve 3D projections of an image, on hardware via webGL

fenomas
4pts6
robertnyman.com 11y ago

Leaving Mozilla – Robert Nyman

fenomas
1pts0

So ideally that question should have answers that apply to the new question as well.

The point is who decides. If you ask a question and I flag it as a dupe, I might think the answers on the other question apply to yours, but only you know whether they solved your problem or not.

I've no idea if the rate of bad duplicates is so much higher than I observed,

Sure, and neither does SO! They didn't even measure it. They only looked at the signal "does somebody with points think these questions are similar", and discarded the signal of whether the new user got any value out of the site, and I think that's what did them in.

I still think SO was done in by the weird way they handled similar questions. They encouraged veteran users to flag new questions as dupes, even if the "original" question was years old and unanswered. Who does that even help?

Imagine if the system had let veteran users link a new question to an existing answer rather than a question, and if the asker finds it solves their problem they can accept it. At least that way new joiners would have a chance of getting their question answered.

Looking back it feels like SO was one of the first really gamified sites, and the people running it got weirdly focused on the point-economy aspect. They ran the site almost like "points" were a finite resource, and not to be handed out unless the user really deserved it.

Related, Raymond Chandler says in his letters that he taught himself to write a novelette by copying one (by Erle Stanley Gardner). He took the original story and wrote a detailed synopsis, then wrote a novelette from the synopsis, compared it to the original, did rewrites, and so on until he understood what tricks Gardner had used to make the scenes work.

I disagree! It's easy to check that an AI program meets its specification, which is to process input tokens and generate output tokens. :)

If you're talking about verifying whether it produces the correct tokens, that's not generally something you can specify in advance with AI. I mean: if your task is one where you can precisely specify which output tokens are correct for a given input, then the task doesn't need AI, no?

I see what you're getting at, but I think you're focusing on the incidental. An animation is good if it's clear and intuitive in motion. It may often be the case that good animations also look nice in a screenshot halfway through, but (a) they don't always, and (b) working well in motion is obviously the more important of the two goals.

As such it makes no sense to worry about the latter thing - it's not a signal whether the animation is good or not.

That's not what TFA is about though.

Look at the youtube example - it has two pieces of UI animating from from a start point to an end point, and the paths are such that they momentarily overlap. There's nothing buggy or janky about it in motion; TFA is just saying that if you ignore the motion and take a screenshot mid-transition it looks odd. Same complaint as what GP describes, and silly for the same reasons.

Placing an undue emphasis on civility is how bad actors control the conversation.

The load-bearing word in that claim is "undue", and it's not justified here. I'm not doing arcane rules-lawyering, I'm just saying people should avoid doing things the site guidelines quite specifically ask them not to do.

I’m not advocating for this rule to change (I’d appreciate if you didn’t straw man and mischaracterise what I said),

I wasn't suggesting you did, I was suggesting the person I originally replied to might.

https://en.wikipedia.org/wiki/Generic_you

Does that mean I now repeat your parenthetical back to you? ;)

I'm fond of linguistic bugbears, and have actually sent that same article to people before :D But what you're missing is that the less/fewer debate is over their use as adjectives, and TFA's title uses "less" as an adverb. It's asking for AI agents to be less human, not for them to be fewer in number. Swapping it to "fewer" would make the title's meaning no longer match the article.

Now please sit a moment and reflect on what you've done. :P

It's not a grammar issue; only "less" matches TFA's meaning.

(Aside: it's better not to be pedantic, but if you must be pedantic you should remember to be correct as well.)

Nice to have these all collected nicely and sharable. For the amusement of HN let me add one I've become known for at my current work, for saying to juniors who are overly worried about DRY:

Fen's law: copy-paste is free; abstractions are expensive.

edit: I should add, this is aimed at situations like when you need a new function that's very similar to one you already have, and juniors often assume it's bad to copy-paste so they add a parameter to the existing function so it abstracts both cases. And my point is: wait, consider the cost of the abstraction, are the two use cases likely to diverge later, do they have the same business owner, etc.

Not at all - didn't mean to sound snarky, I just wanted to add that I was omitting details and caveats.

FWIW, personally I think it muddies things to frame the question as if "..using statistical token generation" was a limitation. NNs are Turing-complete, so what LLMs do can just be considered "computation" - the fact that they compute via statistical token generation is an implementation detail.

And if you're like most people, "can cognition happen via computation?" is a less controversial question, which then puts LLMs/cognition topics easily into the "in principle, obviously, but we can debate whether it's achievable or how to measure it" category.

The high-order bit for for each case is the category it's in and the "Outcome" column - that summarizes if the solution was full/partial/wrong, if AI had assistance, etc. Then further discussion for each one is linked from the number.

Then the "Literature result" columns have a citations for where similar published results were found. The ones with no "Literature" column, like in the first section, are cases where no similar published results have been found (implying that the solution would not have been trained on). Note that in some cases a published solution was found but it wasn't similar to the AI's.

(this is all explained with more detail and caveats at the top of the page)

The post you replied to was:

We went from 2 + 7 = 11 to "solved a frontier math problem" in 3 years, yet people don't think this will improve?

All that says is that the speaker thinks models will improve past where they are today. Not that it's a logical certainty (the first thing you jumped on them for), and certainly not anything about "limitless potential for growth" (which nobody even mentioned). With replies like this, invoking fallacies and attacking claims nobody made, you're adding a lot of heat and very little light here (and a few other threads on the page).

It's not a side effect of tokenization per se, but of the tokenizers people use in actual practice. If somebody really wanted an LLM that can flawlessly count letters in words, they could train one with a naive tokenizer (like just ascii characters). But the resulting model would be very bad (for its size) at language or reasoning tasks.

Basically it's an engineering tradeoff. There is more demand for LLMs that can solve open math problems, but can't count the Rs in strawberry, than there is for models that can count letters but are bad at everything else.

LLMs are bad at arithmetic and counting by design. It's an intentional tradeoff that makes them better at language and reasoning tasks.

If anybody really wanted a model that could multiply and count letters in words, they could just train one with a tokenizer and training data suited to those tasks. And the model would then be able to count letters, but it would be bad at things like translation and programming - the stuff people actually use LLMs for. So, people train with a tokenizer and training data suited to those tasks, hence LLMs are good at language and bad at arithmetic,

I remember using that tool internally! Personally I think I only used it to get stats of which features/APIs were popular. But I think other teams used it for QA/conformance, like finding content that occurred in the wild but wasn't covered by test cases.