HN user

dewarrn1

378 karma

I'm a cognitive neuroscientist with a PhD in psychology.

david-e-warren.me

[ my public key: https://keybase.io/dewarren; my proof: https://keybase.io/dewarren/sigs/GlgzYFgXKgB60f8D9R19UZsu_JQQwZCOQyW9aQyAv7g ]

Posts16
Comments146
View on HN

I'm hopeful that new efficiencies in training (Deepseek et al.), the impressive performance of smaller models enhanced through distillation, and a glut of past-their-prime-but-functioning GPUs all converge make good-enough open/libre models cheap, ubiquitous, and less resource-intensive to train and run.

The premise for this research question is related in part to work from Dr. Eleanor Maguire (who I just learned died last year at only 55) and her team on hippocampal anatomy and careers involving spatial navigation, including taxi drivers. A connection that may be of interest to HN readers: Demis Hassabis was one of Maguire's doctoral students, although he does not appear to have worked on the project most relevant to this study.

So, in reference to the "reasoning" models that the article references, is it possible that the increased error rate of those models vs. non-reasoning models is simply a function of the reasoning process introducing more tokens into context, and that because each such token may itself introduce wrong information, the risk of error is compounded? Or rather, generating more tokens with a fixed error rate must, on average, necessarily produce more errors?

It sounds like a compelling film. Seeing now that it's produced by Penn & Teller's team, it makes me wonder about this fits into their "juggler vs. magician" dichotomy. The implication of that duo producing the film suggests that they might believe that Vermeer's reputation as an extraordinarily skilled artist ("juggler") might in fact be the result of Vermeer's use of a sophisticated apparatus that tricked patrons and viewers into thinking that he had extraordinary abilities, thus making Vermeer a master faker ("magician"). Or maybe they simply wanted to spur debate.

I'm not saying you're wrong about the EFF's support, but I'm not finding a lot of information that says you're right, either. I tend to think of the EFF as generally (not always) being on the right side of issues in their domain, but if that's not true, or if their donor list makes it seem less likely that it's true, I would be interested to know more.

For reference, I found the following descriptions of EFF's major donors, and I looked at their most recent IRS filing. Nothing jumped out at me, but maybe I don't know where to look.

https://www.eff.org/pages/thank-you-public-foundations https://en.wikipedia.org/wiki/Electronic_Frontier_Foundation... https://donations.vipulnaik.com/donee.php?donee=Electronic+F...

This is a wonderful project. Many thanks to Jan for sharing it.

Separately, regarding dementia, it is both less and more complicated than many commenters suggest.

From UCSF Neuroscience’s excellent Memory and Aging Center resources:

“Dementia is a general term for any disease that causes a change in memory and/or thinking skills that is severe enough to impair a person’s daily functioning… There are many different types of dementia… Most types of dementia cause a gradual worsening of symptoms over the course of years due to progressive damage to nerve cells in the brain caused by the underlying disease process…” [0]

Even more briefly: dementia is an umbrella term, many diseases can cause dementia, and those diseases may or may not be progressive.

0: https://memory.ucsf.edu/what-dementia