HN user

MurizS

672 karma

Training multimodal models. Here goes nothing:

https://hesiod.ch/

Posts44
Comments12
View on HN
joelgrus.com 6mo ago

2025 Year in Review

MurizS
1pts0
github.com 1y ago

AlphaFold 3 Code

MurizS
137pts23
nonint.com 2y ago

Google/Rulesofthumb

MurizS
53pts25
www.bloomberg.com 2y ago

Twitch to Cut 500 Employees, About 35% of Staff

MurizS
448pts464
www.chess.com 2y ago

Regarding Recent Accusations

MurizS
1pts0
nonint.com 2y ago

Is the Reversal Curse in LLMs a generalization problem?

MurizS
1pts0
alphacode.deepmind.com 3y ago

AlphaCode Attention Visualization

MurizS
144pts45
psyche.co 4y ago

How to Stop Procrastinating

MurizS
2pts0
aeon.co 5y ago

Why Disagreement Is Vital to Advancing Human Understanding

MurizS
3pts0
psyche.co 5y ago

How to Calm Your Inner Storm

MurizS
2pts0
aeon.co 5y ago

Does Consciousness Come from the Brains Electromagnetic Field?

MurizS
4pts2
aeon.co 5y ago

The Problem with Crackpot Emails from Amateur Physicists (2016)

MurizS
3pts1
aeon.co 5y ago

The Search for a New Physics

MurizS
3pts0
psyche.co 5y ago

On the consolatory pleasure of jigsaws when the world is in bits

MurizS
3pts0
psyche.co 5y ago

What the new science of narcissism says about narcissists

MurizS
1pts0
psyche.co 5y ago

Recognise the creativity behind crime, then you can thwart it

MurizS
2pts0
aeon.co 5y ago

Keep Science Irrational

MurizS
30pts36
psyche.co 5y ago

How to Have a Difficult Conversation

MurizS
97pts18
www.reddit.com 5y ago

Computer Science Fall 2020 Courses from MIT, ETH Zurich, CMU

MurizS
2pts1
math.mit.edu 5y ago

Category Theory for Scientists [pdf]

MurizS
3pts0
fs.blog 5y ago

Mental Models: The Best Way to Make Intelligent Decisions

MurizS
94pts35
aeon.co 5y ago

The start of life on Earth is an event horizon we struggle to see beyond

MurizS
6pts0
daml.com 5y ago

Handing over Ghcide to the Haskell Community

MurizS
16pts1
psyche.co 5y ago

How to Be Indistractable

MurizS
1pts0
psyche.co 5y ago

Our greatest invention was the invention of invention itself

MurizS
1pts0
aeon.co 5y ago

The idea of a language instinct is simple, powerful and completely wrong

MurizS
3pts0
psyche.co 5y ago

The best way to exercise self-control is not to exercise it at all

MurizS
346pts272
www.worldometers.info 5y ago

World Population Surpassed 7.8B

MurizS
1pts0
twitter.com 7y ago

GPT-2 model answers what working at FAANG companies feels like

MurizS
1pts0
github.com 7y ago

Mona Lisa Mosaic created using a genetic algorithm

MurizS
4pts1

I think GP was probably referring to "Scaling Data-Constrained Language Models" (2305.16264) from NeurIPS 2023, which looked first at how to optimally scale LLMs when training data is limited. There is a short section on mixing code (Python) into the training data and the effect this has on performance on e.g. natural language tasks. One of their findings was that training data can be up to 50% code without actually degrading performance, and in some cases (benchmarks like bAbI and WebNLG) with improvements (probably because these tasks have an emphasis on what they call "long-range state tracking capabilities").

For reference: In the Llama 3 technical report (2407.21783), they mention that they ended up using 17% code tokens in their training data.

It is not that the HN community is diminishing your credentials in applied category theory or in any other fields, more so the inherited snarkiness in your short comment provides no one a favor and surely doesn't add any value to the discussion.

Your comment reminds me of a study [1] published in 2019, demonstrating that people with the strongest views against genetically modified foods know the least about science but believe they know the most.

Implicating that the Big Bang Theory enjoys its popularity because it "sells" is, I think, showing complete arrogance to landmark discoveries made in the past century - such as the cosmic background radiation [2] (for which the Nobel Prize 1978 was awarded), supporting the thesis of the Big Bang.

[1] Extreme opponents of genetically modified foods know the least but think they know the most. https://www.nature.com/articles/s41562-018-0520-3 [2] https://en.wikipedia.org/wiki/Cosmic_microwave_background

YouTube Down 6 years ago

Maybe speedtest.net downloads a YouTube video to measure your speed /s

YouTube Down 6 years ago

Maybe speedtest.net downloads a YouTube video to measure your speed /s