HN user

elcomet

2,676 karma

elcomet at mailbox dot org

Posts25
Comments1,056
View on HN
supaiku.com 7mo ago

What does a lean proof prove?

elcomet
5pts1
kyutai.org 2y ago

Kyutai unveils today the first voice-enabled AI openly accessible to all [pdf]

elcomet
25pts10
fpgacomputing.blogspot.com 2y ago

Emulation Is the Sincerest Form of Flattery

elcomet
3pts0
arxiv.org 2y ago

Islands Far Outside the Black Hole Horizon

elcomet
1pts0
support.mozilla.org 3y ago

Copy text from images on Firefox for macOS

elcomet
2pts0
widgetsandshit.com 3y ago

Taco Bell Programming

elcomet
21pts6
www.charachorder.com 4y ago

CharaChorder, Type at the Speed of Thought

elcomet
3pts0
qualiacomputing.com 5y ago

The Hyperbolic Geometry of DMT Experiences

elcomet
2pts0
www.telegraph.co.uk 5y ago

Now France and Italy Join Germany in Suspending AstraZeneca

elcomet
2pts0
storage.googleapis.com 5y ago

Cosmopolitan Libc – your build-once run-anywhere C library

elcomet
2pts1
xkcd.com 5y ago

mRNA Vaccine

elcomet
30pts0
techcrunch.com 5y ago

Twitter finally shuts down its abandoned prototype app twttr

elcomet
1pts0
www.youtube.com 5y ago

YouTube Will Put Ads on Non-Monetized Videos Without Paying the Creators

elcomet
12pts5
github.com 5y ago

WinMin: Run Windows Applications on Linux

elcomet
2pts0
www.theverge.com 6y ago

The true impact of SpaceX’s Starlink on astronomy is coming into focus

elcomet
3pts0
number-none.com 6y ago

John Carmack on Inlined Code (2014)

elcomet
1pts0
dolphin-emu.org 6y ago

Ubershaders: A Ridiculous Solution to an Impossible Problem (2017)

elcomet
1pts0
neal.fun 6y ago

Dark Patterns

elcomet
3pts1
pytorch.org 6y ago

Pytorch Named Tensors

elcomet
3pts0
blog.xkcd.com 6y ago

Serena versus the Drones

elcomet
11pts3
www.theguardian.com 7y ago

Murray Gell-Mann, Nobel Prize-winning physicist who named quarks, dies at 89

elcomet
2pts0
www.python.org 7y ago

PEP 582 -- Python local packages directory

elcomet
4pts1
kodi.tv 7y ago

Kodi 18 is here

elcomet
1pts0
futurism.com 7y ago

World's first battery-free Bluetooth chip pulls power from the air

elcomet
9pts2
futurism.com 7y ago

World's first battery-free Bluetooth chip pulls power from the air

elcomet
2pts1

We didn't have the compute required (GPUs powerful enough to parallelize forward and backward pass). This compute is what allows us to train from human knowledge or distillation.

I don't understand all the hype for generating SVG with LLM. The task is not really useful, doesn't seem that interesting in single shot as it's really hard, and no human could do it (it would be more useful if the model has visual feedback and could correct the result).

And also, since it becomes a popular task, companies will add the examples in their training set, so you're just benchmarking who has the better text to SVG training set, not the overall quality of the model.

Mistral Small 3 1 year ago

You can offload tensors to the cpu memory. It will make your model run much slower but it will work

Multi-step reasoning means that the LLM is giving a question (maths here), and generating an answer that consists of many intermediate words, before returning the solution. Here, we don't want to tell the LLM how to solve the problem word-by-word. We want to tell it at the end, "correct" or "incorrect", and have the model learn on its own to generate intermediate steps, to reach the solution.

That's typically a setup where RL is desirable (even necessary): we have sparse rewards (only at the end) and give no details to the model on how to reach the solution. It's similar to training models to play chess against a specific opponent.

It's possible, the question is how to choose which submodel will be used for a given query.

You can use a specific LLM, or a general larger LLM to do this routing.

Also, some work suggest using smaller llms to generate multiple responses and use a stronger and larger model to rank the responses (which is much more efficient than generating them)

Meta Movie Gen 2 years ago

The ghost is insanely impressive, it's the example that gave me a "wow" effect. The cloth physic looks stunning, I never thought we would reach such a level of temporal coherence so fast.