HN user

kuprel

564 karma
Posts15
Comments104
View on HN
DARPA's new X-76 5 months ago

From the image it doesn't look balanced for VTOL when the propellors are vertical. Also are the jets enabled during VTOL?

God Simulator in Bash 11 months ago

A simulation of God's decision tree for the Serenity Prayer: "God, grant me the serenity to accept the things I cannot change, the courage to change the things I can, and the wisdom to know the difference."

I wonder if a language model can be treated as a policy over token-level actions instead of full response actions. Then each response from the language model is a full rollout of the policy. In math and coding, the reward for the response can be evaluated. This is not how DeepSeek works now, right? It treats full responses from the language model as the action if I understand correctly.

This adds PyTorch/CUDA training support to Andrej Karpathy's minbpe. It takes 2min 28sec (148 seconds) on an RTX4090 to train the BasicTokenizer with a vocab_size of 512 on 307MB of Enron emails. The original code takes 2hrs 15min (8076 seconds) on an M2 Air with Python 3.11 to do this. That is a 55x speedup.

chips will have to come a long way for this to be generated in real time, but there's no reason a generated 3D environment can't be interactive

When I was growing up the concern was that fossil fuels were a limited resource that we are rapidly depleting. Now the concern is that they are far too abundant and cheap for our own good. Eventually the economics should force us to use renewables if the fossil fuels are a rapidly depleting limited resource, right?

I found this quote interesting:

Recent discoveries have shown that ctenophores have no synapses, the tiny connections between neurons. Instead the cells of their primitive nervous system, known as a nerve net, are fused together, forming a syncytium—“an entirely new way to build a nervous system”

It makes sense that synapses would be more general/powerful than fused neurons. Different neurons can connect over time with synapses

We build things with factories where the factory is orders of magnitude more complicated than the thing being built. Life build things via self replication at a microscopic level. Seems like a fundamentally different approach

GPT-4 3 years ago

What’s the best rumor on model size? That number can’t be easy to keep secret