HN user

benchmarkist

295 karma
Posts16
Comments126
View on HN
chrischoy.github.io 1y ago

Data Processing Inequality and Unsurprising Implications (2018)

benchmarkist
1pts0
www.nature.com 1y ago

How close is AI to human-level intelligence?

benchmarkist
3pts4
arxiv.org 1y ago

Foundations of Algorithmic Thermodynamics (2023)

benchmarkist
4pts0
ashvardanian.com 1y ago

GCC Compiler vs. Human – 119x Faster Assembly (2023)

benchmarkist
2pts0
blog.paulbohm.com 1y ago

Information Theory: Obstacles to True Artificial Intelligence (2016)

benchmarkist
3pts0
phys.org 1y ago

Significant amount of methane escaping East Siberian Arctic Shelf (2013)

benchmarkist
3pts0
blog.dottxt.co 1y ago

Beating GPT-4 with open source

benchmarkist
5pts0
www.youtube.com 1y ago

OpenAI CEO Sam Altman on AI governance, ethics, and innovation [video]

benchmarkist
1pts0
arxiv.org 1y ago

Evaluating the Robustness of Analogical Reasoning in Large Language Models

benchmarkist
1pts0
cerebras.ai 1y ago

Llama 3.1 405B now runs at 969 tokens/s on Cerebras Inference

benchmarkist
427pts156
phys.org 1y ago

Modeling urban growth shows that cities develop in ways similar to tumors

benchmarkist
1pts0
tomstu.art 1y ago

Compilers for Free (2013)

benchmarkist
2pts0
80000hours.org 1y ago

The case for reducing existential risks (2017)

benchmarkist
4pts0
existential-risk.com 1y ago

Existential Risk: Threats to Humanity's Future

benchmarkist
1pts0
tomstu.art 1y ago

Automatic Differentiation in Ruby (2016)

benchmarkist
3pts0
www.scientificamerican.com 1y ago

Earth Could Be Alien to Humans by 2500 (2021)

benchmarkist
28pts25

The universe does not have a finite symbolic description. Whatever meaning you attribute to the symbols has no objective reality beyond how people interpret those symbols. Same is true for the arithmetic performed by neural networks to flash lights on the screen which people interpret as meaningful messages.

Yet another instance of how people view the biosphere as a resource to be exploited for their own monetary profit and short-term benefit. That type of logic and thinking is a dead end. I've never had a silk robe and I doubt I would be any better off if I did have one. I'd much prefer clean air, water, and unpoisoned land for growing nutritious food.

The function/mathematics in an NN (neural network) is meaningless unless there is an outside observer to attribute meaning to it. There is no such thing as a meaningful mathematical expression without a conscious observer to give it meaning. Fundamentally there is no objective difference between one instance of a NN with one parameter, f(θ), evaluated on some input, f(θ)(x), and another instance of the same network with a small perturbation of the parameter, f(θ+ε), evaluated on the same input, f(θ+ε)(x), unless a conscious observer perceives the output and attributes meaning to the differences because the arithmetic operations performed by the network are the same in both networks in terms of their objective complexity and energy utilization.

How does math encode meaning if there is no Alice and Bob? You should quickly realize the absurdity of your argument once you take people out of the equation.

Sora is here 2 years ago

I don't think there is any real value in making videos other than useless entertainment. The real inspired use of computation and AI is to cure cancer, that would be the right way to show the world that this technology is worthwhile and useful. The techniques involved would be the same because one would need to include real physical constraints like conservation of mass and energy instead of figuring out the best way to flash lights on the screen with no regard for any foundational physical principles.

Do you know anyone or any companies working on that?

Sora is here 2 years ago

I'd be embarrassed if I was a physicists and my name was associated with software that had phantom masses appearing and disappearing into the void.

Sora is here 2 years ago

My price is very cheap in terms of what it would enable and allow OpenAI to charge their customers. Hamiltonian video generation with conservation principles which do not have phantom masses appearing and disappearing out of nowhere is a billion dollar industry so my asking price is basically giving away the entire industry for free.

Sora is here 2 years ago

Unless you have $500k to pay for the actual implementation of a Hamiltonian video generator then I don't think you're in a position to tell me what I know and don't know.

Sora is here 2 years ago

Why would I give away the idea for free? How much do you want to pay for the implementation?

Sora is here 2 years ago

No one is perfect but you should try to do better and waste less time on HN now that you're aware and can act on that knowledge.

Sora is here 2 years ago

I've seen the quality of OpenAI engineers on Twitter and it's easy enough to extrapolate. Moreoever, neural networks are not black boxes, you're just parroting whatever you've heard on social media. The underlying theory is very simple.

Sora is here 2 years ago

I don't work there so I'm certain there is no one with enough knowledge to make it work with Hamiltonian constraints because the idea is very obvious but they haven't done it because they don't have the wherewithal to do so. In other words, no one at OpenAI understands enough basic physics to incorporate conservation principles into the generative network so that objects with random masses don't appear and disappear on the "video" manifold as it evolves in time.

Sora is here 2 years ago

Neural networks use smooth manifolds as their underlying inductive bias so in theory it should be possible to incorporate smooth kinematic and Hamiltonian constraints but I am certain no one at OpenAI actually understands enough of the theory to figure out how to do that.

Good one but these theorems are useful to have when thinking about information processing systems and whatever promises the hype artists are making about the latest and greatest iteration of neural networks. There is no way to cheat entropy and basic physics so if it sounds too good to be true then it probably is too good to be true.

This is intuitively obvious. If I give you some data x and you transform it with a non-reversible function f into f(x) then you are losing information. Repeated applications of the function, f(f(f(...f(x)...))), can only make the end result worse. The current implementations inject some random bits, b ~ N(u, s), but this can be thought of as a convolution operation with the distribution function g of the random data, g*f, that is injected which, after repeated applications, (g*f)((g*f)((g*f)(...(g*f)(x)...))), reduces the information content of the data you started with because the transformation is still not reversible as convolutions can not really change the non-reversible aspect of the original function.

I'm sure there is some calculation using entropy of random variables and channels that fully formalizes this but I don't remember the references off the top of my head. The general reference I remember is called the data processing inequality.¹

¹ https://en.wikipedia.org/wiki/Data_processing_inequality?use...

Fiat means faith and that's all you have with bitcoin, faith in the algorithms that make the ledger very hard to mutate without spending the required "effort" to "mint" the entries on the ledger. You can believe whatever you want but as I said previously you're better off convincing people to sell you services for your bitcoins instead of arguing with random strangers on the internet about cryptographic hashing functions.

My point is that Bitcoin is no different from fiat. In fact, it can't be anything but fiat because it has no physical representation.

Well, with toilet paper I can wipe my ass. Even a dollar bill will do the trick but I'm not sure what I can do with a number in a database disconnected from the spinning magnets that make it functional.

I'm not here to convince you that bitcoin is worthless because clearly there are enough people who think it is worth more than $100k so you'd be better off convincing those people to offer you services in exchange for bitcoins instead of arguing with a random stranger about the collapse of civilization.

Money is a meme, there is no value it can measure other than whatever delusion people collectively agree to call "value".