stanfordkid

I think you’re being overly combative. It’s intuitively quite obvious that it’s incredibly easy to implement and the circular training catastrophe was only ever a conjecture. It’s kind of like releasing a crypto primitive without knowing a proof. Like… maybe it works, but you can’t assume that just because you don’t know how to break it. You have to remember that 100s of billions of enterprise valuation rely on frontier models being moats. The burden of proof is on those raising valuations assuming they will capture the full market.

I'm sure they are doing more than looking at mouse movements, but I don't think this is a compelling approach -- I think human movements could be faked pretty easily using a large corpus of real world behavioral data. It's an adversarial game but the level of intelligence we are approaching with AI this can be solved IMO.

I think what you're saying might be a stretch. I strongly believe the brain holds some information in a sequential pattern -- not necessarily all of it or even the majority of it. There's a book called Moonwalking with Einstein that digs into this precise fact -- you can remember sequences much much better if you associate a visual image with each item in the sequence. Sequential association covers a lot of human knowledge but certainly not the spatial aspects. I think it's a big reason why I think LLM's might not be as smart as we think they are. The complex spatial representations are only encoded implicitly via projection on to textual descriptions.

Wow amazing. I am very curious how the spider "learns" to do this technique, that it works, and to repeat it. Is this somehow encoded in the DNA of the spider? Clearly spiders don't rear their children or learn / communicate so it must be evolved and encoded somewhere in either the genes or the epigenetics. Nature is amazing.

I don't fully understand how this works... who regulates and defines what is "self-hosted" or "ethical technology"... I feel you can't really solve the distributed consensus and governance problem by just introducing a new domain suffix.

I don't think you can really blame AI agents for this. While I agree the user was using AI irresponsibly, some of the blame does go to Railway for making an API key that allows for all operations to happen from a single key without giving clear warnings on privileges. Clearly this user was shooting from the hip and quickly pasted whatever key they got from Railway into a file somewhere so there is some blame there, but any service that handles hosting infrastructure should provide clear UX warning to users regarding the scoping of it's credentials.

No, they are able to detect errors when pointed at them but they have a lot of false positives... making them functionally useless for a large unknown codebase. They also can't build and run an exploit post-identification. Mythos can find vulnerabilities (purportedly) and actually validate them by building and running exploits. This makes it functional and usable for hacking.

They are bringing in $30B in revenue with 3X YoY growth. Why do you think it is a "jig"? I do think the US economy could implode, but thats because of war and wealth inequality in the midst of hyper-inflation. AI models aren't very useful when you have penniless consumers that can't buy the products they help build. All this is to say: the models are valuable, the companies building and providing them are very valuable.

The biggest risk to AI companies IMO is further optimization and distillation of the capabilities into smaller and more efficient models. The moat these companies have right now is that higher intelligence requires more specialized and expensive compute. If you can do that for cheap then it kind of negates their business model. Everything is moving fast, we also yet to see world models/embodied AI and how that impacts thing. I think we've reached the peak with regards to capabilities of pure text trained LLMs.

They basically wrote the equivalent to Claude Code and launched it as a product... how does their adoption curve lag behind John Deere?

I don't find this paper very compelling. Obviously it would be fraud if the code generated simply escaped the harness vs solving the actual problem. I agree that theoretically models could learn to do that, and it is important to highlight, but my sense is that those entities reporting the benchmark scores would have an obligation to observe this behavior and re-consider the metrics they report. It is a bit like saying it's possible to cheat in football because the balls are deflatable. It matters, and some have done it, but it doesn't mean widespread cheating is taking place. The paper takes the tone that there is already a lot of cheating happening which I do not think is the case.

Mind blowing! I've had this intuition for a while too, but he really gets into the heart of it.

I think there are a lot of good answers here, but it really comes down to the type of content being stored and access patterns.

A database is a data structure with (generally) many small items that need to be precisely updated, read and manipulated.

A lot of files don't necessarily have this access pattern (for instance rendering a large video file) ... a filesystem has a generic access pattern and is a lower level primitive than a database.

For this same reason you even have different kinds of database for different types of access patterns and data types (e.g Elasticsearch for full text search, MongoDB for JSON, Postgres for SQL)

Filesystem is generic and low-level, database is a higher order abstraction.

Not only is it no better, it is significantly worse.

What's your source for this? There isn't really a lot of credible, publicly available information on what you're saying... just anecdotes. In the India v. Pakistan conflict recently a French produced Indian Rafale was downed via a Chinese long range air-to-air missle (PL-15) from a a Chinese produced J-10 jet. Even if they don't have the same hit rate, you can buy 10x for the same price.

Source: https://www.reuters.com/business/aerospace-defense/how-pakis...

No one wants to liberate Iran. Israel just wants to continue committing genocide and apartheid without any opposition. Iran arms Hezbollah and Hamas, the main forms of Palestinian resistance. The whole point of this operation is to decimate those groups so ethnic cleansing can continue without any resistance. Israel could care less about the Irani people.

You are very naive if you think the IRGC truly killed 10's of thousands of it's own people. Israel openly talks about Mossad organizing and supporting the coup, and good old Donny has admitted they have given weapons to organized resistance.

I estimate that many of the death numbers come from armed resistance being killed by the IRGC, not ordinary peaceful protestors. I also think armed resistance killed many Irani citizens. There is obviously fog of war here. The thousands of deaths were likely inflated and obfuscated.

Look at the coups we have backed in the middle east (including formerly in Iran which is what originally led to the Islamic revolution) -- and you will see a pattern. Both US and Israel provide material support to groups like ISIS or actors like Bin Laden. An Al-Qaeda fighter is literally the head of Syria now thanks to Israel.

I don't love Hamas, IRGC or Hezbollah, I don't like their ideology. But it is myopic to think they exist in a vaccum.

It's better than using randomly initialized weights. It's more of a theoretical exercise to explore biology. When an infant is born maybe the visual cortex already has some notion of edge detectors etc. through a system such as this one despite never having really opened it's eyes.

I did a similar project but using 3D fractals I found on shadertoy feeding into ViTs. They are extremely simple iterative functions that produce a ton of scene like complexity.

I have a pet theory that the visual cortex when developing is linked to some kind of mechanism such as this. You just need proteins that create some sort of resonating signal that feed into the neurons as they grow (obviously this is hand-wavy) but similar feedback loops guide nervous system growth in Zebra fish for example.

It's pretty simple... the word circle and what you can correlate to it via english language description has somewhat less to do with reality than a physical 3D model of a circle and what it would do in an environment. You can't just add more linguistic description via training data to change that. It doesn't really matter that you can keep back propagating because what you are back propagating over is fundamentally and qualitatively less rich.

I'm curious to understand, why would you build your website this way vs. say jQuery. I've never really understood the HTMX ecosystem. Is this just to avoid javascript and replace that with html pages, id's and attributes? It feels like the DOM is a very clear abstraction and scripting is a more powerful way to manipulate it. What do people like or prefer about this approach and paradigm?

I'm not sure I totally buy the "no plasticity" argument. If you are allowed to write to context in an agentic fashion, certainly the LLM can record intermediate answers, go back and re-rank it's memory. The "plasticity" is in the form of data that can be looked up and referenced as a shortcut. I would think this forms a Turing complete system so theoretically it can represent pretty much anything.

Isn’t this kind of all bullshit. Like Anthropic licenses so many of its models through Bedrock. If the DoD has a contract with Amazon they can just use them.

Shouldn't public signature of the hash of the exe file from a known key before execution fix this??? What am I missing?

Just look at the domains. Obviously social media will get harder to do this with, maybe that's okay though. I think a simple criterion can be used: could the pre-trained LLM have come up with this itself? If so it probably doesn't have training value.

Cool to see some innovation from HP, this is actually unique and fills a niche of going from desk to desk (home->office), without needing mobile. Much better than ripping off the latest aluminum MacBook designs.

I don't see how you get around LLMs scraping data without also stopping humans from retrieving valid data.

If you are NYTimes and publish poisoned data to scrapers, the only thing the scraper needs is one valid human subscription where they run a VM + automated Chrome, OCR and tokenize the valid data then compare that to the scraped results. It's pretty much trivial to do. At Anthropic/Google/OpenAI scale they can easily buy VMs in data centers spread all over the world with IP shuffling. There is no way to tell who is accessing the data.

Is it really true that nothing would change if the Sun's mass was suddenly compacted by several orders of magnitude (into a point mass or black hole)?

This seems unintuitive to me. The sun is a million miles in diameter, so surely shrinking that to zero would lower the amount of gravitational force infinitesimally since the gravity is 1/distance^2 not linear. I would think the planets would sort of drift ever so slightly farther.

The dude works for GitHub. I don’t doubt there is some rotten code on there, but what you’re saying seems like a stretch and exactly what he’s describing.

To be fair, millions could be hundreds of millions.

Just because it uses the className attribute doesn't really mean it is "like tailwind"... SQL is not anything like CSS classes and cannot be composed in the same manner. It's basically just using className as a data attribute. You might as well just stick raw SQL in there and parse it... what is the point of the weird hyphenated pseudo dialect?

What’s the point of this article — everyone knows desiring heroin is different from wanting to become an Olympic swimmer.