moonu

https://x.com/mitchcohen/status/1476951534160257026?s=20 The replies explain that it was a leaf obscuring the face

I don't think that's true? AFAIK OpenCode started as a TUI and their GUI app is Tauri-based, so don't think it was forked from OpenCode. You might be thinking of Cursor

Yeah it's a good question, I've also been thinking about harnesses and all these tacked on things we've done to add persistent memory, what makes that different, I don't know the answer, I guess that still 'feels' different than what we have, but it's hard to articulate how. As for the memory into weights thing, I meant along the lines of the Google TITANS/MIRAS papers that were released I think late last year.

My favorite explanation for what consciousness is one I read in a Thousand Brains, I found it quite elegant. It posited that consciousness is a natural derivation of embodiment + memory + the ability to create reference frames (which the book lays forth as the fundamental basis by which our brains work). Essentially, the idea is that just as we create reference frames to understand the world around us, because of memory, we begin to develop one for ourselves as well. Because of this, without a more integrated memory (built into weights), it seems unlikely that LLMs might "gain" consciousness.

You should try the Arrow SVG model by Quiver, should be much better at that sort of thing since it's made for that.

Idk if you've seen this already but Taalas does this interesting thing where they embed the model directly onto the chip, this leads to super-fast speeds (https://chatjimmy.ai) but the model they're using is an old small Llama model so the quality is pretty bad. But they say that it can scale, so if that's really true that'd be pretty insane and unlock the inference you're talking about.

Pangram is probably the best known example of a detector with low false positives, they have a research paper here: https://arxiv.org/pdf/2402.14873. They do have an API but not sure if you need to request access for it.

For humans I think it just comes down to interacting with LLMs enough to realize their quirks, but that's not really fool-proof.

This comment seems ai-written

https://gemini.google.com/share/8cef4b408a0a

Surprisingly, it got all of them right