lwarfield

Its interesting seeing how many of these researchers became the heads of frontier labs!

For beginners I'd recommend the Welch Labs Illustrated Guide To AI if your not well versed in reading papers. Its a beautiful book that I've enjoyed going through. I'd recommend going through these papers after reading that to get a deep understanding.

Do they state if they used an API endpoint without a system prompt, or were these done via prompting the currently existing chatbots with a system prompt? Without a system prompt, I'd imagine there would be more variance in answers.

There's also lowering the number of experts you run in MoE models.

Yeah, it's kind of mind boggling that Ted Chiang (of all people!) can't imagine intelligence without a body. and the whole thing just begs a lot of questions.

Damn, what a line!

Another thing that bothered me with his baseline for consciousness was that it did not involve the ability to change one's self. A big part of being conscious in my mind is how one's experiences shape them, and how someone can shape themselves. LLMs completely lack this, their weights are static. An LLM isn't going to be molded by a bad breakup, or a relative passing away. An LLM isn't going to set up a routine to get stronger with training, nor smarter by reading up on a field.

This is some real "There is no claw in ba sing se" stuff.

Well that didn't take long.

I do a lot of lindyhop Swing dancing as a hobby. It's not innovative work, but I find it rewarding.

Damn, I need to going with my embeddings project. I've currently got a prototype for using embeddings (not gemini in my case) for making a game that's kinda reverse connections:

collections.lwarfield.dev

I've always thought the really low bandwidth support they added a few years ago was to support the french subs. It matched all the requirements of VLF/ELF communications.

I ran into this guy nere Interlaken 2 days ago! Had a nice long talk at the post office over how he was going to present this in Geneva. I heard that this is result is with little or no rejection drugs as well!

When I broke a joint in my pinky a few years ago it was pretty easy to tell. Early on the range of motion was the limiting factor, and I'd move it back and forth as much as I could without any pain. After that I worked on strength in a similar way, do as much as I can with no pain. I went from "you'll never play an instrument again" to rock climbing and Viola practice.

Overall, seeing my strength and range of motion slowly get better was immensely satisfying and your body is pretty good at letting you know when you're getting close to a limit.