HN user

rileyphone

1,186 karma

object technologist

https://rileystew.art/

Posts8
Comments482
View on HN

Absolutely, plus if you control the coding agent you can enforce certain guarantees and have it wrap your services with a custom sdk. I've been exploring this pattern in a couple of different domains where it's just a vite react app wrapped in an iframe with a JWT bridge giving auth, hosted on a separate domain.

Here's one: AI democratizes the ability to produce software, which has mostly been an arcane craft wielded by a priestly class. Now anyone, if they know what they want and it isn't too complex, can talk to AI and get working (if not also janky) software in a very short amount of time. Hopefully this breaks the grip that platforms/large corporations have on personal software and the internet.

Pretty neat! Really like the design and minimalism. Oh, and the free hosted models :-) (but I assume that's just for the demo). Kind of confused by the open in cursor button but otherwise clean.

It seems like there's a lot of stuff out there that's similar, but it's all either focused on art/roleplay on the one hand, or enterprise teams on the other. Most prompts I see are shared as raw text on twitter or something, to be lost in my bookmarks...

Anyways, here's a prompt. Next time I see an actually useful one out there I'll hopefully remember to save it on Prom.

https://prom.dev/p/where-is-mama

Location: Seattle, WA

Remote: Sure

Willing to relocate: No

Technologies: Javascript (Node/Web/Bun), Linux, Python, SQL (SQL Server/MySQL/Postgres/Sqlite), Azure, k8s/docker, React, Typescript, and many more

Resume: https://rileystew.art/files/resume.pdf

Email: me @ the above domain

Website: https://rileystew.art/

I'm a generalist with a focus on backend and infrastructure -- in my career that's meant a lot of diving into logs, probing systems, and solving distributed bugs. In my own time I am working on an object-oriented Javascript framework and a custom autoencoder for visualizing latent states of LLMs. Looking for the opportunity to build something great and solve interesting problems.

From talking to people, the average user relies on memories and chat history, which is not easy to migrate. I imagine that's the part of the strategy to keep people from hopping model providers.

I got a Sovol SV06 ACE a few months ago as it seemed to have most of the nice features of the Bambu (like auto bed leveling) without the closedness. The printer runs Klipper and you can ssh into it. So far there's been one issue where I had to replace a fan but otherwise it's been great. Much cheaper than a new Prusa too.

Firefox has made Mozilla billions over its lifetime by selling the default search engine rights to Yahoo and Google. Chrome, having a much greater user base, would demand a correspondingly higher fee (probably around $10b a year). Now, the other problem is there is no other search engine to compete with Google at that level, but that might change with independence of Chrome.

Codestral Mamba 2 years ago

Gemini is probably using ring attention. But scaling to that size requires more engineering effort in terms of interlink that goes beyond the purpose of this release from Mistral.

In that case there are two attractors - one towards the Golden Gate Bridge and one towards the harmless, helpful, honest assistant persona. Techniques as such probably get weirder results with model scale but no reason to think they get wiped out.

There's also the oceanic currents carrying warm water from the gulf. Europe is in a very lucky position.

Meta Llama 3 2 years ago

The bigger size is probably from the bigger vocabulary in the tokenizer. But most people are running this model quantized at least to 8 bits, and still reasonably down to 3-4 bpw.

128GB in one chip seems important with the rise of sparse architectures like MoE. Hopefully these are competitive with Nvidia's offerings, though in the end they will be competing for the same fab space as Nvidia if I'm not mistaken.

With an MoE you only need to train a smaller model which you can then combine into an x8 and finetune/train the router. Mistral used their 7B base to make Mixtral, Qwen's new MoE uses their 1.8B model upscaled to 2.7B, pretty sure Grok also trained a smaller model first.

LLMs aren't nearly as monetizable (now) as search ads. Very possible that search collapses in the near future alongside the open web, and that whole line of revenue destroyed.

Nice! I started a similar project with a rotary phone a couple years ago with asterisk (just to the point of making a test call). Wish I had heard about the Windstream device, I ended up getting a pulse to tone converter and a PAP2T to voipify it, but those seemed to work. If I decide to pick it back up again I will check out your scripts.