AlphaSite

AMD had an interesting take on this around a decade ago. Never went anywhere but very cool tech.

Reddit doesnt work because subreddits crosspolinate and float to the top so theyre rather prone to brigading and intermingling. We don't really get distinct subreddits anymore.

I think models will be a commodity sooner rather than later. This whole race doesnt matter. First mover advantage is real, but over enough time it wont matter.

It probably means they’re close enough that there’s no observable difference. Or better at every different things.

Yes. Make sure you’re not using the Gemma sparse models since they don’t have a small model to use. Also I removed all the image models from the workspace.

I knew a guy who worked on it tell me actions is just literally a fork from Azure Devops. Which is why it never really fit into GitHub.

I think for the same model wall time is probably a more intuitive metric; at the end of the day what you’re doing is renting GPU time slices.

Large outputs dominate compute time so are more expensive.

IMO input and output token counts are actually still a bad metric since they linearise non linear cost increases and I suspect we’ll see another change in the future where they bucket by context length. XL output contexts may be 20x more expensive instead of 10x.

its mostly because MCPs handle auth in a standardised way and give you a framework you can layer things like auth, etc on top of.

Without it youre stuck with the basic http firewall, etc which is extremely dangerous and this is maybe the 1 opportunity we have to do this.

The cool thing is you can host your own node with its own rules; you should host an anonymous server and you can set the rules.

I think if people had a use case for it they’d buy more of the damn things. Right now I’d never need a device separate from my spouse since I just don’t need one.

Make is useful and buyers will come. The never had issues selling multiple macs frankly.

Probably some custom model built for their hardware.

Speed would be nice, but more than that I want it to also manage Ruby installs. I’m infuriated at the mess of Rubys and version managers.

i assume therye trying to build some community before trying to standardise it.

Voting can be coordinated between the N cpus rather than an external arbiter (even making that redundant eventually required the CPUs to decide what to do if they disagree so may as well handle it internally).

Honestly. We used dex. It worked pretty well.

Ruby is a language that optimizes for the local maxima at the cost of the global maxima.

Now every library, company or code base has its own pattern and you have to learn its pit falls. Better to learn once, cry once and just deal with it imo.

As they say, good enough is the enemy of perfection.

eh. Ruby makes it easy to do the wrong thing. imo.

It’s another step in the right direction. These things take time.

Connection pooling has its own severe downsides in Postgres. Considering how limited we are by connection counts.

That was the whole concept behind KCP iirc. It was designed to provide tenancy atop 1 or more clusters.

Types don’t explain intent or gotchas. They’re also useful, but you need both.

While i think Latex is fantastic, i think there is plenty of low hanging fruit to improve upon it... the ergonomics of the language and its macros aren't great. If nothing else there should be a better investment in tooling and ecosystem.

Having a reproducible dev environment is great when everyone’s laptop is different and may be running different OSes, libraries, runtimes, etc.

Also docker has the network effect. If there was a good light weight tool that was better enough people would absolutely use it.

But it doesn’t exist.

In an ideal world it wouldn’t exist, but we don’t live there.

There are extraordinarily highly paying semi firms in the US, but neither Intel nor AMD fit that mould unfortunately.

I’ve never understood why that’s the case; they are also high leverage jobs where a few can do extraordinary work and be rewarded thus. Look at Nvidia. Their employees are well compensated and they stay and the company does fantastically.

I appreciate everything they’ve done but the group which maintains Pip and the package index is categorically incapable of shipping anything at a good velocity.

It’s entirely volunteer based so I don’t blame them, but the reality is that it’s holding back the ecosystem.

I suspect it’s also a misalignment of interests. No one there really invests in improving UX.

The employee isn’t allowed to pay for it. It has to be paid for by the employer (except premium processing and visa stamping fees (2-3k)).

That’s for people who already have H1Bs, this is the company trying to keep them long term by getting them a green card. The whole EB green card system is a bit of a mess.

Since H1B has a 6 year hard time limit.

I think apple calls them NPUs and Broadcom calls them XPUs. Given they’re basically the number 2 and 3 accelerator manufacturers one of those probably works.

I’d say where it’s more Important is when you need to manage database performance. This lets you design an api that’s pleasant for users, well normalised internally, while also performing well.

Usually normalisation and performance lead to a poor api that’s hard for users to use and hard hard to evolve since you’re so tightly coupled to your external representation.

I mean docker is orthogonal to package manager. It makes it easier to deploy but none of the other thing also have managers do are relevant.