HN user
This is great - and another example of how much more efficient CLI tool use ends up being in actual day-to-day use. Claude Code and Hermes took it in and it runs great in my initial tries at it. Thanks for making and sharing it!
Another endorsement - I used Kokoro pretty extensively with an app I was developing over the last year and it's been excellent, both on- and off- GPU. Even with Elevenlabs (long time subscriber) the comparative quality of Kokoro keeps up really well until you get to their larger models with their professional voices.
I do wish there were better support for SSML, as well as deeper documentation of how to influence inflection in-line, but the default does well with standard emphasis (e.g. putting asterisks around text elements). Both asks are getting outside the zone of reasonable asks for this sort of distribution, though, and I remain incredibly grateful for the quality of what hexgrad and nazdridoy have put out in the world.
It's worth being careful here: a lot of the affordable enterprise-class routers from 10+ years ago aren't as fast as cheap consumer hardware - like the OP or just a decent mini PC. The primary arguments for the enterprise-class gear are around feature availability and certain aspects of reliability (redundant power/fans, better heat tolerance, higher quality components). It's also worth remembering that this kind of gear tends to be built for dedicated environments: loud fans, higher power draw/lack of power saving features, etc.
Beside the potential performance and environmental issues the other big downsides tend to include firmware availability - either because download from the site requires a login on the vendor's site or, increasingly commonly, the gear has hit LDOS and images just aren't posted. Obviously there are other "unofficial" places for such images, but the risk/legality are a whole other (potentially serious) question.
There's an additional issue mapping the requirements of home networking to enterprise gear: Ethernet switches are lousy firewalls (little or no NAT, primitive built-in security, DLNA/mDNS and friends aren't really sane options, etc). Finally, even at "1/5" the price the gear may still be quite a bit more expensive than other options. And if it's not expensive, it's usually because nobody wants it any more because of the issues mentioned above (being near- or beyond- LDOS).
FWIW this is from someone who literally built a commercial-class machine room in his house with dedicated AC, subpanels, commercial UPS, etc for data center class Ethernet, Fibre Channel and Infiniband switching as well as carrier-grade routers and still runs "enterprise" grade WLAN and switching and can lay hands on as much as I could reasonably want without too much drama or cost... Going down this road can absolutely be amazing if you either have a.) the background to properly source and run the hardware/software or b.) have a driving desire to learn how to do so or c.) have some very atypical requirements for home networking. Otherwise it tends to not be something to be done lightly.
It depends on what's meant by "fully utilized" but fp8 quants of Nemotron 3 Super, the latest Minimax, Cohere A+ and the Mistral small and (especially) medium variants all sit in that 128-256 category, especially with full context or even moderate concurrency. In fact, in a 192GB environment I work with (Hopper GPUs, fwiw) I was pushed into using 4-bit quants with a couple of those to get the model working with a reasonable context window (..but 256 would have rocked out).
There are also nvfp4 quants of Qwen 3.6 27/35 floating around. I've done benchmarks of both and the quality difference vs fp8/bf16 was barely notable. Honestly the nvfp4 capability is the most interesting feature of the Spark (at least for me).
There is at least one MCP server in Obsidian's community plugins, plus the REST API access capability which is already addressed in several open source MCP plugins.
I use Obsidian as a persistent context store and knowledge graph (..loosely defined, i.e. link/back-link) for both Claude Code and Hermes, while also using it to generate live Wiki pages for working documentation. The native replication and the Git integrations work well keeping it all synchronized across multiple harnesses, as well. I use the native MCP server mentioned above, plus just letting the agent work with the markdown files directly.
That said, having built out all of this manually I'm excited to try out something that addresses much of this out of the box. I'd also be curious about the integration with Hermes/OpenClaw/etc.
It *is* hard to make memory, especially HBM (...which is what the AI market wants, and is what the manufacturers are focusing on) and bringing on new capacity takes years. There's the additional wrinkle that the manufacturers we have left are the ones who survived periods where the market was glutted with oversupply in the wake of previous shortages.
These decisions play out on the order of trillions of dollars and 3+ year horizons. They're also incredibly sensitive to other geopolitical issues (Taiwan, issues with Chinese tech capability vs export/import controls, etc).
There are a lot of valid discussions to be had about how we got to this state of oligopoly: Taiwan's consistent sponsorship of its semiconductor capabilities and the subsequent concentration of technology (expertise, capacity, etc), the lack of investment/support (and ceding of technical leadership) in Western countries, the various rivalries with China and the implications of it becoming a first-class producer of semiconductors at scale, etc. None of those discussions and none of their potential outcomes can substantively change that we're going to continue in this situation (massive price increases, spotty availability, etc) for at least the next 18-24 months.
It’s usually open loop - closed loop, so closed loop goes through CRACs or liquid cooled equipment manifolds. That heated water circulates through an heat exchanger on the roof that uses open loop cooling to shed the heat to the surrounding environment.
In terms of platform variants the Taurus outsold the Crown Vic by a fair amount. The latter was certainly hugely popular as fleet vehicles, but the Taurus was Ford's best selling sedan for quite a while. The Taurus was never rated for anything more than fairly light-duty towing (<= 1500lbs).
More to the point - at least for automatic transmission variants in the early 90s - even the base F150 could certainly out-tow Crown Vics of the time, unless the latter had a tow package, which would push the rating up to 5000 lbs (..same as the lower end F150). Later on the delta was a lot greater (in the truck's favor) as the tow packages for the cars were phased out.
Nowadays the minimum ratings of F150s (even with shorter beds) is 5000lbs, or more. The smaller CUV/SUV platforms are usually rated ~1500lbs *max*, with some of the larger truck-based models obviously running in the same range as the trucks.
TL;DR - Even back in the day the "typical" sedan was still only rated for towing small loads, unless specially ordered with towing packages. Now..all that said, the frequency with which typical F150 owners ever actually tow anything is a whole other question.
Genuine curiosity: Is there any speculation as to what these tools are keying on to reject those particular applicants? It seems like it just being the applicant's name is too easy an answer, but I could be overthinking it.
The commentary on hand-created signage was especially fascinating. The observations about the use of computers "enshitifying" design sort of eerily echo a lot of the commentary about AI now, including the (not unfounded) fear of the loss of human inconsistency, and the beauty it can bring.
I have the $100 plan and had almost never run out of credits until I started using the ultracode / workstreams feature w/Opus 4.8..at which point I managed to blow the full 6 hour allocation in like 20 minutes, or so. In fairness, it did some amazing things with the extracted information, but it also strongly suggested that I'd need the $200 subscription *plus* a budget for extra usage.
Maybe it’s naive, but there’s something incredibly hopeful that there are folks not only protesting this kind of corruption, but also that there’s a government actually responding to the voice of the people. That the EU’s own legal frameworks might positively (if indirectly) affect things is even better.
I don’t think the analogy between rock star developers and LLMs bears out here. Like any other tool, AI abides by the basic reality of garbage in/garbage out. If you don’t make sure the LLM has sufficient context then you get what you get. Same point with vague prompts.
AI tools are producing code on behalf of a developer. If that developer is fine putting their name on code that they don’t understand, applied to a code base they also don’t fully understand then you have a very human problem. The technology just magnifies this.
I always knew the "point" was there, but never saw it actually used in my travels (..which finished in '90 or '91). I seem to recall the node lists at some point didn't have decimals, but perhaps my recollection is inaccurate.
99:9008/206 / 1:137/206
They implied it might have options with < 128G of memory. That could significantly reduce the price of components. There's also the very real possibility that the whole venture is being subsidized by Microsoft - or even NVIDIA itself - as a bid to get into a different space. Even with that, though, I doubt it will be cheap.
There are still a *lot* of sharp edges with the Spark: compatibility, overstated performance, power consumption/heat generation, etc. It's one thing to have that situation on a box explicitly aimed at developers and quite another with an actual consumer-focused laptop.
For some value of "well supported" - NVIDIA's own internal catalogs (libraries, NIMs, etc) are still spotty on aarch64 coverage.
Thus does kind of beg the question: If developers are being laid off because AI is better/faster/cheaper or makes all their people 10x or whatever fig leaf, what happens if the required tooling ends up being more expensive? From the investor’s point of view is the drag of employee costs better or worse than a ballooning expense item?
The $48K also isn't fully sunk cost - there's a non-trivial residual value for those GPUs at the moment and likely for a few years yet. The server has a depreciation curve that's pretty enviable, actually!
Cultures of patronage are fertile ground for mediocrity.. very much a running theme in the history of human organization.
It seems like LLMs are actually pretty good at the sorts of things needed to manage a high-volume mailing list (summarizing, looking for dupes, sentiment, flagging things, etc), even if only as augmentation for human eyes.
That said, I get why this would rankle a lot of the folks involved.
Cisco's fiscal year closes at the end of July, which makes this time of year the season for reorgs, LRs (as they're colloquially known) and the usual maneuvering that leads up to establishing budgets, sales quotas and the like. It sucks that this kind of thing has become so normalized now.
I'm not sure we'll ever really be free of the GIGO (garbage in / garbage out) principle. Tools will get better and better, but can never be a substitute for a deep understanding of the thing we want to create.
Not to be glib, but is there any industry where management consultants have been shown to make a statistically significant difference either way?
I wonder if a part of the problem isn't just the misapplication of LLMs in the first place. As has been mentioned elsewhere, perhaps the agent's prompt should be to write code to accomplish as much of the task in as repeatable/verifiable/deterministic a way as possible. This would hopefully include validation of the agent's output as well. The overall goal would be to keep the LLM out of doing processing that could be more efficiently (and often correctly) handled programmatically.
Wouldn't this immediately put the American companies producing these models at a significant disadvantage? Just use an unmolested model hosted by a provider in Vancouver.
If anything, this measure seems like it would create a scenario where services hosted outside the US would become a lot more attractive relative to Trumped AI.
The general idea is to have the LLM maintain longer-term context/background by storing it in a format/structure that's akin to a standard Wiki. The result is (hopefully) a series of human-readable and editable documents that's developed and maintained by the agent.
There's great coverage of it at https://gist.github.com/karpathy/442a6bf555914893e9891c11519...
It's actually also now a base capability in the Hermes agent and has been really helpful for me, at least.
The arc of the technological universe is short, but it bends toward enshitification.