tpurves

You are assuming there are not naked shorts out there.

"Latent space representation" I have been waiting for this moment in the evolution of AI. Well, waiting with some trepidation. It seems inevitable that frontier AI's will, at some point, leave behind human-comprehensible representations of language. Purely for functional reasons, it's going to start making sense for AI agents to communicate amongst themselves in much more efficient ways than borrowing the languages of flesh-bag humans as an interface medium.

I Imagine next that programming languages, interfaces and API design starts going this direction next. Being written, expressed and optimized as blobs of high dimensional vector space. As humans we might still be able to understand some abstractions of what our AI's are talking about to each other, but maybe not more so then we understand how different regions of our own brain communicate with each other.

this strategy worked to keep Ukraine alive, by enabling them to throw literally anything and everything they could obtain into the fight. And the system enabled rapid experimentation and evolution of what works. Also they didn't have enough of anything to equip all units equally or fully, so a market-like system of was also a way to triage short supply.

However the logistics costs of fragmentation are very real (relevant to the supply chain theme of this story). And now that Ukraine is producing the better part of 10 millions(!) of drones per year, they are shifting towards more standardized drone models to simplify logistics, achieve more economies of scale and also now to have the capacity to keep units equipped more evenly and reliably.

An unfortunate series of events that this thing ended up with these specs at 1,049.00. It was supposed to be cheap and cheerful. At first Steam took an opportunistic deal to buy up a bunch of near-obsolete-already chips from AMD to build a low-cost box around. Then years of delays and an explosion in DRAM and SSD prices and here we are.

4 year old chip design on an equivalently old process node, not that unlike nvidia selling 2-3 year old chips as the spark. Thanks to AI boom, consumer market really just getting the warmed-over leftovers here from AMD and NVDIA.

I do think local models are huge pending market opportunity for Apple. An M5 Ultra Mac Studio (if that exists) could be decent local AI machine, though so expensive as to stay niche. But by the M6/M7 generations and a recovery in DRAM affordability, the future could be interesting moment for them to deliver a compelling local AI platform that 'just works'. But I do think that a mini-pc that is easy to configure, can be always plugged-in, always on, higher power envelope than a laptop, but not obnoxiously loud and hot, is the right form-factor

Not to mention quitting in droves because very many don't want to take these cases or otherwise to stand in court and explain why current admin is not bound by existing laws, court orders, the US constitution in general, or internationally recognized human rights etc.

This has already happened. Home PC market is practically dead already due to memory, ssd and graphics card price inflation. Makers of components like PC cases and power supplies etc. are seeing demand down 30-40% year over year and this is going to put many suppliers out of business. NVDIA has stopped even listing gaming revenue on their earnings reports. Both NVDIA and AMD are not seriously interested in supplying the consumer GPU market anymore either.

The only hope left is really Apple, but even apple has conspicuously delayed the launch of M5-gen mac minis and mac studio. Mostly because even Apple can't source enough DRAM to fully supply all their product lines.

China does not have sufficiently leading edge fab capabilities to fill DRAM demand.

> find a reliable place to sell it without getting ripped off by scammers.

This is a real problem and why I've just about given up on ebay or fb marketplace, esp for computers. If you are in Canada though sellit9.com is a great solution to having to deal with sketchy buyers.

Well in that case, I predict you are going to be in luck!

@Ademeure Where do you think the market will be by the time, say year from now, when Apple has rolled out it's M6 generation? Do you think one more process node and architecture revision will be enough yet to tip the balance that local LLM starts to go mainstream?

What this article fails to mention is that there are also a record number of empty tankers routed to the US refineries right now, with the intention of shifting still-relatively cheap US oil products to overseas markets where the prices are already much higher and shortages have already hit. The effects of the Iran war on the US economy will really start to kick in over the next several months.

I haven't been in a mcdonalds in decades because they have zero options for people with food allergies (I developed celiac midway through life).

Nobody is using LLMs to make lending decisions. They are using LLMs to read, extract and audit the supporting documents that go into normal well-tested, compliant and rules-based underwriting systems. And firms A/B test against humans doing the same work. The outcomes your are looking for are metrics like delivering faster results back to customers, with fewer mistakes and less fraud, more compliant, than a comparable human-only process.

Thanks for flagging this, I was literally seeing the same thing with protechts.net in my activity tab this morning as I was trying to understand why firefox was aggressively draining my battery.

If it's not US and it's within a few percent of SOTA that might be good enough for a lot of people (eg Europeans)

The conceptual problem is that we keep wanting to compare AI behavior to that of traditional computers. The proper comparison is comparing AI, and how we trust or delegate to it, to the concept of delegating to other humans or even to domestic animal. Employees can be trained and given very specific skills and guidelines but still have agency and non-deterministic behavior. A seeing eye dog, a pack mule or chariot horse will often, but not necessarily always do what you ask of them. We've only been delegating to deterministic programmable machines for very short part of human history. But ad human societies, we've been collectively delegating a lot of useful activities to non-perfectly-dependable agents (ie each other) for a very long time. As as humans we've gotten done more that a few notable things in the last several millennia with this method. However, humans as delegates or as delegators have also done a lot of horrific things at scale to, both by accident or by design. And meanwhile (gestures broadly around everywhere) maybe humans actually aren't doing such an optimal job of running and governing everything important in the world?

When compared to how human make a mess of things like in the real world, how high does the bar really need to be for trusting AI agents. Even far shy from perfect, AI could still be a step function improvement over trusting ourselves.

The real 'hype' was that the oh-snap realization that Open AI would absolutely release a competitive model to Mythos within weeks of Anthropic announcing there's, and that Sam would not gate access to it. So the panic was that the cyber world had only a projected 2 weeks to harden all these new zero days before Sam would inevitably create open season for blackhats to discover and exploit a deluge of zero-days.

Yep this was the moment to finally remember to cancel my cursor subscription. I find it unconscionable to do business with someone who would do business with Elon.

Like with all new tech trends, it takes them a hot minute to catch up, but it's highly likely they will (eventually) release some killer platforms for local AI. The shared memory, high bandwidth and power-efficiency of their M chips is a near-ideal architecture. If/when they finally push out the M5-ultra, that could be round one (albeit still not at the best price/performace vs comparable cloud api tokens). A real mass-market killer device for local LLMs is still going to require some remediation of the global DRAM shortages, and maybe the M6/M7 generation.

The insight here is, that in current warfare, quantity is the quality that matters. And with quantity, cost of replacement needs to be low, platforms expendable, cheap to maintain and resupply. It, and it's support infrastructure, need to not easily be detected and targeted by drones while on the ground. F35 is not these things. It's powerful but brittle, and like many US platforms, too much value packed into too few platforms. Not enough sustain in prolonged modern conflict. A one-punch military.

This is such a dastardly psychological trick. Being slightly aswew really hard to fight the subconscious urge to reach out and 'fix' them. I almost want to rush out to a nearest McDonald's right now and buy one of these burgers so that I can make sure that it's buns are aligned properly....

Yep, I am in same boat. 32GB M1 Pro myself, and ya still a very solid machine. Thanks for that link.

So between AI and robots that can do this, humans are basically done right? I am going to bed.

Closest thing to a usecase I can think of are all military in nature. There's an argument that AI in space only begins to make any sense if the data source you are processing is also originating in space, and you need (for reasons) to run models on it in space before downlinking the results.

Maybe there's a very latency sensitive need to send realtime targeting information to a tomahawk missile in flight? But it's also too bandwidth, compute or cost intensive to send a firehose of raw spy-satellite data to a disposable one-way attack munition?

The data centers in space are actually for the spy satellites to use. That's all I got for practical applications.

It's not just chat. Remember image and video generation are on the table. There are already a huge category of adult video 'games' of this nature. I think they use combos of pre-rendered and dynamic content. But really not hard to imagine a near future that interactive and completely personalized AI porn in full 4kHDR or VR is constantly and near-instantly available. I have no idea the broader social implications of all that, but the tech itself feels inevitable and nearly here.

Either M5 Pro chips are finally here... or March is just the next time Apple can source any DRAM or SSD chips for the existing line!

In all seriousness, I am quite concerned for what the base model and upgrade pricing is going to be for the full M5 line, given the recent AI-driven DRAM supply apocalypse.

Ships of that era and leader had castles on both ends fore and aft. It's just the forward one than retained in usage as a sailing term, even after foredecks no longer looked like castles. The aft castle became a quarterdeck, a poop deck, a cockpit or a bridge etc.

Meanwhile, a built-up and elevated stern 'castle' is advantageous place to put the steering and command position, close to the rudder and with visibility of the whole ship, it's rig, plus where the ship is going. While maximizing mid-ship area for cargo. If you have to pick one end or the other, stern is the more comfortable end of the ship being most sheltered from wave action and weather. Being elevated and fortified also helps as a fighting/defensive position, but that is less important for modern cargo ships. 'Anticipation' isn't quite the right word as shipbuilders have always worked within the same basic design considerations and trade-offs, as the sea itself continues to enforce the same fundamental constraints.

[this is a reply to fourseventy] Looking up the violent crime rates by migrants in places like MN, it's effectively zero. As a rule, migrants and immigrants don't commit crimes at anything close to the rate of native US citizens.

Meanwhile in Minneapolis, the overwhelming majority of violent crimes (including aggravated assaults, theft, murders and sexual assaults) are being committed by ICE agents.

Your comment above should make more clear that the large scale healcare fraud you mentioned was not about Minnesota. It was nationwide, involved mass identity theft and large corporate scale white collar crime.