HN user

drvdevd

1,178 karma
Posts11
Comments565
View on HN

I don’t have a good list of which games I validated in parallels and which I didn’t (since I’ve stopped gaming for the last 6 months or so).

And I do heavily play boomer shooters so it’s likely I was impressed by performance of less demanding games.

Doom Eternal is one AAA game I definitely would want to play in Parallels but can’t because the Vulkan version is not new enough. I’m confident though that Microsoft could bring these APIs up-to-date on an “ARM PC” though, if it has capable 3D hardware.

This appears to be an architectural vulnerability where a speculative execution side channel similar to Spectre can be utilized within Safari or any other browser. The specifics of which environment is exploitable comes down to the specifics of the JavaScript-based gadget they use to trigger/measure this side channel. It may be in the linked paper which I haven’t read yet.

From a cursory review of the FAQs on the page it appears one mitigation might be to only keep one browser tab open at a time? They appear to be using timers and a cache eviction gadget to infer the state of other browser tabs/processes so it’s unclear what they can recover if you are not concurrently having a session to a particular site outside the gadget execution context. ???

This is an interesting thought and I have to agree it’s a legitimate issue. I have also considered something similar - that in the near future, if all software is designed with AI, or “generated” rather than explicitly engineered, we would certainly reap some benefits from that but we would also cease understanding how anything actually works. Obviously no one person fully understands the abstractions we have currently engineered when considering the totality.. but at least currently we have them.

I share this opinion as well, I think. I’m looking at any CRUD app I’ve worked on and thinking: this is just a specification over a database. Same with most other software but the web and most mobile apps seem ripe to just become generated patterns.

I think I agree with you on how I felt at the end of the post, but at the beginning and most of the way through, I found myself generally agreeing. But I want to look past the “bitcoin” switch after the bait because I generally agree with the author on most points.

Especially as I have delved more into how LLMs actually function and are trained, a lot of the magic in e.g. ChatGPT has evaporated for me, but in a good way. The performance of larger models like GPT-3.5 or 4 is still consistently impressive, to me, but as I’ve increased my understanding I do believe that censorship poses a greater threat than the models themselves.

Perhaps I’m misunderstanding the law or article, but wasn’t the author implying that the act of inference on an LLM model itself is a sort of “statistical experiment”:

In probability theory, the law of large numbers (LLN) is a theorem that describes the result of performing the same experiment a large number of times.

And so the mean in this case is “perceived like a real human”?

This is an interesting idea but is it feasible? What does “filter these vectors” mean? In the context of deep models are we talking about embedding specific models, weights, parameters, etc at some point in memory with the hardware? Are we taking about filtering input generally and globally (on a general purpose system)?

Gonna leave my footprint on this one too. Here’s my take since my favorite app on my Meta Quest 2 is actually Immersed (for virtual desktop / multi monitor setups): I’m less interested in either Apple or Meta here because I think Apples Vision Pro ideas just reinforce what we’re being told repeatedly: the industry wants to move away from screens, and the future is not screens. We have two big things on the near horizon now: AR/VR and AI. The industry as a whole will push these technologies until they are the norm. Smartphones, PCs, tablets and laptops (maybe even TVs?) will become legacy technology, but they will of course live on in emulated forms (a “window”). Conversational and ubiquitous computing will be the future, like it or not.

Indeed any AI defense capabilities will necessarily need to include some offensive abilities, which for the public are mostly censored right now (eg try asking for any of the obvious public PoCs which it almost certainly was trained on) I find it to be one of the worst aspects of the current alignment….

By driving down the costs of training and inference, and then encouraging experiments. For LLMs, QLoRA is arguably a great step in this direction.

Yeah and one of the fundamental assumptions around statements like “let’s make AI a licensed regime” is the idea that we know what AI even is. This idea is banking on current technology being the best algorithm or method to produce “AI” and the whole lesson from the “we have no moat” crowd is that this is actually quite uncertain. Even if they succeed in getting some class of model like LLMs under “regulatory capture” - the technology they are working with today is likely to be undermined still by something cheaper working on weaker hardware and with smaller datasets and it’ll probably happen faster if they seek this market capture.

So yes it is quite comparable to the export restrictions of the 90s.

But since Microsoft is involved and we are all of course thinking about Windows vs Linux, I think another good comparison is the worst assumption Microsoft made in the 90s: “we know what an operating system is and what it is for.”

While I agree that is a bit of an extreme statement (many companies are also adopting LLMs from what I've been reading here on HN), this part just below that does seem insightful:

Unless you work for OpenAI, your GPT leverage is likely wasted on trivial business code, and even more likely that due to the overwhelming amount of poor code, GPT with its 4/8k context window is unable to optimize, further weakening the leverage.

If you are sitting at a company in this situation it is of course arguable that you were already experiencing a negative return pre GPT-4, but certainly that productivity feeling from GPT-4 probably makes it seem even worse.

Perhaps this is one of the greatest paradigm shifts for traditional software engineers as “AI” becomes more commonly integrated: maybe we will have to use anthropomorphic language and maybe it will be considered the most technically correct way of talking about these systems due not only to their non-deterministic nature but also their emergent properties.

(This was a great post btw - highly recommend if you’re just perusing the comments)

I can say I read about 1/4 of the way through the article and although I’m interested in the authors research, I did get the feeling the author hadn’t actually driven an EV - which may not be true, but I agree the author didn’t touch on the idea that EVs may simply offer a superior driving experience.

I certainly can’t argue with this point. Except I will add that when I speak of a shortage of engineers, I am perhaps more speaking of a gut feeling on the overall quality of software the entire industry is putting out. There may or may not be a surplus of engineers out there to fill jobs, but there are a lot of hats an engineer has to wear if they actually want to drive systemic positive forward change, much of which is of course not really “engineering” at all.

Maybe what I’m trying to say is: for the vast majority of new-hires despite qualifications, they will consistently produce more technical debt and that debt will need to be paid from time to time. I believe the increase in popularity of LLM-type AIs will amplify this effect and make that debt more visible and urgent.