HN user

tru3_power

507 karma
Posts1
Comments270
View on HN

I kinda felt like this was coming so mid last year I built a local rig with the top of the line parts I could afford at the time lol (rtx5090/ryzen9 etc) now I just need to build out my inference setup (sadly m3 ultras r insanely expensive now) - I have a feeling they will try to lock down usage of open source LLMs too. I don’t get how token moat can exist if local inference rigs can be built out and serve open source models locally for nothing (besides power cost).

What’s the purpose of licensing requiring though things though if someone could just use an open source model to do that anyway? If someone were going to do those things you mentioned why do it through some commercial enterprise tool? I can see maybe licensing requiring a certain level of hardening to prevent prompt injections, but ultimately it still really comes down to how much power you give the model in whatever context it’s operating in.

I circled back to this, The only mechanics I can think of and I’m not sure if it’s really even really a thing (maybe someone can chime in) is that market makers buying shares to cover their calls or something along those lines? How does one even really trace this type of transaction?

Yeah that’s what I’m understanding is the case. That’s why they’re harping on no known (unreleased) vulns. But it’s kinda funny, a lot of times bugs that fall under this category are constantly shuffled around/not fixed because there is no public pressure to address them.

So why couldn’t one make a malicious iot device/tool to do just that? I’m kinda confused on the need for access via some other exploit. (I have little domain knowledge on Bluetooth) - when you say scan/spoof/attack any near by device, is it ones that the target is already connected to? Sorry for dumb question

Yeah but this is just the name of the game. How can you even stop SEO style gamification at this point? I’m sure even LLMs are vulnerable/have been trained on SEO bs. End of the day it takes an informed user. Remember back in the day? Don’t trust the internet? I think that mindset will become the main school of thought once again. Which tbh, I think maybe a good thing.