fortyseven

Did the app work?

Can't wait!

Or, considering you're already considerable markup, you could just make a little less money on each one... HAHAHA I'm just fucking with you Apple.

I use Pi and Qwen 3.6 27b locally on a 4090 for all my personal projects. I still use Claude for day job work since they pay for it, and my employer expects me to use it. I rarely touch it otherwise.

I remember when "Facebook Gold" used to be a joke.

It's my daily driver, so I kind of twitched a bit saying that list in here. I never noticed because I was using it anyway, I guess.

This is really good. I'm going to adopt this I think. Yoink! ;)

Nothing like ignoring the spirit of the thing by turning it from one line to nearly a dozen.

Oh no!

It's a bit of a contradiction. We understand that AI can be used usefully, and to great effect. But if someone else uses it, it's a potential liability.

I think the issue is, we understand our own usage of it, and respect the boundaries of what's possible and what needs to be done to use these tools properly.

But we don't know how the other guy is using it.

We don't know if they're being responsible, and using it in a safe manner.

If they are: great. But if they aren't, we're opening ourselves up to all kinds of security shenanigans.

It's one of those things where we're only going to be okay with it, if we're the ones using it. But that also means other people will be suspect of our code.

It's really a no win scenario, except for inside each of own little bubbles.

That's how I'm finding I feel, too. It's not that I don't use LLMs myself, but I trust myself enough to know how to filter that data that comes back from them and compare it to actual facts. I don't necessarily know the processing of this information from the other person, to trust that they vet the information properly. So instead of it being helpful to me, it becomes incredibly irritating. Especially because I just know they're going to expect me to take that data at face value quite often. And then it's going to be on me to vet the data. How about you just let me get the data myself and cut out the middleman?

Just burn the whole fucking internet down. We can't have nice things.

I wonder what's going wrong there? Personally I found compatibility and performance on Linux to be extremely good. And just keeps getting better. And that's not even just me, that's all kinds of benchmarks out there. Sorry to hear that. : ' (

I think once the hype dies down, and things start to normalize, the hate will fade into the background. Instead of "AI", we'll just get "apps with features" again.

Well you're fun at parties, I bet.

Funny, I know quite a few extremely talented programmers who cautiously approached the topic, and found that, with proper use, they've found LLMs to be extremely useful. Just a matter of understanding where the boundaries are, and using them responsibly. It's not a magic genie, it augments their existing skill.

I'm with the username like that, I'm sure we're going to get an even-handed, well thought out and reasoned discussion about all of this.

To be fair it's been quite a while now since OS/2 was relevant. It never even occurred to me that it might be connected to that mainstream news story.

Been LOVING Pi so far!

This is why, despite enjoying all of this, I really want to focus on locally hosted models. If we don't host the technology ourselves, we're setting ourselves up for a hard fall down the line.

Until very recently, local models been little more than brittle toys in my experience, if you're trying to use them for coding.

But lately I've been running Pi (minimal coding agent harness) with Gemma4 and Qwen3.6 and I've been blown away by how capable and fast they are compared to other models of their size. (I'm using the biggest that can fit into 24gb, not the smaller ones.) In fact, I don't really need to reach for Claude and friends much of the time (for my use cases at least).

Glad I used a privacy.com burner when I bought from them. Quite a while later I found a declined purchased for pizza on the now long-deactivated burner card I used to purchase through them.

You are going to have a hard time living in the future.

You... wash your phone in the sink?

Give Gemma4 a look, too. I've had terrific results with that and OpenCode locally.

Strangely, I haven't had a lot of luck with vLLM; I finally ended up ditching Ollama and going straight to the tap with llama-serve in llamacpp. No regrets.

These companies control content by exerting pressure on those they either control directly or indirectly, by denying them and their customers access to their services, if they in any way threaten the profitability of their business.

And when this kind of power it's consolidated with a handful of companies, you leave people with nowhere to go for any kind of real success. So you're forced to compromise your vision in order to get any shelf space.

Money money money money money money money money money.

Money.

Weird. A great number of my medical or legal queries are actually answered, but come with a disclaimer, often at the end of the inference. (I'd offer up some examples, but I'm not at the desk.)

I also find that you can coerce a wide spectrum of otherwise declined queries by editing its initial rejection into the start of an answer. For example changing the "I'm sorry I can't answer that..." response to "Here's how..." And then resubmitting the inference, allowing it to continue from there. It's not perfect, sometimes it takes multiple attempts, but it does work. At least in my experience. (This isn't Gemma-specific tip, either. Nearly every model I've tried this with tends to bend quite a bit doing this.)

4090, 128gb of ram (long before you'd have to take out a loan). I'm fairly sure it would run just as fine on a 3090.

Thanks to the settings suggestions in the article, I was able to squeeze in the 31b model. Still testing, but it's real tight in 24gb of vram. A bit slower, too, but usable. Not sure I'm seeing much of a quality boost yet, but I'm still testing.

I've been VERY impressed with Gemma4 (26B at the moment). It's the first time I've been able to use OpenCode via a llamacpp server reliably and actually get shit done.

In fact, I started using it as a coding partner while learning how to use the Godot game engine (and some custom 'skills' I pulled together from the official docs). I purposely avoided Claude and friends entirely, and just used Gemma4 locally this week... and it's really helped me figure out not just coding issues I was encountering, but also helped me sift through the documentation quite readily. I never felt like I needed to give in and use Claude.

Very, very pleased.

Anyone else think of the film 'Hangar 18'; specifically the alien language they find on the UFO?