monegator

It's them who don't want to be in the same room with me, they don't like their to have their bluffs called on

If you are looking at upvotes as a measure of support OpenAI

who, but an incredibly dishonest person, would ever think that?

Feels like i'm missing the introduction paragraph in the repo.

What is LoRA in this context? the communication protocol? Or another term appropriated by LLMs? Why the speedrun?

Is really any guarantee that they even follow those?

No, there isn't. I just don't understand how naive (or imbecile) people are. The most valuable thing for these companies is people's data used for training, so giving unrestricted access to a tool from them and believing they will never take advantage of it to gobble up whatever they want from your computer, just because they told you they'll never do that, swearsies, is naive, or incredibly stupid.

Insulate yourself, or better yet, go local whenever possible, and there isn't much you can't do local if you have enough patience.

to me this article feels like an exercise in creative writing rather

because it is. Previously: https://news.ycombinator.com/item?id=43571851 / https://ai-2027.com/

that would be implying that "private" really means anything for AWS. Because if it's "private" as in "private" github repos that were totally not used for training copilot because they said so or "private" claude chats that are totally scanned even if you have enterprise contracts to check you are not doing anything malicious or are from china or whatever, and this will totally not be used for training...

can we trust any US based service to guarantee privacy and confidentiality? especially to us european frienemies?

And then you have repacks.

It's basically impossible to find any game that isn't on GOG that is not shared as a repack. You don't get the installer, you don't get the original media, you have to trust that the repack is not filled with malware. (and also the repack process somewhat confuses wine/lutris. More than once i couldn't make the repack run on my linux box, but if i managed to find the genuine install medium.. or if i ended up buying the game on sale, then no problem)

friends of friends simply need all that sweet government grant money

really? I have to keep making useless updates (just a version number bump) on one of the accounts i manage, because i keep receiving thread emails every 6 months that the developer account sees no activity and if i don't do anything they will remove and close.

that app is a done project and need only to be udpated when the target SDK becomes too old for the play store

Good. Now, if only they also fought against developer integrity..

https://keepandroidopen.org

but until this comes to edge gallery i won't care

Meta is actively sponsoring the bills in my country. They go as far as ads on TV and Radio, something that never happened before

Mediamarkt already had the neo on "special price" (launch price) until the end of this month, it was pretty obvious what would happen

Here we have a 15% limit on scanning for fair use

Soon, when even the enterprise subscriptions will have ads, every session will begin with a mandatory generated image:

you would NEVER distill a model..

He goes way too far though

that's what activist have to do to shake people

Hey! That's exactly what lobbyists against regulations would say!

But cloud is what will enslave them to the corporation's will.

Google (of all companies!) demonstrated you can get useful stuff with reasonable performance with model running local on their smartphones.

Depending on your expecations you can get the local models running on a recent enough laptop, you just need 16GB of ram to be comfortable. It certainly exceeded my expectations (but i don't use the LLM to write code, only to do the real boring stuff: docs.)

I have not called musk redarded, i have called the idea retarded.

Same as master branch or master/slave communication idiocy. People that get this hung up really have too much free time on their hand, or have too much to gain in discussing language instead of discussing the actual problem.

For example: see how many commenters here are debating words instead of debating the validity of yet another hype-inducing value-pumping statement for clueless investors and fanboys.

On local fintech radio the week it was first announced they spent 3-4 days discussing the financial implication, then just one discussing the feasibility. Guess we're lucky we got one whole day of engineering discussing things for a change

exactly.

oh, no it's exactly as jimmy valmer puts it, there is nothing against mentally disabled people, it is just it's something so stupid that one can't even decide were to start to describe all the points in which is stupid, so stupid doesn't possibly cut it

yes musk said that, but that's retarded, a statement made to fill as many bingo spaces as possible

gemma runs pretty well

I've been trying local models for the boring stuff you might be thinking about: writing small docs.

So i've tested a couple, and the speed is finally impressive. My colleague uses paid tiers of claude and GPT, and the speed is comparable. Maybe even slightly faster on my end.

The problem is: i'm running the model on my work laptop, a 12th gen i5 with 16GB of RAM (which, you know, i asked to upgrade to 64, but that was right at the time of the great RAM shortage of the '20s) so i'm pretty limited in what i can use. And this is running alongside the usual suspects: Web browser hugging 1.5GB, MPLABX hugging 3, windows taking at least 5 just to sit idle, thermal throttled to 1GHz ... And yet its speed is comparable to a paid service. A lunch's worth of tokens vs a few cents of power.

So, what i found, what i fount... What i found is that i need AT LEAST 16k of context window, otherwise they will halt when i pass a small C file for analysis. And coding models will shit the bed with 4k. But we all know that, context size is King.

I found out that Qwen will keep looping while thinking, but that's not a surprise to you, either. But give it enough time and you will get an useful answer. I was hoping to using it as a better warning system for some languages, but i fear i need muuuch more context size, because i tried to feed a file that had a function with an endless loop:

At 4k context it almost shit the bed if i gave it just the offending function, then told it where to look at. At 16k context, with the whole file, it needed some guidance to what the problem was, and after 10-15 minutes of thinking it found the issue. Problem is, it kept second guessing itself for another 20 minutes on the same unrelated thing before giving the output. For which the fix was wrong, but the semanthic was correct. Good enough. Maybe it will be faster if i don't ask for a fix (which i didn't i just asked to look for a specific issue)

Wish i had 3 times the RAM so i can see what happens with more context.

Then i gave it the task to analyze a C file to make an API document. It took half an hour, but then i had a good starting point, which i had to keep changing because it would confuse commands with IDs and things like that.

This was the Qwen 3.5 9B model.

I then tested Gemma 4, being impressed at the tokens per second it gives on my Pixel 8A. Same tasks: same issues with short context, with long context it gave absolutely useless answers when looking at code, but it took 1/3 the time of qwen.

In producing documentation, instead, it was much faster, and it never hallucinated data. Good. in 15 minutes i had everything done.

Not bad for stuff running on a business laptop, while doing actual work.

Tomorrow i will try Qwen 3.6, let's see how it goes..

Full blown war: putin scared that more territories will want to join the EU block. No internal wars and more countries wishing to enter the block.

Powerless without american hardware and intelligence: You wish. Big tech is spending so much lobbying our governments in fear of us leaving them for open solutions, or god forbid paying fair amount of taxes.

And regarding intelligence, we would have been so much better without the CIA & co spying our politicians and messing with our governments, aiding and sponsoring domestic right wing terrorism for the past 50 years.

Ah, if (2) happens i will just walk out. No more brain. I refuse to work on those conditions.

And if that's the situation everywhere, i'll just go back being a tradesman, i love working with my hands, and there's been abundance of work for any skilled individual in any trade for more than a decade.

Now, my attitude may change when we get back to decent prices for hardware capable of running local models. I can be fine with local models, but not the current corpo owned shitshow. See what's happening with anthropic. They reserve the right to keep the chats for security concerns if you use bad words in the prompt, even if they are breaking contracts. Gee, who would have fucking guessed? Their most valuable asset is their training data and OF COURSE they're going to suck up new brain activity from everywhere they can. (like who was really surprised when it came out that microsoft was training copilot on private repos?)

the EU has demonstrated for decades that by balancing trades, equality and human rights it can prevent conflicts from happening.

Seems to me that most of our friends in the balkans that have memory of the past wars are overall pretty happy about the current state of things, and there hasn't been wars to contend Alsace-Lorraine in 80 years, is it a record already?

War is very much not a given in the civilized world

And just a few days ago i was being called out because i considered anthropic "evil"

I mean, did nobody ever get the vibes, never see a pattern emerging? (well they don't or they wouldn't be so amazed by pattern recognition machines on steroids)

re: SUNO

i actually was discussing that with a guy i met the other day, an old school producer, did succesful stuff 30 years ago. He used SUNO to reinterpret old and ideas of his, in his judgement it did an excellent job and lets him create many songs daily if he want.

Sounds familliar? the good old "let AI be steered by experienced X and boost productivity".

All in all, gun to the head, i think i am so critical because to use these tools is surrendering to big corpos. It is not a democratic tool. If it was i would probably be using it. I have finally given up and started messing with local models (well, i did already with images) but general local models are useless.

OR maybe it's me? i cannot for one moment let go and converse with the machine. I can give order to the machine.

The tech is fantastic, but the fact that it's in the hand of corpos with all interests in never letting us be able to do shit without them, makes me one hundred and one percent against it.

Hear me out: what about just refusing to use them?

why would i ever want to use a tool that remove the part of my job that brings me joy? Fuck productivity, we were already doing good, when we were able to actually do our job, i.e.: not wasting hours in useless meetings, or doing customer care to idiots who could not be bothered to follow instructions, which i shouldn't be doing in the first place. let the LLM do that, or let the human assisted by the LLM do that. Not my job.