If AI is so good at coding where are the open source contributions?

https://pivot-to-ai.com/2025/05/13/if-ai-is-so-good-at-coding-where-are-the-open-source-contributions/

by thm • 1 year ago

83 37 1 year ago

avbanks• 1 year ago

This is exactly what I've been trying to point out, while LLM's and coding agents are certainly helpful, they're extremely over-hyped. We don't see a significant bump in open source contributions, optimizations, and innovation in general.

drob5182• 1 year ago

Yep. It’s all frothy hype. It’s all crashing down at some point. The billion dollar valuations. Nvidia’s revenue. All of it. That’s not to say that it’s worthless, but everyone is throwing money around like the dot-com days and LLMs (thus far) are not nearly as transformative as the Internet. I’m even hearing that phrase investors use when it’s about to pop: “this time it’s different.”

api• 1 year ago

I lived through the late 90s and the dot.com bubble. This is exactly the same. The Internet was real but a lot of the hype crashed and a lot of ventures from those days failed.

LLMs are real but they are also overhyped and imbued with powers I don’t think they have.

The most interesting stuff with AI will be done after the bubble collapses.

johnisgood3• 1 year ago

I have made some "serious" contributions with the help of LLMs. Sadly I cannot share them, but hey, N = 1, so it is not significant.

pavel_lishin• 1 year ago

We shall add the anecdote to the bucket.

lalith_c• 1 year ago

maybe open source projects are prohibiting code generated by AI?

v3ss0n• 1 year ago

Where?, name them

rpdillon• 1 year ago

The article is actually pretty interesting. The only one mentioned is Curl, and that's because of abuses by uneducated developers using AI with no idea of what they're doing.

I actually think that's the central thesis of the article, especially the last example that discusses the LLVM compiler project getting raked over the coals after not engaging with a non-developer that had used AI to make pull requests, and admitted he had no idea what the code did.

Buried in the middle of the article is a paragraph that I think sums up the main point well.

More broadly, the very hardest problem in open source is not code, it’s people — how to work with others. Some AI users just don’t understand the level they simply aren’t working at.

The point being that without a good programmer, AI is not very useful.

MoonGhost• 1 year ago

Probably because AI generated code cannot be copyrighted. And the second reason it's not as good as AI sellers tell you.

mcny2• 1 year ago

Probably because AI generated code cannot be copyrighted. And the second reason it's not as good as AI sellers tell you.

Is this true? I anal but I have a publicly available GitHub repo which shall go unnamed where most of the heavy lifting is by Claude and Gemini. If I can't copyright this code, does that mean I can't license it under AGPL? If someone copied some code from my repo, does that somehow now taint their code as well?

My application is a simple console app. The original code mostly worked. I have been updating it for the past month or so when I run this application and discover some defect. I have tried hard to avoid the temptation to write much of the code myself with this application and only made minor edits myself, opting to try coaxing an LLM to do the right thing.

This is not for work or even remotely work adjacent but I have been pleasantly surprised by the code quality. It still doesn't replace a programmer but it is impressive for what is essentially a glorified autocorrect auto complete iterated a little.

heavyset_go2• 1 year ago

Is this true? I anal but I have a publicly available GitHub repo which shall go unnamed where most of the heavy lifting is by Claude and Gemini. If I can't copyright this code, does that mean I can't license it under AGPL? If someone copied some code from my repo, does that somehow now taint their code as well?

No one knows, it's untested in court.

As far as I understand, you can own and license the code you modify or create yourself, but if someone decides to copy and paste code they can prove came from an LLM that they found in your project, you don't have much of a standing to enforce your license on them.

drob5182• 1 year ago

You own your prompts. /s

protocolture2• 1 year ago

Is this true?

Depends. Probably not.

Code produced solely by AI with no inputs or modification is not copyrightable.

But theres an amount of human labor and direction you can mix in to pass that hurdle.

Likely:

1. If you never tell anyone its AI created it doesnt matter 2. Someone will test this in court one day and we will discover where the line is actually drawn

Until then you should follow the Terms and Conditions of the tool you use, it probably assigns you all applicable rights to the generated code.

Not a lawyer etc.

dragonwriter2• 1 year ago

Is this true?

It is true that products of purely a prompt passed through an AI and returned cannot be copyrighted in the US currently, whether a particular body of code that involves AI generation but has a more involved workflow can be copyrighted is a case by case question (for copyright registration you need to document the actual human and AI process and present it to the copyright office and they will make a decision; if you didn't do this at the time, you've probably accidentally rendered it unprotectable even if would have been were the facts documented. Technically, copyright exists at creation without registration, but since you can't sue for infringement without registration, if you make it so you can't register the copyright, you've basically made it unenforceable even if it might abstractly exist.)

I anal

IANAL should really be kept together and capitalized.

but I have a publicly available GitHub repo which shall go unnamed where most of the heavy lifting is by Claude and Gemini. If I can't copyright this code, does that mean I can't license it under AGPL?

Absolutely. AGPL is a copyright license. If you have no copyright, you can't enforce any licensing restrictions. You can obviously include uncopyrightable-because-of-how-it-was-generated (and therefore public domain, unless it is violating someone else's copyright) code along with other code that is AGPL licensed, but you can't enforce the AGPL terms on the code you don't have a copyright too, because the copyright is what gives you permission to prohibit uses of the exclusive rights of copyright (copying, derivative works, etc.) that you haven't licensed.

If someone copied some code from my repo, does that somehow now taint their code as well?

No, if they copied legally-unprotected code from your repo, it has no adverse effect on their repo. They, too, cannot enforce any licensing restrictions on the unprotected code, because neither you nor they have a copyright on it to enforce, but it doesn't adversely impact their ability to enforce their license on any of the code they have that is protected by a copyright.

heavyset_go2• 1 year ago

Your modifications are owned by you.

Gigachad• 1 year ago

How would this even be enforced? If I privately used AI to generate some code and then post it on github. How could someone verify if it was written by me or AI to decide if copyright applies or not?

SpecialistK• 1 year ago

It's pretty obvious that AI code generation is not up to snuff for mission-critical projects (yet? ever?) - it can prove handy for small hobbyist projects with low stakes and it may provide time-savings and alternative perspectives for those who subsequently know how to sniff out BS.

But even airliner autopilot systems, which are much more mature and have a proven track record, are not trusted as a replacement for two trained experts to have final control.

The overall trend I've seen with AI creations (not just in programming) is that the tech is cool and improving, but people have trouble recognizing where its suitable and where it isn't. I've found chatbots to be fantastic for recipes and cooking advice, or banal conversations I couldn't have with real people (especially after a drink...) and pretty shoddy for real programming projects or creative endeavors. It isn't a panacea and we'd benefit a lot from people recognizing that more.

jsheard• 1 year ago

I keep seeing users of the AI-centric VSCode forks impotently complaining about Microsoft withholding their first-party extensions from those forks, rather than using their newfound AI superpowers to whip up open source replacements. That should be easy, right? Surely there's no need to be spoonfed by Microsoft when we're in the golden age of agenic coding?

rerdavies5• 1 year ago

How could somebody who has actually used coding assistants be asking for evidence of open source projects that had been 100% written by an AI? That's not what the tools are used for.

Here: https://rerdavies.github.io/ About (at least) 30% of the NEW code in my open source repos are currently written by AI (older code is not). I don't think this is extraordinary. This is the new normal. This is what AI-generated source code looks like. I don't imagine anyone could actually point to a specific AI-generated chunk of code in this codebase and say with certainty that it had been written by an AI.

I can’t help feeling that people who make these sorts of complaints have not used coding assistants. Or perhaps have not used coding assistants recently. Are non-professional programmers writing about AI coding assistants they have never used really any better than non-programmers submitting AI generated pull requests? I think not.

davidgerard2• 1 year ago

of course, that doesn't answer the question Evans was asking at all.

rerdavies5• 1 year ago

The question Evans asked:

    But if AI is so obviously superior … show us the 
    code. Where’s the receipts? Let’s say, where’s 
    the open source code contributions using AI?"

The answer I provided:

    Here: https://rerdavies.github.io/ About (at least) 
    30% of the NEW code in my open source repos are 
    currently written by AI (older code is
    not).

The point I wanted to make: code currently written by AIs isn't obviously different or segregated from code that is not. That's not how the tool is used.

kazinator2• 1 year ago

Open source dev here. I cannot merge something generated by AI, because it is plagiarized, and therefore incompatible with the project license (pretty much any license: BSD, MIT, Apache, GPLn, ...).

A significant contribution to a project requires that the the contributor put a copyright note and license on it. The license has to be compatible with the project being contributed to. (Note: I'm not talking about copyright assignment, but, yes, that's a thing also, e.g. with GNU projects.)

You can't put your copyright notice and license on something that you generated with AI.

Small changes to existing code are in a gray area. They are more based on the existing code that the unauthorized training data, but the latter is hanging over them like a spectre.

I won't merge anything knowing it was done with AI, even a one liner bug fix. If AI were used to describe the issue and propose a fix, and then someone coded it based on that, I think that would be okay; that's something analogous to a clean room approach.

jwitthuhn• 1 year ago

There are some but not a lot, current AI is a lot better focusing on smaller more well-defined problems than stuff like "add this feature" or "fix this bug".

A good example is this PR for llama.cpp which the author says was written 99% by AI. https://github.com/ggerganov/llama.cpp/pull/11453

When the problem statement can be narrowed down to "Here is some code that already produces a correct result, optimize it as much as possible" then the AI doesn't need to understand any context specific to your application at all and the chance it will produce something usable is much higher.

Maybe it will eventually be better at big picture stuff but for now I don't see it.

rerdavies5• 1 year ago

The problem I have is keeping up.

Current generation coding assistants are capable of doing things they could not do mere months ago, and are dramatically more capable than they were a year ago. I recently gave my coding assistant a task that was much larger than I usually trust my coding assistant with; and it produced a very large chunk of code that was remarkably well implemented. (And then rewrote about 2/3 of in order to add an innovative feature. But still).

As things stand at this particular moment, I am unsure of the upper limit of what I can trust this month's AI coding assistant with. Learning to use ones' tools properly is a big part of programming.

vborovikov• 1 year ago

I recently discovered an open source project which I believe was completely vibe coded. 90k lines of code, 135 commits starting from an empty project.

I cloned the repo and tried to run the examples. Nothing worked. The problem was many data structures and variables were initialized empty/zero but the code wasn't designed to work with empty data at all.

ramity• 1 year ago

I think it's fair to say AI generated code isn't visibly making a meaningful impact in open source. Absence of evidence is not evidence of absence, but that shouldn't be interpreted as a defense to orgs or the fanciful predictions made by tech CEOs. In its current forms, AI feels comparable to piracy where the real impact is fuzzy and companies claim a number is higher or lower depending on the weather.

Yes, open source projects would be the main place where these claims could be publicly verifiable, but established open source projects aren't just code--they're usually complex, organic, and ever shifting organizations of people. I'd argue the metric of interacting with a large group of people whom have cultivated their own working process and internal communication patterns is closer to AGI than coding assistant, so maybe the goal posts we're using for AI PRs are too grand. I think it's expected to hear claims from within walled gardens, where processes and teams can be upended at will, that AI is making an unverifiable splash, because they're precisely the environments where AI could be the most disruptive.

Additionally, I think we're willfully looking in the wrong places when trying to measure AI impact by looking for AI PRs. Programmers don't flag PRs when they use IntelliJ or confer with X flavor of LLM(tm), and expecting mature open source projects to have AI PRs seems as dubious as expecting then to use blockchain or any other technology that could be construed as disruptive. It just may not be compatible or reasonable with their current process. Calculated change is often incremental and boring, where real progress is only felt by looking away.

I made a really simple project that automatically forwards browser console logs to a central server, programmatically pull the file(s) from the trace, and had an LLM consume a templated prompt + error + file. It'd make a PR with what it thought was the correct fix. Sometimes it was helpful. The problem was it needed to do more than code, because the utility of a one shot prompt to PR is low.

flembat• 1 year ago

I let a popular agentic ai refactor some code for me today, it looked really nice, but despite the fact that it was meant to be splitting a file full of functions that already compiled and worked it rewrote them all and broke them comprehensively, it then tried to research how to fix them, even though working code was right there in the file and just kept making the code worse and worse. It also had some limit which meant it left the code partly refactored, ran out of its quota left everything broken and then when restarted suggested refactoring some more classes.

If AI is so good at coding where are the open source contributions?

Related Stories