We're getting “helpful” ChatGPT generated comments on the Svix GitHub repo

https://twitter.com/tomhacohen/status/1607777182117662720

by tasn • 4 years ago

24 13 4 years ago

twitter.com

tasn2• 4 years ago

Here are a couple of others from the repo (same comment author):

https://github.com/svix/svix-webhooks/issues/453

https://github.com/svix/svix-webhooks/issues/714

KenRuf2• 4 years ago

Have you tried replying to it? Would be curious if it's made to automatically reply to you or if its just some person copy/pasting chatgpt outputs.

theossuary• 4 years ago

It's interesting how easy it is to tell a piece of text was generated by chatgpt. It has its own writing style, I wonder if that's something easily varied? Like, you could ask it to write a response in a different style, but would it still come across as chatgpt to humans?

geon• 4 years ago

You can ask it to write in the style of a pirate or a 1950s movie gangster. I’m sure it could do a rudimentary Linus Torvalds.

slang800• 4 years ago

These comments are easy to identify as ChatGPT because their style makes no sense in the context of a GH issue discussion. They're overly verbose and contain unnecessary caveats like "there may be other solutions that would be more appropriate depending on the specific needs of the project". Nobody who knows about the project they're commenting on would write that. They would mention what the other solutions are rather than being intentionally vague.

In another context, like SEO blogspam, this text wouldn't look out of place.

thedanbob• 4 years ago

I bet it would, because it’s not so much the style as the overall structure. Every response sounds like a mini school essay. Intro, body, conclusion; authoritative, yet vague; perfect grammar and punctuation.

pfedak• 4 years ago

https://github.com/search?q=+commenter%3Aswarna1101

retrieves other issues that user has commented on. Some have code, but it's usually examples/boilerplate except when previous comments cited a relevant snippet.

sharemywin2• 4 years ago

Rephrase the last comment to be short and sound 100% like a human:

"We want to pass the state object to a worker and use it to manage connection pools and other resources. To do this, we will need to modify the server code to pass the state object to the worker and use it instead of the Axum Extension. The worker also needs to be able to access and use the state object to manage resources. It's worth considering if this is the best solution for the project before implementing it."

sharemywin2• 4 years ago

rephrase below with simpler words:

"We want to give a worker a state object to help them manage connection pools and other resources. To do this, we need to change the server code to give the worker the state object instead of the Axum Extension. The worker also needs to know how to use the state object. Before we make these changes, we should think about if this is the best way to solve the problem."

tasn2• 4 years ago

They both sound much better, but still are essentially zero-substance drivel.

KenRuf2• 4 years ago

Rephrase as if it was written by a 5 year old:

"Typhoeus is a special thing that you can use with the gem, but it's not necessary. You can change the gem so that you don't need to use Typhoeus if you don't want to. You can also remove the part of the gem that uses Typhoeus if you want. It all depends on what you want and what's easy to do."

We're getting “helpful” ChatGPT generated comments on the Svix GitHub repo

Related Stories