PHP code generated by GPT-2

https://gist.github.com/moyix/dda9c3180198fcb68ad64c3e6bc7afbc

by monort • 7 years ago

96 53 7 years ago

gist.github.com

Any context on what this is supposed to be...? I can vaguely read PHP, but the code does not appear to be doing anything of much substance.

At first I thought it was something to do with a second revision of GUID Partition Tables.

rahimnathwani• 7 years ago

Context: https://blog.openai.com/better-language-models/

bitexploder2• 7 years ago

It’s a text generation algorithm. It’s not meant to be real code, just look like it. This is the infamous “too dangerous to release” GPT-2 making this code.

userbinator2• 7 years ago

Reminds me somewhat of https://en.wikipedia.org/wiki/Article_spinning

...and now I hope that searching for code in the future won't become polluted by such spam.

tyingq3• 7 years ago

The tweets that go with this: https://twitter.com/moyix/status/1096255984866082816

fffrantz• 7 years ago

"Accidentally picked up" Somehow they must have fed it with some JavaScript and some php, right ?

kowdermeister2• 7 years ago

With sloppy scraping I guess JS was picked up besides text.

PHP should be intentionally used as training material.

tyingq3• 7 years ago

Yes. But that's the sort of hype that seems to be desired. "OMG zombies, we accidentally put some bad samples in the training data"

moyix3• 7 years ago

Yeah, the dataset was 40GB of text from pages linked from Reddit, so I imagine it was quite hard to clean it to just English text. They also noted in their paper that it "accidentally" learned to translate English into French, even though they removed non-English web pages, because of examples like

"I’m not the cleverest man in the world, but like they say in French: Je ne suis pas un imbecile [I’m not a fool]."

cheeko1234• 7 years ago

Anyway, I expect that what I just did – fixing up slightly broken bot-generated code – will be the most common occupation within 10 years

Imagine debugging code all day everyday for life. Oh wait...

ndpsr• 7 years ago

Still better than Wordpress core.

lmilcin• 7 years ago

I especially like how the comments have absolutely nothing in common with the code they are supposedly commenting, just like in real life.

smhg• 7 years ago

And almost-real naming like 'DbAppAndFNAAppRegistrationService'.

ahje• 7 years ago

That put a smile on my face on a bad day. Thank you! :D

aboutruby• 7 years ago

With some automated formatting: https://pastebin.com/7F2Leqy1

Navarr• 7 years ago

What on earth did you use to format that.

This will be far more readable to PHP devs; https://gist.github.com/navarr/a20284c0533ea6f6ebc0946d62c96...

munk-a• 7 years ago

Until GPT-2 can participate in a formatting holy-war all our jobs are secure. It's time to get worried when it starts posting opinionated comments on the internet about "how spaces make my code look the same on everyone's machine" that's when it'd be a good idea to invest in a bunker.

rbrtdrmpc-• 7 years ago

Look ma, no Laravel

beager• 7 years ago

This makes me think that something like Stack Overflow could be used to train a model that generates code to answer a question—and that software specifications that are decomposed into a series of requirements or "questions" could be fed into this model to produce code that's equivalent to a team of remote contractors.

Your model would be based on NLP/votes of the questions, NLP/votes of the answers, and separating the text from the code in both.

The fact that many markdown/code formatting tools have you select the language for syntax highlighting is useful for classifying code as well.

scrollaway2• 7 years ago

Finally, StackSort (https://xkcd.com/1185/) could actually be useful in a real world application.

52-6F-622• 7 years ago

My god—the JOBINTERVIEWQUICKSORT is just brilliant.

scrollaway2• 7 years ago

Important note: The AI did not generate that exact version of the code. It was almost syntactically correct. Here's the diff:

https://gist.github.com/moyix/dda9c3180198fcb68ad64c3e6bc7af...

yorwba2• 7 years ago

Also, the original in https://raw.githubusercontent.com/openai/gpt-2/master/gpt-2-... has two more lines.

The first

// web/application/handlers/add-full-no-app-directly.md (1071 bytes)

and the last

public function registerPipeHandlerInterceptor

cubano• 7 years ago

Just what I didn't need to see this morning.

I am literally living in the streets, freezing my ass off and hungry, looking for any kind of programming work for the past month, and now I have to see some AI bot generating more inexpensive shit code that I am sure some manager will convince themselves might get them that final career promotion by lowering their labor costs to near zero.

WTG, geniuses, for developing AI that before you know will have all of us living in the streets and hungry...

I'll save you a spot.

openbasic• 7 years ago

Where do you live? There's plenty of jobs in my area and my company is also hiring. I would be happy to help you land something.

leesalminen• 7 years ago

I see you’re proficient in a LAMP stack?

Gingrapp.com is looking for a developer. Our parent company owns many other companies as well and are always looking for developers.

My personal email is on my profile. Please feel free to reach out! I’ve helped find work for other devs down on their luck here on HN successfully.

PaulHoule• 7 years ago

They're going to have to make PHP that compiles before we lose our jobs...

jayar95• 7 years ago

PHP is interpreted o.o

52-6F-622• 7 years ago

People are downvoting your crassness, but I sympathize with your situation.

I don't know what Las Vegas is like, but there is a lot of LAMP/WordPress work here in Toronto. (Frankly, I want nothing to do with it, but there's plenty of it and they pay alright. Some also offer PT or FT remote)

---

The company I'm with is even hiring for such a role: https://twitter.com/scarbiedoll/status/1095714031023714305

---

Best of luck

root_axis2• 7 years ago

Welcome to the life of all the non-engineers out there either up to their eyeballs in debt or otherwise unable to earn a living wage. How many secretaries or data entry workers or webmasters were made obsolete because you were paid to destroy their job?

However, you don't have to worry, free open source tools and off the shelf B2B software will make your job obsolete long before AI is actually a time saver when writing code.

iamleppert• 7 years ago

I can sympathize with your situation but I have to ask: where are your friends/family in all this? You don’t have any support system at all? I realize it’s possible but I want to understand how you ended up in your present situation.

My next comment is you are in the wrong industry if something like this scares you. You have the wrong attitude. Instead of lamenting about a new tech replacing your current skills, you should be asking yourself, how can I learn this new technology and put it to work for me?

Some people may say someone in your position has more important things to worry about and I would agree. Get yourself the first job you can find (tech related or not) and get your basic needs in order. Then invest your time in learning a tech with some staying power.

Jumping from short lived and volatile coding jobs isn’t a long term solution.

kodablah• 7 years ago

Can someone shed more light behind this? What is the true source? Was it generated via the unreleased full model by an OpenAI employee? Or did someone generate it with the released "smaller model"? Can we, the curious public, see the model and replicate the results?

moyix3• 7 years ago

I found it while browsing the "raw" samples generated by the full-sized model. You can read through them all here:

https://raw.githubusercontent.com/openai/gpt-2/master/gpt-2-...

The PHP sample is Sample 195.

pamparosendo• 7 years ago

It will be interesting when AI finds out there's no need for her to generate human-readeable code.

gambler5• 7 years ago

This is very fishy. You can get code like this by substituting words in identifier names for other words, but how can an algorithm trained on English dataset "learn" that keywords like 'function' and 'class' are exempt from substitution? I know most people here have unwavering faith in the magic of deep neural networks, but you'd need _a lot_ of examples to deduce this with any certainty, regardless of how you do it.

hnarn• 7 years ago

you'd need _a lot_ of examples to deduce this with any certainty

Are you saying that "a lot" isn't almost semi-trivial to obtain, seeing how much code is available online?

gambler5• 7 years ago

Why would a model trained on English texts see "a lot" of PHP code? What was the prompt used for generating this code?

xkapastel• 7 years ago

What is fishy? This isn't even state of the art for program synthesis. Here's another simple example trained on the Linux kernel: http://karpathy.github.io/2015/05/21/rnn-effectiveness/

I'm not sure what point you're trying to make. Do you think a neural net is not capable of generating the code in the gist? Because it's pretty easy to do that. The harder part that we're still trying to figure out is getting that code to do something meaningful.

gambler5• 7 years ago

Because there is a huge difference between generating C code by training on C code and generating PHP code by training on random internet articles.

root_axis2• 7 years ago

Did you read the GPT-2 paper? Frankly the english examples therein are much more impressive than this, and this certainly seems within the realm of possibility for GPT-2 based on some of the other emergent behavior of the model (e.g. inadvertent french translation skills)

gambler5• 7 years ago

BTW, I would like to point you to the MIT's project Genesis as an example of what a rule-based text comprehension system could do almost a decade ago.

glup• 7 years ago

I have been working with a group that is trying to clone this dataset and make it publicly available (https://github.com/jcpeterson/openwebtext), and I have noticed quite a bit of code in the scraped dataset. Future releases of our dataset will be pre-filtered with another LSTM language model that will filter sentences by their probability under more conversational / literary datasets.

chadbennett• 7 years ago

Motivated by this post, I decided to test it out. It's impressive how powerful the software is even with the limitations. I made a simple tutorial on how to test GPT-2 out for yourself at https://medium.com/heroic-com/how-to-quickly-generate-full-a...

PHP code generated by GPT-2

Related Stories