Show HN: Write code using natural language

by tshepom • 7 years ago

209 109 7 years ago

king_magic• 7 years ago

This looks pretty neat. Thought about something sort of like this awhile back but never built it out, glad to see someone’s giving a try! Good luck!

matchbok4• 7 years ago

Cool experiment. Really shows how poorly conceived/verbose Auto Layout is. The first thing I do in any iOS project is add some sort of wrapper around all that constraint nonsense.

tannerc• 7 years ago

Can you elaborate your approach? I've been making iOS apps for a decade now but auto layout and constraints scare the bajesus out of me.

tshepom6• 7 years ago

Of course: the app draws from a database of thousands of snippets that are cleaned up and generalized with some scripting. Natural language queries are handled like search, with semantic matching over both natural language and code structures. Content within the snippet like naming, "subject"/"target", and values are dynamic (use # to modify those values) – but it still needs work. As for auto layout, I actually have a feature for that on the roadmap but wasn't sure it was a common problem – bumping up its priority!

matchbok4• 7 years ago

https://snapkit.io/

Makes life easy.

injidup• 7 years ago

This will just converge to some kind of lisp and then pragmatically end up as XML and then be thrown away when it is realised it is a poor imitation html.

Tehchops• 7 years ago

Is all "code of code" inevitably destined for a Lisp dialect?

imglorp• 7 years ago

"Any sufficiently complicated C or Fortran program contains an ad-hoc, informally-specified, bug-ridden, slow implementation of half of Common Lisp." - Greenspun's Tenth Rule

cleansy• 7 years ago

IMHO: There is a good chance that Lisp is pretty close to expressing "natural language" in code. I would argue that written text / prose is even a bad starting point. I'd rather think about having an UML Activity Diagram, add a way to add parameters / variables to it. Then visually imagine that you take away the full bubbles around the commands and just leave the sides. They look like brackets, right?

Now fiddle in a syntax for having parameters, maybe place them next to the text that describes what the program wants to achieve.

The next step is to define what the program or routine is actually doing, so think about step one again.

... Every time I think about a non-graphical way of writing a program as intuitive as possible I usually end up with some sort of Lisp.

EDIT: several edits for wording

swlkr• 7 years ago

Wow I really like this!

My main problem when programming against mac/iOS APIs is constantly looking up how to do the little things shown in the demo video.

I don't look forward to writing macOS/iOS apps but this makes me think differently.

epberry• 7 years ago

I think you've nailed it. Getting all the constructs right can be tough - Metacode solves that.

seisvelas• 7 years ago

This seems more like a helpful glue between documentation and code than "write code using natural language". Nevertheless, very cool!

carlmr• 7 years ago

I was thinking more along the lines of natural language snippet creation. I think one of the key problems here remains that you go from a ~30 word (+your own identifiers) vocabulary to a English language vocabulary where you're not sure how to express something.

The example says constrain x. I wouldn't have searched for constrain, but for saturation, min-max, limit, or something along those lines. I'm not sure this will work as well if you don't use the right vocab.

guiltygods• 7 years ago

Only Swift or it can handle any language ?

tshepom6• 7 years ago

Yup, just Swift right now, but collecting requested languages here: https://forms.gle/Yfgxn3yi4JHvjmD17

matchbok4• 7 years ago

More evidence that iOS really just needs a declarative UI format. Storyboards/IB are trash and doing it programmatically is fine, but slow and error-prone.

Grustaf• 7 years ago

If you think it’s trash it’s probably that you don’t know how to use them. I’ve been making glorious UIs in IB for half a decade.

matchbok4• 7 years ago

I know how to use them just fine, thanks. Anything that cannot be viewed/compared in version control or tested easily is trash. You cannot easily collaborate on complex IB or storyboards.

DanielBMarkham• 7 years ago

In a tightly-scoped domain like "write code in Vue.js" it might be really cool. Looking forward to seeing how this evolves!

But just like self-driving cars, once you start expanding the scope, and only just a little bit, it doesn't look so cool anymore. I would love to see how far they can take this.

Programming in the purest sense is taking problems that real people have, expressed in their own words, and creating a logical symbolic construct that automates a sequence of interactions that pleases them. Human language is an extremely fuzzy and messy affair involving all sorts of things like body language that don't transfer to writing. Programming is not like that. These are not just different things. These are completely different domains of things.

Neat. Best of luck, guys!

MuffinFlavored2• 7 years ago

I toyed with the idea that corporate business analysts (who write requirements for products then hand to developers) could just write in a different syntax and pass them to a compiler that makes:

1. database tables

1. API CRUD endpoints with validation / sanitation

1. screens with input fields

Most of the corporate work I did was very similar to this. It was either a batch job, a UI screen, or an API that talks to some other service.

barbecue_sauce2• 7 years ago

Isn't that what UML was supposed to be for?

GorgeRonde2• 7 years ago

What about www.hyperfiddle.net ?

joe_the_user• 7 years ago

But just like self-driving cars, once you start expanding the scope, and only just a little bit, it doesn't look so cool anymore. I would love to see how far they can take this.

It's beautiful the way you balance the pessimism of hard experience with an optimism borne of real natural language understanding being still an amazing possibility.

Human language is an extremely fuzzy and messy affair involving all sorts of things like body language that don't transfer to writing. Programming is not like that. These are not just different things. These are completely different domains of things.

That's rock such hopes founder on, sadly. Of course, there's always a chance someone will the passage between things that others have missed.

A more hopefully way to put is that natural language is a stream of symbols that where the unnecessary parts are removed, the other parts are actively interpreted by context and by the intent of the speaker, and where any ambiguity is sorted out by dialog. If you can create a system that can let you program similarly, you may have something.

Good Luck again!

throwaway55554• 7 years ago

Natural language is ambiguous. Grammars for computer languages are designed to remove ambiguity. A natural language that is used to program a computer, too, will have to remove ambiguity, thus only using a severely constricted subset of a natural language. Is it worth it beyond curiosity? If a person can't grok a computer language are they going to grok such a terse natural language?

The_rationalist2• 7 years ago

Only a Subset of features of natural langage introduce ambiguities, equivocations, etc. It is perfectly doable to force one and only one meaning per keyword (just like do programming keywords already (if, while, etc), removing the ability to use coreferences, etc I would love to see a great constrained English, formal without the readability and expressivity loss of formal symbolic grammars / formal maths

SilasX5• 7 years ago

Only a Subset of features of natural langage introduce ambiguities, equivocations, et

I wish! People won't even use "literally" consistently, despite it existing to prevent you having to guess which sense a speaker means.

Edit: Toned down.

stevenyoung• 7 years ago

'Only a subset'? What does that mean?

ryl00• 7 years ago

Sounds like you are looking for Legal-ese.

roywiggins• 7 years ago

Well, lojban tried.

https://en.wikipedia.org/wiki/Lojban

SilasX5• 7 years ago

Ruby on Rails is designed to add it right back in.

"Cookies set? Oh, that must be the plural of Cooky" -> actually happened in live coding demonstration before.

anamexis• 7 years ago

Or my favorite example: that at one point, the Rails inflector would singularize "police" as "polouse."

OJFord• 7 years ago

'Remove ambiguity' means 'choose a meaning', which of course means non-zero% chance you're wrong.

Alternatively, as you said, use a non-ambiguous subset. But then it's no longer a natural language, I wouldn't mind betting they're all ambiguous.

gridlockd• 7 years ago

It's not actually a "natural programming language", it's more of a snippet generator. The output is ordinary code and you still have to understand it.

I can see how this would be useful to quickly get the right incantation in certain verbose APIs, as opposed to copy-pasting code from API docs or Stackoverflow.

munk-a• 7 years ago

I don't believe there is a natural grammar that is unambiguous, instead I think in the realm of computer languages it's more a process of creating a jargon set that relates to terms but explicitly overrides them with unambiguous meanings within the domain.

For instance `new Object` - we're all going to read that as "create a new object that hasn't existed before" but within english a `new Object` could also be an antique you happen to have recently acquired, so `new` could be comprehended to be an acquisition action - like copying an Object - rather than creating a new one... But in our fancy computer language jargon we have forever banished the "new to me" meaning from `new`.

jason_zig• 7 years ago

Nice landing page, it made it extremely clear what your product was and how I might use it.

I'm usually skeptical about programming language abstractions but from the demo it looks like this is more of a "helpful addition" then something you need to fully commit to which is interesting. I don't do a lot of Swift but will keep this in mind if I do. Best of luck!

faissaloo• 7 years ago

If you want to understand why this is bad just look at AppleScript, probably the closest thing I've ever seen to natural language, the only problem is that it's impossible to just figure something out if there isn't a tutorial, because there's no real convention you can make guesses based on.

JadeNB• 7 years ago

AppleScript (and COBOL before it) was my first thought, too. Gruber calls the problem it exemplifies the "English-likeness monster" (https://daringfireball.net/2005/09/english-likeness_monster).

tshepom6• 7 years ago

Ah, interesting! The difference between Metacode and something like AppleScript is that the artifact left over from using Metacode is still the rigorous programming language you're used to. If we retain a query log, you could even convert your natural language queries into code comments alongside your code to actually improve clarity.

pvg3• 7 years ago

You're going to get a lot of comments like these because when you say 'natural language' and 'programming' or 'code' in the same sentence people think coding directly in some 'natural'-like language. Also people often don't click on the actual links and many don't necessarily watch endlessly looping video clips when they do. A little bit of verbiage on the site might help that and head off the more obvious-but-inaccurate critiques. .

abecedarius2• 7 years ago

Is there a summary in text? I don't watch videos without a reason.

tshepom6• 7 years ago

I wrote a comment about how it works: https://news.ycombinator.com/item?id=19985482. Will do a short blog post sometime soon.

abecedarius2• 7 years ago

Thanks!

NikkiA• 7 years ago

It searches stack overflow and inserts the top answer in your chosen language as code

carhartt• 7 years ago

It's actually kind of cool to watch the animation, the tool maybe can help teach people how to code in a much faster time-lapse way. I personally don't know how to code in Swift but I think I learned a lot just watching the animation and the different snippets. Maybe you can livestream your Metacode app on Twitch for a learning channel.

AdmiralAsshat• 7 years ago

Project will end when it discovers it has reinvented HyperCard.

zapzupnz2• 7 years ago

It's a snippet program. It's not trying to reinvent anything.

mistersys2• 7 years ago

Really awesome stuff for dealing with verbose frameworks.

In the code builder demo, it strikes me that all that code in swift could be replaced with a declarative format:

  let TestVC = viewController(
     button(
       padding: { left: 5 },
       width: 100,
       height: 200
    )
  )

And probably be easier to type than these snippet demos. Has there emerged a good declarative API for iOS? As a web developer, as much as I hate the insanity of the javascript tooling ecosystem it's hard to imagine going back to the spaghetti I see with swift/iOS apps.

tshepom6• 7 years ago

That would be awesome! But yeah nothing like that for iOS comes to mind.

modarts• 7 years ago

React Native?

mistersys2• 7 years ago

A couple of days later... SwiftUI looks.. amazing.

llamataboot3• 7 years ago

My "first" programming language other than BASIC as a kid was probably learning Inform to create interactive fiction with

http://inform7.com/

It was a pretty complex language, and meant to use English syntax to mix both the fiction writing and the coding. So you can end up with code that looks like the following, for example

---

"Stage is a room.

The old lady is a woman in the Stage. Understand "mother" or "stepmother" as the old lady. The old lady is active. The description of the lady is "She looks plucked: thin neck with folds of skin exposed, nose beaky, lips white. Perhaps when her fortunes are mended her cosmetics too will improve.""

---

And it obviously gets more complex as you create things like objects with weights and inventory limits etc. My experience of it is that when it worked it was pretty magical, but when it didn't it was utterly maddening to figure out how to get it to parse.

Kinda felt like a voice help that barely works.

Best of luck with this, I like where it looks like it is going, but it simply has to be /really good/ to be value-added and not frustration-added

pvg3• 7 years ago

This tool is almost, but not quite, entirely unlike Inform, though. The 'programming' part is still done in a regular old language like Swift. The tool finds and/or generates snippets for you and plonks them into the Swift code you're actually writing.

llamataboot3• 7 years ago

yes, I see that, I should have been more clear that I knew it was a separate domain. This looks more like extended and interesting macros. My only point was that when you move towards being able to express things in natural language - whether as programming or even getting Siri to call your friend, the frustration level can be much higher if it doesn't work as expected.

There is something about getting to talk in "natural lanaguge" some of the time, and otherwise having to repeat yourself while trying variations in syntax that just feels bad.

Since I was talking about Inform, probably analogous is the text adventure issue where you know /how/ to solve the riddle, but you don't know how to tell the machine that you know.

"Give lantern to crocodile" "Offer lantern to crocodile" "Put lantern on crocodile" etc

pushpop• 7 years ago

I’m someone who picks up new languages easy - regardless of their paradigm - and this is honestly the first time I’ve spent 10 minutes going through a languages documentation and still not been any wiser where to start. That is an extremely odd programming languages; fascinating too.

Kudos for actually being able to use it.

llamataboot3• 7 years ago

The docs are actually amazingly comprehensive, but it does have a pretty steep learning curve, especially as it is presented towards non-programmers, so you can't nec look up how to do a conditional very easily.

However, what really shines are the tremendously well documented full games. You can literally load them in Inform and play the game in one pane and walk through the code in the other.

I'm still not sure what to think of it as a language, I think now as a full-fledged programmer, I would pick an interactive fiction framework that looks a lot more like a programming language and less like fiction. However as a beautiful experiment in being able to use the English language to write a story and make it playable at the same time, it is still pretty amazing to me.

It /is/ a full-fledged language. You can implement weather or tides or magical systems or inventory systems or health points or anything else you can thing of, but it all reads pretty English-y...until it doesn't!

_bxg1• 7 years ago

Using NL as a macro system for quickly inserting code, instead of as a way to hide actual code, seems like a good use-case. I wish the website was more informative about how much you can do with it, how far it goes to automatically generate snippets, and what kind of language support it's planned to have.

scotty792• 7 years ago

Normally I'd be very sceptical but this just seems like a shortcut to googling the thing you need from stackoverflow and shortcuts are nice.

jasode3• 7 years ago

One way to look at Stackoverflow is that it's a gigantic index that maps "intuitive plain English" to "non-intuitive exact syntax".

A good exampe of bridging this mismatch is "git" commands. A lot of questions about Git are just translating natural English into the "secret decoder ring" lingo of Git.[0] E.g. "How do I undo a commit?" isn't something obvious like "git undo". Instead, it's the more cryptic "git reset HEAD~"[1]

A lot of the programming grind is like that. You know the English words for what you want to accomplish but don't know the exact programming syntax to make it happen. So this app is sort of like putting Stackoverflow lookups with copy&paste directly into the IDE.

In contrast, the existing "insert snippets" functionality in Visual Studio[1] or IntelliJ have abbreviations to help find templates of code but not quite the rich natural language of Stackoverflow. I wouldn't be surprised if future versions of those IDEs incorporate something like Metacode.

[0] so many "How to...?" in the most-upvoted questions tagged [git] : https://stackoverflow.com/questions/tagged/git?sort=votes&pa...

[1] https://stackoverflow.com/questions/927358/how-do-i-undo-the...

[2] https://docs.microsoft.com/en-us/visualstudio/ide/code-snipp...

Wump2• 7 years ago

100% agree with this take. I mentioned it in another comment, but I've actually been working on a project which is essentially a better search engine for programming questions that's integrated in your IDE.

When possible, you try to pull out code snippets from SO/github/reference sites/etc that answer the query with high confidence. (Essentially like "instant answers" in google, but making it better by focusing on programming questions.)

The challenge is the level of noise and ambiguity that you get back in search results, and actually sorting through that to surface the right answers.

SilasX5• 7 years ago

I agree that a lot of the unremovable difficulty in programming is translating natural English into something precise.

But I also think git often makes the problem worse by splitting similar operations unnaturally across different commands. I believe that was the motivation behind mercurial.

coldacid• 7 years ago

I thought git and hg both started around the same time, didn't they?

llaappqq• 7 years ago

Except languages are ambiguous. When you say you want to undo a commit, do you mean undo like pretend nothing had happened or undo but please keep track of the change.

That's why the first thing I do when I'm learning something new is to read the documentation to find out what capabilities are available.

Aeolun• 7 years ago

Right away? Or when you actually need to do the thing?

When I start using anything new I really only check that it can do what I need it to, not everything that’s possible.

ygra• 7 years ago

But those are two options of the same command. You can have a -keep-changes argument for undo and it wouldn't be weird or incompatible with the plain -language description.

0815test• 7 years ago

One way to look at Stackoverflow is that it's a gigantic index that maps "intuitive plain English" to "non-intuitive exact syntax".

It's not that syntax itself isn't intuitive; there's after all nothing more intuitive than, say, FORTH, LISP or Haskell syntax - surely it handily beats the weird idiosyncratics of "more English-like" FORTRAN or COBOL! It's actually the semantics of what you're interacting with, that, while simple, might be initially unintuitive to a naïve user. I don't think that I'm actually disagreeing with what you're saying; it's just that "not knowing the exact syntax for X" generally unpacks to something slightly different, namely "not knowing the relevant semantics to the extent that one can figure out how to do X". This, I think, is a better explanation of how StackOverflow might end up being quite helpful.

Of course, natural language itself does involve some semantics-related facets of its own, that might well end up being more intuitive than the programming-language semantics we normally use. But even then, we can (and should) use devices like Montague-semantics to give them an "intuitive", compositional syntax reminiscent of the lambda-calculus, Haskell or FORTH. I think this is the better way towards the goal of "using natural language to make programming more intuitive".

jimktrains22• 7 years ago

"How do I undo a commit?" isn't something obvious like "git undo". Instead, it's the more cryptic "git reset HEAD~"[1]

The issue with this example is that `git reset HEAD~` doesn't undo anything, and it doesn't undo _any_ commit, just the last one. It will also cause push and merge conflicts if the commit you're "undoing" was public, which may end up with you not really having "undoing" anything at all.

It's also not anymore cryptic than any other industry's jargon. It's a sentence that means something specific. It's somewhat, but not entirely, what someone _could_ mean when they say "undo a commit".

jasode3• 7 years ago

The issue with this example is that `git reset HEAD~` doesn't undo anything, and it doesn't undo _any_ commit, just the last one.

I shortened the question in my comment for brevity. The full question I cited on StackOverflow was worded as: "How do I undo the most recent local commits in Git?"

It will also cause push and merge conflicts if the commit you're "undoing" was public,

Yes, and StackOverflow answers also warned of that scenario. Again, the full SO question did ask about "_local_ commits".

It's also not anymore cryptic than any other industry's jargon.

In my comment, "cryptic" doesn't mean the syntax doesn't have its own internal logic that makes sense once one "groks it". It's just non-intuitive for someone who has a goal in their head but the only know plain English for describing that goal.

scotty792• 7 years ago

I'd prefer it to be "Show HN: Communicate with humans by writing code instead of using natural language"

bawllz• 7 years ago

Very cool!

Do you have any ideas for how to document the tool well?

Thank you for the smile this brought to my face :). Really imaginative and cool tool.

tshepom6• 7 years ago

Not yet, right now I just have a tutorial window that shows up the first time you use the code builder feature, and the videos on the home page. Open to suggestions!

Wump2• 7 years ago

I gave it a try; love how fast and simple it is! You probably already know this, but the set of snippets are somewhat limited at the moment (though pretty good for a first launch). Also, it would probably be helpful to have more descriptions/metadata around each snippet, so that you can use some NLP goodness to make search better.

I've been working on a related idea, which is sort of a search engine for programming questions integrated into your IDE (starting with JS in VSCode). The idea is to give you fast, relevant answers (code snippets when possible), and reduce context switching to the browser to keep you in flow.

Similar in spirit though; would love to chat more! (my contact info in profile; I didn't see a way to contact you)

aatharuv• 7 years ago

Cool.

For an older implementation of programming using a natural language, there's Lingua::Romana::Perligata http://users.monash.edu/~damian/papers/HTML/Perligata.html

Unfortunately for probably most people here, the natural language in question is Latin.

GorgeRonde2• 7 years ago

    nexto stringum reperimentum da.                     # $next = pos $
    nextum stringo reperimento da.                      # pos $string = $next;
    inserto stringum tum unum tum duo excerpementum da. # $insert = substr($string,1,2);
    insertum stringo unum tum duo excerpemento da.      # substr($string,1,2) = $insert;
    keyis hashus nominamentum da                        # @keys = keys %hash;
    keya hashibus nominamento da                        # keys %hash = @keys;

Wowfunhappy3• 7 years ago

One of the things I really like about Applescript is that, at least for simple tasks, the code reads as standard english. This isn't to say you can type anything in english and Applescript will interpret it, just that the correct syntax also happens to form real sentences.

Here is how I tell QuickTime to play NPR:

  set WNYCAddress to "http://www.wnyc.org/stream/wnyc-fm939/aac.pls"
  tell application "QuickTime Player" to open URL WNYCAddress

Here is how to tell if the file you've highlighted in Finder is on a specific drive:

  set theNameOfTheDrive to "Archive"
  tell application "Finder" to set theSelectedFile to the target of the front Finder window as text
  if theSelectedFile starts with theNameOfTheDrive then log "that file is on the right drive!"

Unfortunately, it all starts to break down when you get to more complicated stuff, but in the right situations it's kind of beautiful. I wish Apple had taken it a bit further...

microtherion2• 7 years ago

Wicked tongues have called AppleScript "Visual COBOL".

Wowfunhappy3• 7 years ago

Are we just comparing any old-ish languages we don't like to COBOL now?

Applescript has its problems but it's one of my favorite features in macOS. Maybe not the language itself, but the Apple Events capability. There's no equivalent in Windows other than AutoHotKey type stuff.

max0563• 7 years ago

The problem with this kind of stuff is that by due to the ambiguity of natural language, it becomes more complicated to actually do this at scale.

Also, you are essentially creating another programming language that I have to learn and I don't want to learn it.

"Writing code using natural language" should mean that I can write code without having to follow any kind of format.

I should be able to say "find the smallest item in the list" and "give me the smallest element in the list" and that should work the same way. Right now these natural language programming languages are still just that - programming languages.

marknadal• 7 years ago

So this seems to be more like a natural search for code components? Does anyone know if it is dynamic or using preset templates with adjustable variables?

I did a talk out in Italy[1] where I showcased an evolutionary programming language, one could take either symbolic input or fuzzy language input and it would "reduce" it to a symbolic interpretation - which would be really powerful for a non-programmer to slowly "learn" through interaction how to speak / write code more precisely.

I'd love to see other demos people have, too!

[1] https://vimeo.com/208899228/b9bc9eaaa4#t=23m27s (re-recorded for a webcast)

TBF-RnD6• 7 years ago

Okay so I came here expecring something different. Turns out that this is a stack overflow search engine.

So ever since I read a book on AI I have been pondering on when and how computers will steal our jobs.

I do have an idea on the subject though if anybody is interested in working with me on this please comment: So with github and loads and loads of other open source repos don't we have enough training data.

Couldn't throwing loads and loads of processing power on training an AI on commits create an intelligence with an "actual" understanding of day to day programming problems.

Love to discuss this please comment! Crazy idea but huge if it works!

YeGoblynQueenne3• 7 years ago

> Couldn't throwing loads and loads of processing power on training an AI on commits create an intelligence with an "actual" understanding of day to day programming problems.

I'm curious to know why you think it's possible to create "an intelligence" with "actual understanding" thanks to lots of processing power and data. What makes you think this is actually doable? Do you think that this has been done before, for example?

TBF-RnD6• 7 years ago

Okay so seeing how a brain is made up from 86 billion neurons. 16 of those in the most recently developed cerebral cortex. Randomly creating a set of random configuration of billions of neurons and then subjecting them to simulated evolutionary evolutionary preasure on the basis of how close they come to A) the correct solution B) compiling code that runs C) tests if available* Kill of the worst performing networks. Mate the most succesful and have the offspring replace those who where not fit enough for survival.

How would it work exactly, I wouldn't know which is sort of the point. But sooner or later representations of abstractions within the code would appear within the graphs.

I get that this is not either trivial and cheap. Let alone hosting the wast amount of source code and parse it would require computing power weighing in at quite a hefty sum.

Human beings probably have the advantage of having built in functionallity that we are born with encoded in our DNA.

I suppose that a fair bit of "intelligent design" would be required. That is having coded parses that breaks down the source code into input signals that would help speed up the evolution.

Even reaching halfway there could be useful. Say by providing useful analysis, maybe warn if something seem stupid. To some extent I believe that for a natural language programming language to be viable some understanding of abstract concepts have to be present in the algorithm. That's why I don't think we'll ever program via speech recognition for example. Whenever Siri is smart enough to parse what we are trying to do, why bother with programming. Why not cut the middle man and plug her directly into Jira. but I'd love to be proven wrong regarding this though.

I am by no means saying that it would be easy or even viable within the forseable future. Thank God for that because that would means unemployment for quite a few of us.

* As I am writing this it struck me that test driven development just happens to make this easier.

tylerhou• 7 years ago

https://arxiv.org/abs/1904.02818

Disclaimer: I work at Google.

TBF-RnD6• 7 years ago

Thank you and see my response to thomasahle!

thomasahle• 7 years ago

Github basically did this themselves using (comment, code) pairs as training data: https://github.blog/2018-09-18-towards-natural-language-sema...

TBF-RnD6• 7 years ago

I love it when I find that someone has done something that I've been thinking about. Proves that I am not crazy and saves me from the burden of putting in the hard work myself! :D

At a closer look I don't think that mapping up correlations in a vector space is good enough for the task of fixing bugs based on an issue tracker description though.

The way I see it word2vec is basically statistical connections. So if you compare it to google translate which also works via statistical correlation. Which explains the errors it might do. At some point to get a good translation you'd need human intelligence.

To continue with the google translate analogy. Imagine a translator trying to translate Fyodor Dostoyevski's The Karamazov Brothers to English. That person have to have a tremendous understanding of Russian and English culture not only now but also when it was written along with ideoms and so forth. Along with a deep understanding of politics and religion not to botch the job completely. Or imagine entering a greek epos written in hexameter into google translate and publishing the book.

So you see just as translation and translation might be two totally different things, search and making changes to source code might be different beasts.

Then again you are totally right in that they are doing it. Getting access to this datasource for minining is probably a huge factor in microsoft's purchase of github, so I'd think it would be a safe bet to say that they are working on it...

At least originally, I am sure it's an incredible complicated piece of software by now applying multiple heuresstics.

machiaweliczny• 7 years ago

The possible models where change C fits are unlimited. Code describes only behaviour but it's hard to guess intent. So unless languages won't be just specification languages (as close to describing intent as possible) then I doubt it's possible.

Anyway already part od programming work is deciding what you really want. Maybe that's where machines might help - with discoverability.

I actually think that more likely is some CRUD maker as an expert system? (you put what you vaguely need, answer questions and it comes with solution), doesn't need ML.

TBF-RnD6• 7 years ago

The same thing applies for a human to try to solve a problem as well doesn't it? And we have bugs and inefficent code don't we?

I remember seing a talk on youtube about a lisp program finding every program that would fit a certain solution. So reasoning about things like this is what a lot of lisp's gurus are doing all day long basically.

You are probably right about AI being used in an assitive part at first. I imagine it'll be a while until people dare putting their business logic in the hands of an AI.

Probably CRUD applications would be the first to be automated. Boring tedious work that has been done a million times. And unhappy coders are probably more prone to create bugs make bad decisions. Also there are litteraly thousands and thousands of implementations doing the same thing with variantions that are more or less just flavour.

Then again if you are at analyzing all open source software ever written. Why not plow through all open source issue trackers at the same time. If you found the top 20% bugs that cause 80% of the issues and have get an AI that solves 20% you'll be a very very rich man if you feel like it.

So don't expect to tell a computer to figure out the best way to create top off the line lossless video codec anytime soon or anything else. Then again it's hard to find a coder that you could tell that and get back the results you wanted either...

dugluak• 7 years ago

Visual Basic did something similar to Basic with drag and drop controls and writing most of the UI code for you. This seems like a command line version of same thing.

Show HN: Write code using natural language

Related Stories