Betty – English-like interface for the command line

by jrpt • 12 years ago

190 81 12 years ago

kelmop3• 12 years ago

I like this idea a lot. But why on earth it is written in ruby?! - I know the answer and it is "ok". But it is probably the reason why it won't never gain huge momentum, prove me wrong :)

AaronBBrown• 12 years ago

What language would you write it in?

kelmop3• 12 years ago

c :)

jkh123• 12 years ago

http://www.alicebot.org/aiml.html

dscrd• 12 years ago

Given that this program is mainly several regexp matches against the input string, perhaps perl or awk would be a perfect match here?

artyomkazak• 12 years ago

Doesn't really matter what it's written in as long as its logic is easily extendable by someone who doesn't know Ruby. Preferably without having to code at all.

kelmop3• 12 years ago

I knew my reply will be heavily hammered by rubyists. There is nothing wrong in the language but I think that shell tools should be written in C or in some other low level language without complex dependencies over ruby or java or python etc. or any other non-default installation stuff

rcfox• 12 years ago

You're not only being down-voted by Rubyists. For something that deals heavily with string manipulation and isn't speed-sensitive, C is most definitely not the best language to use.

TomasSedovic• 12 years ago

I'm afraid that ship has sailed a long time ago:

    $ for bin in /bin/* /usr/bin/* /usr/local/bin/*; do
    >     if [[ -f $bin && "$(cat $bin | head -c 2)" == "#!" ]];then
    >         echo $bin
    >     fi
    > done | wc -l

    544

I imagine most of these are written in Perl (though there's surely a fair amount of Python and shell scripting in there, too), but that's still a high-level language with a complex runtime and dependencies compared to C.

To be fair, there's still about twice as many compiled binaries on that box, but having system commands written in a non-C language is by no means an exception.

mixmastamyk• 12 years ago

"DSLs" are one of ruby's strengths, no?

andrewguenther2• 12 years ago

A cute tool, but seems incredibly limited. Why would I use any of these commands more than once if I can just alias them? While some of them might be useful I really just don't see myself using a tool like this.

singularity2001• 12 years ago

And just for the kicks:

function genie(){ query=`printf "%s+" $@` echo $query result=`curl -s "https://weannie.pannous.com/api?out=simple&input=$query"` echo $result say $result 2>/dev/null } alias hey=genie alias how="genie how" alias what="genie what" alias when="genie when"

me:~$ what is the root of pi It is approximately 1.7725

me:~$ how old is obama Barack Obama is 52 years old

hidden-markov2• 12 years ago

A PR implementing that for Betty: https://github.com/pickhardt/betty/pull/4

lukeholder• 12 years ago

me:~$ capital of australia

answer: Sydney.

hmm this is wrong, how to submit a fix for this?

source99• 12 years ago

From what I gather the developer is allowing users to use natural language so they won't have to remember arcane commands.

I have looked up how to do _____ multiple times because I don't remember the command or syntax. Creating an alias is nice but then I still have to remember my own alias or look it up.

This tool makes it so you don't have to remember anything. Assuming it works well it will yield a great user-experience.

afternooner• 12 years ago

It's some pretty basic regex, so you're going to have to remember the correct phrasing anyway,

jdc0589• 12 years ago

for real. everything you can do with this you can do with aliases for the most part. Plus, this actively prevents you from actually learning all the various core *nix cmd line utilities.

chrisrhoden• 12 years ago

by printing them before it executes them?

ppod• 12 years ago

http://xkcd.com/1168/

hidden-markov2• 12 years ago

The idea is awesome though.

omarhegazy2• 12 years ago

Really interesting program, although, as Andrew has said, seems kinda limited. That's not your fault at all; any early project will seem limited in scope. Given some popularity and extra effort, something like this could be the Siri of the command line.

Which gets me thinking -- is stuff like Siri and Google Now really just like this? Core set of pre-set commands surrounded by regex magic to recognize said pre-set commands? Interesting.

Begs the question : is it possible, using current knowledge in machine learning and NLP, to create a English-like interface for #{some_device_or_program_here} that learns and self-develops the English commands from the user? Sort of like how Bayesian spam filters (http://www.paulgraham.com/spam.html) don't have core preset hardcoded set of Spam-Related Words and classify them accordingly, but instead takes an initial corpus and then learns and self-develops from the user after that.

e12e6• 12 years ago

I think having a prefix (be that "betty" "b" and/or some "mode" for your shell) that signals you want to use natural language (with all it's ambiguity) is a good idea. The zsh way of suggesting "did you mean" rather than simply erroring with "command not found/invalid syntax" drives me nuts -- but a lot of people seem like it. Having a prefix allows you more freedom at "learning" -- ambiguity isn't so terrible if the user expects it (and the simple idea of just listing alternatives that betty uses seems like a great interface. Not as sexy as "I'm feeling lucky"-style (super-)high scoring wins, middling scores ties and asks user to pick -- but I think it may win on the principle of least surprise).

Anyway, it does seem that most proof-of-concept voice-control (as opposed to text-controlled) systems use a prefix too "siri"/"glass"/<microsoft had one, can't remember which, also they have "xbox". The idea is that if the mic is always on, you don't want your drones to blow something up, just because you jokingly told a friend "kill it with fire" in a voice call. Context is hard to get right for such systems, I expect the kinetic and similar systems can do better (if user looks at computer, listen. If user is already speaking "in conversation with" to computer, listen. Otherwise ignore, unless user asks for computer by name).

As for you question, I think it should be relatively easy to train, say a music-player app to understand stuff like "next song", "accept call", "repeat" -- in any language, using simple statistical methods. Not sure how far you could take it though (example, dictation software still makes (AFAIK) enough errors that it's not really a viable option if the user already can type reasonably well (or hire an actual stenographer)).

omarhegazy2• 12 years ago

Stuff like "next song", "accept call", etc. can be done with extensive knowledge in machine learning and some clever work.

The really tough bits will be stuff like,

"Siri, check if PBS Idea Channel has uploaded any new videos, please."

How will Siri know you mean the YouTube app? How will Siri know what "check if X has uploaded any new videos" means? How will Siri know you mean "PBS Idea Channel" and not the channel called "PBS Idea"?

thom3• 12 years ago

Cortona was released with an API to external apps, and that only allows simple pattern matching, so that's similar. Obviously the built-in stuff is more complex. I've no idea about today, but the original Siri was mostly just chaining relationships together by keyword matching in an ontology.

You could probably train a system like this with a word alignment approach if you generated a training corpus. But ideally you'd want to be able to show the system a new manpage and have it map arguments correctly.

Also a false positive in a SPAM filter is bad, but `rm -rf`ing because of the vagaries of the English language is worse.

the_af2• 12 years ago

I wonder if the author of Betty has taken a look at one of the existing Inform (http://inform7.com) interpreter variants used for Interactive Fiction games (what we used to call "text adventures"). They have progressed a lot since the old text adventures of yore, and are now capable of parsing pretty complex English sentences (instead of just "take sword", you can write "examine sword, then take it and give it to the wizard", and the interpreter will even ask you about ambiguities, such as "which sword? the magic sword or the long sword?").

Then again, I'm unsure if the precision needed from command line interfaces can ever be improved with natural language. Natural language is imprecise, ambiguous, redundant, and confusing even to our human interlocutors. Why would we want to interface with computers in English, instead of using a synthetic and concise made-up language? I'm talking specifically about the command line, which is for power users anyway.

(A perfectly valid answer is "because it was fun to write Betty, and that's its own reward", of course).

jrpt• 12 years ago

No, I wasn't aware of that, but that is interesting.

Betty just grew out of my cheat sheet of commands. I was tired of repeatedly looking up things in my cheat sheet or Google, and decided to make this.

The current project has a limited number of commands, but I am hoping that by making it public, others will issue pull requests with things they'd want to use.

Its current state is command line only, which is for power users. But thinking ahead, on the roadmap I wrote that by the time it reaches v1.0, I'd like it to be extensible. This means it can be used from text-to-speech apps or whatever. Some futuristic use cases: I'm sitting on my bed, with my computer on my desk, and say "Betty: next song" and it just works. Or I'm running on my treadmill, talking aloud: I'd say "Betty: open the New York Times in Chrome" then "Betty: read me this article" and it just works. That'd be cool. I don't know specifically how to do everything I'd want to do, but those are the sorts of far future things that would be cool. In its current implementation, it's mainly for not having to keep looking up commands or options.

the_af2• 12 years ago

That would be cool indeed and I hope my comment didn't sound too negative. And you should definitely take a look at Inform (and similar), it's amazing what they can do. I think some interpreters are open source (edit: it seems it's not, I remembered incorrectly).

thom3• 12 years ago

The very smart people at Wit.AI[1] are building a backend for this sort of thing. You could do worse than hook into that in the short term.

https://wit.ai/

sp3322• 12 years ago

My favorite command-line parser was in the (now-defunct) Ubiquity [edit: not unity] project from Mozilla. It had internationalized parsing, extendable verbs and noun types.

http://mitcho.com/blog/projects/a-demonstration-of-ubiquity-...

edit2: another link https://wiki.mozilla.org/Labs/Ubiquity/Parser_2

bitJericho• 12 years ago

What about for the blind?

dllthomas• 12 years ago

The historical problem with things that parse almost English is that it's hard to remember where the line is drawn between stuff the system will and will not understand. Once upon a time, reading about this stuff, that seemed significant. On reflection, I'm not actually sure how to weight it, relative to the benefits.

eschaton• 12 years ago

Seems like this could be handled more like the Symbolics Genera command line, which offered extensible intelligent commands with context-sensitive completions. Here's a demo by Kalman Reti: http://youtu.be/o4-YnLpLgtk

epynonymous• 12 years ago

isnt the whole idea of a command line for impatient little people like myself that dislike guis and inefficiency? this sort of defeats the whole purpose, i'm now typing sentences instead of shortcuts

heyimwill• 12 years ago

To some people this might be an easier and more efficient way to wrap their head around the CLI.

jeffreyrogers• 12 years ago

This is an interesting idea, but I'm not sure it has much use outside of proof of concept. Most people don't need to use the command line, and those who do don't find it that difficult.

In fact, for the most part the command line is very usable once you've learned the philosophy behind it. I remember reading something about the BSD flavors of UNIX along the lines of "BSD is very user friendly, just not for inexperienced users". I see the command line as being similar. It's very powerful when you understand it, but a bit opaque when you're learning it. Fortunately, you can learn the basics in an afternoon.

Now one useful aspect of this is that it makes commands that would require a long command line much simpler than they would otherwise be. However, I find that whenever I have a long command line that I use repeatedly I just write an alias for it and add it to my .zsh-aliases file. I like this solution better because it is more customizable for my workflow.

e12e6• 12 years ago

Well, an argument could be made for having the alias-file be something like:

    alias ll="ls -l"
      doc = """List files -- long list format"""
      natural_match = "list all files long size date owner group"

And have:

    "list all files by size"

match this (as betty does now: running ll "docstring". Then, when you realize that "list all files by size", really is "ls --sort=size", possibly with "-l", you could just add another definition:

    alias lss="ls -l --sort=size"
      doc = """List files -- sorted by size, long list format"""
      natural_match = "list all files sort by size long format"
      natural_exact_match "list all files by size"

And now have:

    "list all files by size"

Score higher for lss than for ll (the scoring function is assumed to be some combination of tag count, proximit match, substring match etc, a so-called hard problem, but only needs to match over defined aliases -- and trying hard to first match the "exact_match" part...).

Of course, it should all be paired by a define-command or something that autmatically saves these monstrosties to a file or other db. So that you could do:

     # Lots of head scratching and experimentation, until:
     nmcli dev wifi list |sort -k8 -n # list wifi access points by
                                      # signal strength

     # define prev as "list wifi access points by signal strength"
     > displays commmand and prompt for tags etc, then on "y" at y/n
       prompt saves definition to "alias" file.

Come to think of it, it's a little like mandating/recommending users to document their aliases, and to have the shell automatically suggest from the docstrings. I guess zsh actually does a bit of this already (I'm still sticking with bash, it's gotten good enough for me over the years, and I'm always terrified by something, that if it isn't posix/ksh also isn't bash -- as that just makes scripts brittle...).

ing33k• 12 years ago

exactly .

Also this is not the best example to start with imo,

  betty whats my username
  Betty: Running whoami
  jrp

may be should put better example in the beginning

FriedPickles2• 12 years ago

Crazier alternative:

1) Install howdoi https://github.com/gleitz/howdoi

2) Write commands like the following (all work as expected):

    howdoi get time in bash | sh
    howdoi clear bash | sh
    howdoi find current user bash | sh
    howdoi restart computer bash | sh
    howdoi fork bomb | sh

#YOLO

e12e6• 12 years ago

It might be worth mentioning that howdoi is just a wrapper around a google (essentially a "I'm feeling luck"-search as far as I can tell)?

It's hardly the same as a curated set of specialized pipes. Nor does it work offline (howdoi configure eth0/enable wireless...).

TeMPOraL2• 12 years ago

It actually uses StackOverflow.

FriedPickles2• 12 years ago

Add this to your .bashrc:

    function yolo() { howdoi ”$@“ bash | sh ;}

and use it like:

    $ yolo get time
      1399402426

note: dont actually

thrayfounder• 12 years ago

That there is masterful copy.

I'll be honest, I have a general software test called "StonerTesting" - if you're high as fuck a lot of your cognitive function is distorted, so successfully using a piece of software (even its website) means you're software is in fact quite easy to use.

I'm thinking of offering it as a service.

hisham_hm• 12 years ago

Why are all computerized natural-language "assistants" all modeled as female? (Siri, Cortana, Betty...) A remnant of the view of women's role as "secretaries"?

It's interesting to see that this applies to real-world products, which are still kind of "dumb" or single-minded (as in default voices for GPS navigation assistants), while in fiction, when computers are smarter than its owner (HAL, Jarvis) they more are often than not represented as male.

HCIdivision17• 12 years ago

I think you can find quite a few counter examples of a female AI, not least of which Cortana. It's possible to imagine S'Jet as an example, though perhaps much closer to Transcendence (movie) than AI.

Really, I think it simply has a lot to do with the voice. I'll be darned if I can recall the source, but it seems that women can usually be understood more clearly and easily than men; that claim may be only over a lossy channel, but it seems to jive with my experience (listening to podcasts on a motorcycle, women tend to be easier to make out over the noise, and even Google maps' female voice is clear over a highway's roar).

TeMPOraL2• 12 years ago

AFAIK, J.A.R.V.I.S. was modeled after a butler. As a counterexample for smarter-than-its-owner AI you have Jane from Ender's Game series.

unfunco• 12 years ago

I think it's partially region-based, in the United Kingdom, Siri is a male. (Perhaps it's somehow related to butlers, where as in the United States, secretaries were more common.)

Betty was also likely named Betty because of the last three letters, there's no voice with the application, it's only gendered because of the name.

mantrax5• 12 years ago

Well Siri isn't female (and "Siri" as a name isn't a girl or boy name per se), its voice gender varies depending on the country. Apple uses the highest quality voice they have as the default. If you ask Siri what's its gender, it famously replies "I haven't been assigned a gender".

Even then though, female voice usually wins for phone voice services. Why?

Turns out males voices are more "lossy" over plain-old-telephone-service and over tiny tinny speakers (like on the iPhone).

The frequency range of a female voice maps to less loss in this speaker/service range compared to a deep male voice, where the lower frequencies get lost. So female voices are easier to understand in such circumstances.

This explains in part why OSX has a male voice, because a Mac comes by default with much better speakers than a phone does. Even then deeper voices are still not preferred. The "in a time..." movie trailer voice isn't coming to an AI assistant any time soon.

As for Cortana, the basically nude Halo AI bimbo, you have a point there, awkward choice for a commercial product, but that's Microsoft's problem. They've always had awkward marketing/branding choices, so this fits in.

As for Betty, "Betty the secretary" reference is quite obvious, but as a personal project, I'd say he's forgiven.

thekonqueror• 12 years ago

Chance for my Plug: I'm using similar approach with cloud management at http://webservice.management. It allows you to manage VMs and run tasks across them in english. (Create a small vm with node.js or build lamp stack on vm1 and so on)

sytelus• 12 years ago

Every natural language interface eventually will be required to generate a new program. For example, if you say my parser supports query like "count number of words in file X", someone would want to issue a queries like "count number of words starting with character a and at most length 3 in file X" and so on.

Natural language interfaces eventually fall on its face not because parsing is really hard but rather because after you parse, how do you generate a program on the fly to solve the user's problem.

mallamanis• 12 years ago

It is indeed a hard problem, but there is some research going on in this area http://people.csail.mit.edu/nkushman/papers/naacl2013.pdf

and the application is definitely worth it, because it lowers the barrier for doing "complicated" stuff for people that are not very computer-savvy

b6fan• 12 years ago

This may be why concerning of testing in ruby, dhh supports native Test::Unit instead of Cucumber [1].

1. http://cukes.info

ejain• 12 years ago

Natural language interfaces can be very frustrating when they (inevitably) don't recognize (or worse, misinterpret) your input... I'd rather have commands that are easy to remember (i.e. simple and consist).

roeme3• 12 years ago

Other than being fun; I can't quite see the benefit of making my shell more verbose. I'm sure I am not the only one who can get by with the regular commands through mnemonics.

And to further my point; if this was such a good idea, then why has nobody aliased 'ls' to list, 'cp' to copy, (etc.)? Or, while we're at it, 'list files', or 'list files in current directory'. Maybe someone has and I just didn't meet them yet.

I do see the point of a programming language to be a bit more verbose, since it makes sharing between humans easier, as understanding old codebases – but even there, people are split (Java is too verbose! Ruby is natural! Lisp is too much abbreviated! etc.). But using a shell, issuing commands, is fundamentally different to programming, in my opinion. Consider the analogy of a crane (just to avoid cars for once), what would you prefer: Waving your finger around in thin air, or using levers? And before you answer that: while the former seems way more cool, it doesn't work well. Getting rid of mechanical controls has been tried experimentally by the Air force (I read that back in the 90's; sorry no link to a source now): They were able to interpret commands from the pilots brainwaves, but manual control was consistently faster. We humans just evolved this way: Thinking of moving a plane into particular direction is slower than moving your hand accordingly to yank a stick – it seems to have a higher more mental load for us. Do you picture your arm moving your mouse? I bet you "just do".

But I digress; though the fundamentals in play are the same. My fingers are fast; why should I slow down the whole thing by making them type more?

Of course, a shell using of single-letter commands would be equally useless to an overly verbose shell. The sweet spot, in the end, might be a personal preference and dependent of daily usage and experience. In my case, that's a bit more than the POSIX command set, and – to exaggerate a bit – not writing essays on the command line.

e12e6• 12 years ago

http://www.computerhope.com/copyhlp.htm

roeme3• 12 years ago

Err, serves me right. Nonetheless, the bottom line of my post should hold true.

area51org• 12 years ago

It becomes interesting when you can tell Betty to do things you don't otherwise know how to do. (How do you tell iTunes to skip this song from the cmd line? I don't know, and I'm too lazy to look it up.)

thom3• 12 years ago

This is classically what `apropos` is there for, but I don't see any mention of iTunes in there.

saraid216• 12 years ago

Do you mean skip it once, or skip it forever?

The first is really an "advance to next track" command.

The latter is a "mark current song as Never Play and advance to next track".

I'd be surprised if there was any kind of interface with iTunes that doesn't have at least one of those capabilities.

epsylon• 12 years ago

The whole point of this is when you don't remember the command which you are trying to achieve. (See the author's comment[1]: "Betty just grew out of my cheat sheet of commands. I was tired of repeatedly looking up things in my cheat sheet or Google, and decided to make this.")

It's faster than a google search.

[1] https://news.ycombinator.com/item?id=7696453

roeme3• 12 years ago

I'd say the time spent looking it up (and maybe creating an alias/script) is less than typing it verbosely each time.

I don't see 'betty whats my ip address' as a valid alternative to 'ip addr list'. And in case of 'betty next song' vs. osascript -e 'tell application "iTunes" to skip to next track' I'd just alias the latter to something short & memorable (though I just wrote it from memory).

borplk• 12 years ago

Interesting project. I know for us geeks the short obscure commands are sometimes easier but something like this can ease people into using command line more.

I applaud the author because typically I don't have the courage to even attempt solving problems like this. And I wonder what the author is going to do about this.

Because well ... natural-language processing just isn't there yet, you can kind of "fake" it a bit by looking for keywords and patterns and regex but it only goes so far.

So beyond a certain point, you end up needing to solve the natural-language processing problem first, so that you can then build Betty.

rawland• 12 years ago

That's great. However, I don't see an end to capture all the ambiguity of language and especially misspellings... can this be contained in a reasonably fast running script?

  ~/tmp betty my ip
  Betty: Sorry, I don't understand.
  ~/tmp betty my ip adress
  Betty: Sorry, I don't understand.
  ~/tmp betty whats my ip address
  Betty: Running curl ifconfig.me

billrobertson42• 12 years ago

COBOL was supposed to be English-like too wasn't it?

ebbv• 12 years ago

This seems like a recipe for disaster.

When you're at a command prompt you should always know exactly what the command you're inputting is going to do. Since Betty necessarily obfuscates your command this seems like a good way for unintended consequences.

The obvious solution to that is make it so Betty never does anything that actually matters. So then the question is; why bother with Betty at all?

d0ugie• 12 years ago

Between this and bropages Linux is finally taking shape as a viable contender to MSDOS! :)

Curious how many man hours have been put into Betty so far. Good work pickhardt, looking forward to taking this for a spin. Hope you put in some umask command support in this, I keep screwing that up...

codereflection• 12 years ago

Betty looks pretty interesting. Adding tab completion would certainly cut down on the amount of typing with the length of the commands. Do the commands also accept short variants? Such as i for iTunes?

Goosey• 12 years ago

Is it compatible with fish shell?

edit: answering my own question, it seems to work just fine

chanced• 12 years ago

Upon seeing the list of commands, I immediately thought "this is great! I could alias betty to b and then maybe a few more aliases here and there. I could take "betty next song" and make it 'b n s'!"

and then went "oooooh, so that's how this all started."

elwell• 12 years ago

CLI in Ruby, ok.

Betty – English-like interface for the command line

Related Stories