R is hot [pdf]

http://www.revolutionanalytics.com/why-revolution-r/whitepapers/R-is-Hot.pdf

by sonabinu • 13 years ago

50 54 13 years ago

mblake• 13 years ago

Ugh, should've put a [pdf] warning in the title. Other than that, R can indeed be hot, but maybe just in the special 'flavor' Revolution Analytics developed, otherwise it's one of those languages you dread using but are forced to because so much scientific code/packages etc has been written on it, some with no equivalent in other languages.

sonabinu7• 13 years ago

just did put in pdf to the title

j_s• 13 years ago

however you managed to skip past the auto-scribd-autodetection, congratulations! scribd is a mistake.

maxerickson2• 13 years ago

It's also from 2010 (according to the copyright statement in the PDF).

vickytnz• 13 years ago

"How Did a Statistical Programming Language Invented in New Zealand Become a Global Sensation?". Hmm, slightly condescending title—though I had no idea that it was invented by two academics at the University of Auckland (not "Aukland"!)

sonabinu7• 13 years ago

Check this out http://www.nytimes.com/2009/01/07/technology/business-comput...

dagw3• 13 years ago

Is "invented" really the correct word, given that R started its life as a straight up Open Source re-implementation of the S language.

randomsearch• 13 years ago

Indeed. Is the language the second most famous scientific 'R' from NZ?

http://en.wikipedia.org/wiki/Ernest_Rutherford

crayola• 13 years ago

R has some spectacular libraries and a huge userbase among statisticians, so it is definitely a big actor. On the downside, the core team who manage it appear to be somewhat averse to making the language progress in meaningful ways. R is very slow, has difficulty handling large data, and is a source of many "wtf" moments (e.g. see "the R inferno"), even for advanced users. I think the best thing that could happen would be a mass migration of R users towards Clojure, Julia or (more realistically) Python, and an attempt to reproduce in that language the key packages that are R's main appeal at the moment (ggplot2 mostly).

dagw3• 13 years ago

https://github.com/ContinuumIO/Bokeh is an attempt to provide a ggplot equivalent in python.

schabernakk• 13 years ago

what advantages does this offer in comparison to matplotlib?

Are the points they describe (easy faceting, bulk application of aesthetic and visual parameters across categorical variables, pleasing default color palettes for categorical data, etc.) really that much of a pain point with matplotlib?

I used it for two or three projects but not really extensively and especially not for complex statistical plotting, thats why I ask.

dfc• 13 years ago

The R Inferno: http://www.burns-stat.com/pages/Tutor/R_inferno.pdf

Abstract: If you are using R and you think you're in hell, this is a map for you.

llamazv2• 13 years ago

Agreed. Ideally, a new language/api will emerge that learns from the successes and failures of R. Something that is designed to be used as it is used presently, that incorporates Hadley Wickham's ideas, that has a less quirky OOP system, and that is more readable.

Perhaps currying/function compositions could be encouraged to avoid(hard, to(read(nested, functions))). However, being unexperienced with currying/function compositions, I have no idea if that would complicate the language...

hadley5• 13 years ago

You can already implement Curry in R: https://github.com/hadley/pryr/blob/master/R/curry.r :)

hadley5• 13 years ago

I think the best thing that could happen would be the development of a competing R implementation. In my mind this would include the definition of a minimal R language implemented in something like Riposte (http://www.justintalbot.com/wp-content/uploads/2012/10/pact0...), and the majority of base code written either in R, or the sort of C++ that Rcpp makes very natural.

chuckbone2• 13 years ago

The best thing that can happen to R would be to rewrite the parser in Haskell and make R a domain specific language. Leave the stats/R language to statisticians who originally designed R, and bring in the Comp Sci crowd to actually make a meaningful speedup.

simulate• 13 years ago

Julia is meant to be a competitor to R. The Julia developer community have added dataframes to compete with R Datasets and packages.

See: http://docs.julialang.org/en/latest/packages/packagelist/?hi... and: http://docs.julialang.org/en/latest/packages/packagelist/?hi...

saosebastiao• 13 years ago

Interesting. First time I have heard of Riposte. It dousn't sound like a new language though, but rather a new runtime. Am I understanding incorrectly?

sonabinu7• 13 years ago

agree that the change is slow, but R is increasingly finding a place in the world of large datasets. Check out these http://www.oracle.com/technetwork/database/options/advanced-...

http://www.revolutionanalytics.com/why-revolution-r/whitepap...

hudibras• 13 years ago

The biggest problem R faces is the corrosive attitude the language developers and maintainers have towards the R community. The R core team sometimes seems openly hostile to users; instead of Benevolent-Dictator-for-Life, it's more of a military junta that suppresses the opposition.

foobarqux2• 13 years ago

Where is this "R community" hiding? The IRC channel is essentially dead.

shared4you• 13 years ago

Please add a [pdf] tag in the title!

sonabinu7• 13 years ago

just did, didn't realize the confusion it was causing

TomMasz• 13 years ago

So, let's say you're interested in playing with R, where's the best place to start? I've got basic statistics background and some datasets I could play with.

rpackard• 13 years ago

http://www.codeschool.com/courses/try-r

Codeschool recently launched a free tutorial class for R thats interactive. They do a great job with intro level learning.

sonabinu7• 13 years ago

A great place to start learning the basics of R - coursera has a couple of classes using R - Computing for data analysis https://www.coursera.org/course/compdata and Data analysis https://www.coursera.org/course/dataanalysis

go to the R website - http://cran.r-project.org/

pvaldes• 13 years ago

A great place to take a look and see some things that you can do with this program is this:

http://gallery.r-enthusiasts.com/

Examples of graphics with code, and some are very smart

dbecker2• 13 years ago

If you are looking for a book, "The Art of R Programming" is (by far) my favorite R book.

It explains a lot of the general principles behind the language, so you can figure out details for yourself (in comparison to, for instance, the R Cookbook, which has hundreds more pages of details and code samples for specific use cases).

piqufoh• 13 years ago

This would suggest that "R is not" http://lang-index.sourceforge.net/#grid

minimax2• 13 years ago

The article is suggesting R has become popular for data analysis projects, not as a general purpose programming language.

sonabinu7• 13 years ago

R is essentially for statistics, it is not a general purpose programming language

11001• 13 years ago

I like R, it's more fun to write in than, say, Matlab. But it is unbelievably slow and has very little support for web-based projects. I'm reading "Python for Data Analysis" right now, and I'm pretty sure the book is converting me. Pandas' DataFrame includes R's data.frame's functionality as a strict subset, and that's enough for me to switch. I still might need to use rpy2 for awhile for certain packages though.

minimax2• 13 years ago

I started using data.table [1] as a replacement for data.frame recently and it's hugely improved my productivity in R. On the web front, the Shiny [2] project has a emerged as a possibility for quickly building web frontends for analysis projects in R.

1. http://datatable.r-forge.r-project.org/

2. http://www.rstudio.com/shiny/

dagw3• 13 years ago

If you like data.table, but use python, take a look a pytables.

Maro3• 13 years ago

I think R is just as terrible as Matlab. Personally I prefer Mathematica, but I even stopped using that, it's just so painful to use with everything being lists.

linhat• 13 years ago

Could you elaborate your dislike for mathematica and matlab? In my university departement a lot of people are using matlab while I somehow prefer C/C++ as I still cannot get my head around it.

Maro3• 13 years ago

My use of Mathematica is usually reading some data (generated from a simulation, say) from a CSV file and then doing something with it and plotting it. What I dislike is that simple things like aggregation, slicing and dicing the data is kind of pain when everything is a list and using Table[], Map[] etc. It often occurs to me that it'd be much quicker to express what I want with an SQL query. Also, with Mathematica's lists header information is lost, so I always have to remember which column in the list of lists is what. It's kind of a pain. Basically, whereas in SQL I can tell it what I want (declarative), in Mathematica I actually have to implement it (functional).

Then, in the plotting phase I'm constantly looking up Mathematica's plot options because I don't use it often enough to remember them. By default almost everything looks like crap in Mathematica, and you have to put in 10+ options to try to make it look good, but even so I'm usually dissatisfied with the result. Often I want something and then I find someone on a message board saying that it doesn't support that, and then he shares his 100 line program which gets Mathematica to do that. Then I usually give up. Getting programs from the Internet to work with Mathematica is a pain because Wolfram pushes out a new version every year and they keep changing small things which break backwards compatibility. Compare to the (much less powerful) Google Charts library, where everything looks much better and easier to comprehend by default.

One of my startup ideas is to write something like Mathematica, much simpler, runs on the web as a service, you can program it in Javascript, has embedded SQL, and it uses something like Google Chart for simple plotting, or you can pull in your favorite plotting library. Let's you share your work by sending around a link.

PS: I played around with R, but it seemed even more cryptic than Mathematica. Admittedly I didn't spend much time in it.

foobarqux2• 13 years ago

Matlab as a language is awful and here are a few examples why:

- You can't chain indexing with function calls. So you can't do myfun()[1]. This gets obnoxious really quickly. I hope you like useless intermediate variables. - You can't have a N-D array with singleton trailing dimension. So if you want dynamically created array sizes you will have to create special cases for that. - One external function per file.

sagacityhappens• 13 years ago

Expect R is dominate as the SAS legacy begins to die. R is spreading across a lot on analytics departments in Universities, from Stats to Finance. The holdouts are the CS departments, who have rebranded much of statistics into data mining/machine learning and, smartly, use python.

chuckbone2• 13 years ago

Another important metric is the use of R in clinical studies. The FDA now accepts much research in R whereas before they did not. That is a slow moving change, and shows R will be around, at least in use by Pharma, for a while.

michaelfeathers• 13 years ago

Has anyone explored the possibility of making a nice clean language that compiles to R?

jre• 13 years ago

Python has some nice tools to interface with R when needed (rpy2 for example). On top of that, scipy/numpy/matplotlib provides a lot of scientific routines.

dbecker2• 13 years ago

Personally, pandas was the library that converted me from R to python for general data work.

hablahaha• 13 years ago

I dunno if R is that hot, but I think RStudio's Shiny (http://www.rstudio.com/shiny/) is on its way to making it hot. Best thing to come out in the R world in a long time. Besides being a great visualization tool for people who already use R, it might be something that makes programming easier to learn for kiddos (they can even learn some HTML + JS at the same time...) This almost brings R to a level where all the material taught in a freshman COMP101 class could be implemented in R (... as long as you don't even mention OOP)

R is hot [pdf]

Related Stories