Ask HN: What are the best technologies you've worked with this year?

https://news.ycombinator.com/item?id=2053956

by Athtar • 16 years ago

253 149 16 years ago

news.ycombinator.com

So HN, what are some cool, shiny new technologies that you worked with this past year? Care to tell us what those technologies are and why they are so cool?

rdl• 16 years ago

I'm kind of ashamed to admit it (at the end of 2010!), but I did some Objective-C/iOS apps for the first time this year, and I was pretty amazed by how good the Apple dev tools and the iOS simulator actually are.

The other thing which impressed me is kvm, in contrast to Xen.

dgallagher• 16 years ago

Ditto on the Objective-C stuff, though personally I've been focusing on Mac OS X rather than iOS. Apple really documents things well, and the Cocoa community is extremely nice and helpful. The shiny glare of quality extends deep into the inner depths of Apple's products.

niels• 16 years ago

Backbone.js! Hits the sweetspot for a lightweight clientside MVC framework.

SandB0x• 16 years ago

New to me: Numpy/Scipy. If you're using Matlab you should know there's a Free and worthy Python based alternative

ctkrohn• 16 years ago

Don't forget Matplotlib. Great-looking visualizations built on top of the Numpy stack.

mark_h• 16 years ago

And don't forget basemap if you're doing anything geospatial. This is an absolute godsend for me, I wish I knew of alternatives in other languages too, but as far as I know there's nothing else like it for that sweet spot of free and awesome ease of use.

(Not that I mind writing in Python of course! It would just be nice to have similar options when python might not be an option)

locopati• 16 years ago

Erlang - playing with serious functional code for the first time in a long while has done wonders for my day-to-day Java job.

apu• 16 years ago

Redis. Fucking awesome database. Does exactly what it's advertised to do, with no unexpected surprises. Great documentation. Finally we can go beyond the simplistic key-value map/reduce datastores, for when you don't need all the guarantees that traditional SQL forces you to have.

http://redis.io/

(I still use postgres and sqlite for other database needs, but I'm strongly considering moving a few of those over to redis if I have time.)

PStamatiou3• 16 years ago

Yes! I first laid hands on Redis this year while working on Notifo and it's raw speed lets me do some great things. Currently hacking on some service analytics stuff that redis is making pretty easy. Though keeping everything in memory can get expensive when we want to minimize server costs so we keep the first month of data in redis and the rest as an archive in mysql (how often is someone going to look up a notification they received more than a month ago?)

sage_joch• 16 years ago

I'd like Redis more if they had chosen the logo that had earned the most votes. :-)

justinchen• 16 years ago

Redis. It has ton of different data structures that make it an interesting alternative to the relational DB and memcache.

zppx• 16 years ago

LDAP, particularly 389 DS.

sophacles3• 16 years ago

These aren't new to the world, but they are new to me this year, and a lot of them sort of hit some sort of "usable by those without active interest in the continuation of said tech".

1. Mongodb -- This year it really hit its stride and have been able to use it without worry for storing test results and experimental data. This is much nicer than the textfile logs -> sql -> processing datapath I was using previously.

2. flask: this little framwork is in my sweetspot. It does all the annoying crap of webby stuff, without all the "use our orm/routing model/way of thinking of http" so common in the space

3. mongrel2: I like it because it uses 0mq as the backend and sanely integrates some components in a way I feel could be better for many use cases than traditional stacks.

4. 0mq: This gets special mention, because it has been around for a while and I was actively using it, but 0mq 2 came out sometime this year, and is different enough from the first round, that it could be considered a separate technology. It isn't revolutionary in the MOM space, but it is a cool lightweight approach, and the core team has the type of dedication I like to see in OSS projects.

5. ABSOLUTELY NOT NEW: Haskell -- this year is the first year I've had time to sit down with Haskell for real, and start understanding the weird FP thing. This has made everything I do feel shiny and new, because even though I never actually use Haskell, I find myself writing very short hsskell programs in python and c and the other languages I use in my day job. When I started coding I remember thinking "This must be what a wizard feels like!", Haskell has brought back that feeling for me.

endgame3• 16 years ago

0mq is fantastic. I just wish it had some way to put a socket in a half-open state: http://stackoverflow.com/questions/3692854/how-should-a-zero...

ETA: `zmq_poll()` is nice, but some way to make it play nicely with other event loops (like libev's) would be even better.

sophacles3• 16 years ago

I know Zed Shaw played with such things for making mongrel2. I've never needed it, so that is the best pointer I can provide, but the IRC channel for 0mq may be of help too -- friendly crowd over there.

pjscott• 16 years ago

To make 0MQ work with libev, get the file descriptor for each 0MQ socket:

    zmq_getsockopt(socket, ZMQ_FD, &notify_fd, &notify_fd_size)

Then just pass notify_fd to libev, or libevent, or epoll, or whatever event library you prefer. Very pleasant and easy, but not yet officially documented last time I checked.

jmtulloss• 16 years ago

This exists in ømq 2.1 (https://github.com/zeromq/zeromq2/tree/v2.1.0). You can get access to the raw socket, which allows you to plug it into anything that understands sockets. This is what was done for zeromq.node to tie ømq into node.js.

sibsibsib• 16 years ago

My list is pretty much identical to this, aside from mongrel2 (looked at it briefly though).

I'm loving flask + mongo in combination; they make prototyping webapps almost effortless.

jfoutz2• 16 years ago

makerbot cupcake cnc.

It was an on again off again sort of project mostly off, but i finished it up a week or two ago. Now I can print plastic in any shape i can draw in art of illusion. It's satisfying fiddling at the computer for a while then printing and having a real 3d thing.

tocomment2• 16 years ago

What's some stuff you've printed?

jfoutz2• 16 years ago

mostly just silly calibration cubes. a few space invaders and companion cubes to give to friends. today i (continued) work on a spindle to hold the big spool of plastic.

cnc is so much fun. I think i'm going to have to get a cnc mill. this is just to tempting. http://lcamtuf.coredump.cx/guerrilla_cnc1.shtml

In the near term i'll probably just print some brackets and containers for stuff.

samdk• 16 years ago

2010 was, for me, the year of JS-related technologies. (I'm actually rather disappointed I haven't had more time to check out Clojure and to use Haskell and Scala more--I was doing quite a lot of front-end web stuff.)

1. Socket.IO (http://socket.io/)

It lets you use websockets and automatically fall back to flash sockets, long polling, or several other real-time communication methods if websockets aren't supported by the client. There's a JS client and node-compatible server, as well as in-progress server implementations in a few other languages. Node is nice by itself, but it's with things like Socket.IO that it really shines.

2. Coffeescript (http://jashkenas.github.com/coffee-script/)

Coffeescript is a nice-looking and nice-to-type syntax on top of JavaScript. It's made JS development a lot friendlier, and I now miss things about it every time I'm programming in Python and Ruby. I now use it whenever I'm doing any significant amount of coding in JS.

3. Node.js (http://nodejs.org/)

Node should, by this point, need no introduction. Server-side JS. Plays very nicely with websockets thanks to Socket.IO, making it very easy to write the server-side part of real-time webapps. I've also found it very useful when trying to quickly prototype simple non-webapp things that have to communicate over a network.

I haven't had a chance to check out Backbone.js (http://documentcloud.github.com/backbone/) yet beyond a very quick look, but I expect to use it (or something like it) next time I'm developing something that uses a significant amount of client-side JS.

I'm also very excited by the continued development on (and Yehuda Katz's participation in) SproutCore (http://www.sproutcore.com/).

hasenj• 16 years ago

Thanks for #1, never heard of websockets before.

jashkenas2• 16 years ago

I'm looking forward to seeing someone combine Backbone.js with Websocket-based persistence. It's a bit out of scope for DocumentCloud to tackle, but the building blocks are there.

One client makes a change to a model -> changes are synced to the server -> other clients that currently reference that model have its attributes updated -> all the UI that displays the model is automatically re-rendered.

It's not critical for most applications, but is a really nice, nice-to-have for any JS app that displays the same editable data to more than one user at a time. Built-in conflict resolution mechanism for bonus points.

datapimp2• 16 years ago

I started work on this a little while ago, and shared a starter template on https://github.com/datapimp/backbone-express-mongoose-socket.... I am starting a new job in 2011 where we will be using this template heavily, so expect major updates in the first couple weeks of January.

nsm2• 16 years ago

I'm doing something pretty similar to rumpetroll (it is fully functional rumpetroll now, but we will add more features) using Backbone Model View Collections as my 'Sprites'. The code isn't public yet, but me and a friend have some plans for it. The only thing different is that we've completely dropped use of Backbone.sync, for the sole reason that the method based approach does not fit very cleanly into what we are doing and websockets. So we have one model as a 'dispatcher' instead, to which all models send messages which are transmitted over websockets. All sprites communicate via attribute change events which is a really good use of Backbone. On the server a tiny node.js wrapper uses Redis pub-sub to relay messages out to other clients.

The code is 'out there' but private, so if you want to take a peek at it, please contact me directly.

Thanks for a great framework.

zefhous• 16 years ago

All thanks to jashkenas: CoffeeScript, Underscore.js, and Backbone.js.

Using those tools has helped me to really enjoy writing JavaScript and to start doing it in a much more organized manner. They have been a huge catalyst for my growth as a JavaScript developer.

Also, using MongoDB has been awesome!

DanHulton2• 16 years ago

1) MongoDB - I started off using it in place of a few tables that had some varied column requirements, and I'm now in the middle of converting my entire DB to it. So awesome.

2) Kohana - I love working with this framework. I never really worry about the ugly warts in PHP, because honestly? I'm not programming in PHP any more. I'm programming in Kohana, and I only occasionally fall back to PHP for "low-level" stuff.

gsmaverick• 16 years ago

I was trying to get into Kohana but I just couldn't find any good guides to get started and to show me all the various features.

DanHulton2• 16 years ago

Sorry I'm a little late to get back to you on this, HOWEVER, Kohana just released version 3.0.9, which includes a revamped user guide with full examples and details and tutorials:

http://kohanaframework.org/guide/kohana

patio11• 16 years ago

Twilio. Ringing phones is pure magic, and provides so many disruptive opportunities it is staggering.

sarkozy• 16 years ago

Sure. You can disrupt someone on the toilet, at the dinner table, in bed, etc, etc. Very disruptive indeed.

sophacles3• 16 years ago

There was a time in my life, where every single time my girlfriend and I were about to enjoy some adult time, my employees would call. Without fail. There has to be some sort of twillo app idea in there somewhere.

catshirt2• 16 years ago

or... while they're using their phone as a method of programmatic notification?

cglee• 16 years ago

+1 for Twilio. Tropo is looking pretty sweet too.

benatkin• 16 years ago

Indeed; especially their PhonoSDK. http://phono.com/ I didn't really understand what it did until I listened to this podcast: http://changelogshow.com/105/18576-episode-0-4-1-telephony-w...

flacon• 16 years ago

+2 for Tropo... it is sweet.

prawn• 16 years ago

I would love to see Twilio more readily available in Australia. SMS costs here are just unfair.

RoyceFullerton• 16 years ago

In 2010 I fell in love with:

1. Groovy - a programming language, it rocks because it less verbose and more powerful than Java and I can fall back onto standard Java syntax when I don't care to figure out how to do something in the 'Groovy' way. (http://groovy.codehaus.org)

2. Gaelyk - a groovy framework that runs on Google App Engine. Google App Engine is great for launching apps. It's free until it gets traction. (http://gaelyk.appspot.com)

3. Objectify - The simplest convenient interface to the Google App Engine datastore. Takes a lot of the pain out of using Bigtable. (http://code.google.com/p/objectify-appengine)

These all pack a mean punch and let me work on my night/weekend projects quite productively after overcoming a small learning curve.

I built http://icusawme.com and http://chatroulettespy.com with all three.

I'm looking forward to diving deeper into Appcelerator Titanium Mobile in early 2011.

oemera• 16 years ago

+1 for mentioning the awesomeness of Groovy and that you can fall back to Java if you have to or if you like to.

catshirt2• 16 years ago

node.js was already mentioned as someone's third, but I'd like to cast a sole vote. seriously, it's awesome.

endgame3• 16 years ago

Not new, but I've really enjoyed working with Lua (http://lua.org). The C API is really nice and I like how you can start from a known-safe, minimal interpreter and add new procedures carefully.

libev (http://software.schmorp.de/pkg/libev.html) was also a lot of fun to use for multiplexing sockets, plus it has a whole pile of other useful watchers that can use its event loop.

swannodette• 16 years ago

Clojure - it's the gift that keeps on giving. It keeps getting faster and the feature set for writing robust object-oriented software (minus the broken stuff) just keeps getting better. In fact, it's changed how I assess the feature set of other OO languages old and new.

miniKanren - logic programming w/o the Warren Abstract Machine. Has opened my eyes to a ton of incredible literature on this under appreciated programming paradigm.

pederb72• 16 years ago

GLM (http://glm.g-truc.net/) - A C++ mathematics library based on GLSL. It's not a new library, but I didn't know about until 2010. It's really convenient to use (almost) the same syntax in C++ as you do in GLSL.

clemesha• 16 years ago

Redis. Makes working with a database fun, just like jQuery made JavaScript fun.

j_baker• 16 years ago

I'm actually beginning to enjoy writing things in Haskell. It's the first statically typed language that I enjoy using (although I do still miss dynamic typing).

lionheart• 16 years ago

A bit late to the party but I finally learned and started using Ruby on Rails this year and I love it.

binaryfinery2• 16 years ago

Solid State Discs in everything.

Ok, perhaps not what you were asking, but they made a big difference for me. I have two, raid0 in my desktop, and a sandforce in my MBP. What a difference. Compiling, linking, copying, everything not just faster, but almost instantaneous. Yum.

rphlx2• 16 years ago

Yup. And PCI-e SSDs are going to rock-n-roll next year. 160GB at 700MB/s w/ 10us latency for $300? Yes please.

aw3c22• 16 years ago

Buying an SSD was a huge disappointment for me. Programs were not "almost instantaneous" but just 2-3 times faster to load if there was a difference at all. So OpenOffice took 3 seconds instead of 7, not worth the huge price difference for me. Compiling is CPU bound, I noticed no mentionable difference there. It might be worth it if you use a "bloaty" OS with virus scanners and indexers running or have specific use cases where very fast access is needed, but for a lightweight system the difference is neglible. The only real difference I actually noticed without looking at numbers was that after startx the XFCE desktop was ready before the monitor did its resolution switch. Lots of random reads in that process I guess. From a HDD it takes a couple of seconds (once per day...).

I returned it. And before some is implying I am dumb: Yes, I had a fast and quick SSD and my system was setup to use it well.

binaryfinery2• 16 years ago

You need more CPUs then :-)

Also, there really is a difference between SSDs available right now. My Kingston SSDs have blocksizes of 120k (!). My OCZ Vertex2 has blocksize of 4k. Its 4k write speed is off the chart. Like 40x faster than some SSDs.

I'm on OSX (2 cores), Windows (8 cores) and CentOS (4 cores).

DanielBMarkham• 16 years ago

I continued to work with F#, deploying a couple of small apps.

The really cool part came when I realized that with F# I was programming at the language level -- that I could effectively and easily write my own languages. So I decided I would like rails-like entities, where the entity reads the structure of the table and then conforms itself to whatever is in the table.

Couple hundreds of lines of code later, and presto chango, I could simply say "give me a list of customers" and point it to the table and I had a list of customers. This totally disconnected the database data structure from the code. Add a new field in the database and there was nothing to change in code. Or add a new field in the type and have it percolate out to the database. Change database providers and it was only a few function changes. Very cool. The kind of simple fix Microsoft should have done with data access instead of writing ODBC/ADO/OleDb//EF/etc

Then I had a blast with mailboxes, er monads, agents, and threads. Ended up writing a small app that was purely functional and all ran in the background. It was so automatic, at first I couldn't figure out how to start the dang thing!

This led to a venture into MPI and other technologies which has just begun. I'm also trying to wrap up my language work with a full DSL sometime soon (if I have a project that needs it). Looking forward to parsing and setting up trees and walking them. I also broke out of windows and started working in a linux environment using Mono, Apache, and MySQL.

Incredibly fun stuff. Looking back, I really had a blast this past year. Next year should be even better.

davidedicillo• 16 years ago

Not directly but I'd say Erlang and Redis, definitely the most "exotique" technologies I've been in contact this year that made http://mysyncpad.com possible

jamesbritt3• 16 years ago

Physical/wearable computing: Arduino Lilypad, and the Kinect.

dstein2• 16 years ago

The iPad has changed everything. It's an entirely new type of computer that turned out to be substantially better than anyone imagined. Watch a 5-year-old use an iPad for the first time and you will immediately see and understand why this is a major paradigm shift. It's the first "socially acceptable" computer -- at Christmas I can pull out my iPad, plop it down at the dinner table and share pictures with the family, and it's not at all considered rude.

jaxtapose2• 16 years ago

The iPad is an entirely new type of computer? You mean, like a pad computer as suggested by Wieser in the 90s?

> turned out to be substantially better than anyone imagined

By anyone you mean analysts, right?

cookiecaper• 16 years ago

Or like the tablet computers released throughout the 90s?

The iPad is cool, but it's only cool because it went the extra mile and released something polished and thoroughly thought-out from a user experience perspective, whereas its progenitors of like form factor targeted specialists (serious digital artists, et al) and they basically worked, but they just required more work, as one might expect when comparing a high-end specialist's tool with what is essentially a portable document, web, game and movie player.

It's all about repackaging the technology in a format that appeals widely to the general mass of consumers and allows them to do things consumers want to do.

dstein2• 16 years ago

You mean, like a pad computer as suggested by Wieser in the 90s?

I mean like a kids computer, and a socially acceptable computer, as I said so. The physical form factor isn't what's new, the implementation, software, use cases, and the whole experience is what's new.

By anyone you mean analysts, right?

By anyone, I mean everyone who I've shown an iPad to. Most people don't get it, initially, but after a few minutes of playing with it, seeing their kids play with it, watching funny youtube videos together etc, everyone basically admits they didn't think it would be as good as it is.

rphlx2• 16 years ago

The power of marketing and glossy case design.

mrjjwright• 16 years ago

The power of an engineer's self-absorption.

michaelty• 16 years ago

Clojure. I miss map and reduce already.

Rendy• 16 years ago

The Google Map API v3 is pretty nice.

calicoder• 16 years ago

crawshaw• 16 years ago

Protocol Buffers (http://code.google.com/p/protobuf/)

Not what you would call cool technology, but definitely the best technology I have used this year. Protobufs get out of the way so you can get work done.

endtime• 16 years ago

CoffeeScript, Raphael.JS, and Django (not new this year, but new to me) were definitely my favorite tools of 2010. I've just started playing with Tropo as well, which is better for my purposes than Twilio.

maxer• 16 years ago

faceboook graph/api, always learning :)

railsjedi2• 16 years ago

1. MongoDB / Mongoid have blown me away this year. Is now my default database for new rails projects.

2. CoffeeScript language is an amazing replacement for Javascript. I can't see myself going back to pure JS at any point in the future.

3. Rails 3 finally feels like a stable and maintainable web framework. All the web frameworks now all seem to work together using Rack. The ruby web development world is really a nice place to be at the moment.

4. Bundler really nailed the gem dependency management issue (though the journey to 1.0 was very painful)

5. Sass / SCSS / Compass got really good. It feels unimaginable to go back to regular CSS.

Wow, now that I think about it, way too many great technologies to list. 2010 was an insanely good year for ruby web developers.

cheald• 16 years ago

Great list. With the exception of Coffeescript (I just don't "get it"), that's basically my list, too. I'd like to branch out for this next year, though. Clojure and Erlang are both on my list.

datapimp2• 16 years ago

I am a huge fan of Vagrant ( http://vagrantup.com ) which is virtualized development environments, package-able. Works with chef and virtualbox. I don't know if I can state just how game changing this is for me.

DocumentCloud really dropped some bombs this year. backbone.js, underscore.js are really great.

Socket.io saved my ass. I promised some big clients that I could make websockets driven apps for the iPad and then apple pulled websockets support without saying anything. So I was able to get socket.io for the win.

railsjedi2• 16 years ago

Ah, great one! Vagrant is amazing. Probably has a lot to do with VirtualBox getting really good as well.

jlangenauer• 16 years ago

JRuby. It's just rock-solid, wonderfully fast and easy-to-use, it's now at the center of my product. Many props to Charles Nutter et al for this!

jamesbritt3• 16 years ago

Absolutely.

Despite being responsible for Monkeybars, I actually hadn't used JRuby that much this past year, being mostly caught up in a Rails gig (which I thought might run under JRuby, but is not).

However, having gotten a Kintect I'm hooking into the C libs via JRuby and some nice JNI wrappers some smart Kinect hackers have written. So I can use JRuby + Monkeybars for the GUI.

seivan• 16 years ago

Redis Rails 3 Cocoa Sparrow-Framework Chipmunk Physics jQuery

Anyone who says MongoDB without having a proper use will get a very angry stare from me. Seriously...

gfodor• 16 years ago

Clojure & CoffeeScript are the one-two punch this year.

mkramlich• 16 years ago

#1: SSD

#2: MongoDB

#3: iPad

though I have not used them significantly, I have sort of drooled from afar over: Twilio, Redis, Node.js, Clojure and Kindle

(ok some of the above are not super new-new, but new enough to me)

rviswanadha• 16 years ago

1. Node.JS 2. ExpressJS 3. Mongoose 4. MongoDB

mjuhl24• 16 years ago

This is not a new technology, but new for me this year was working with MVC frameworks for web development. My workflow has vastly improved because of it. Specifically, the Play Framework (java/scala) and Rails 3.0 (ruby) have been great new additions to the many available.

peteforde• 16 years ago

I was shocked by how powerful SproutCore was, once I actually started hacking on it. I suspect that it will be a very big deal in 2011.

I am also really excited by socket protocol tech advancements in the browser. I was able to pull off seriously cool stuff using http://pusherapp.com/ and also http://faye.jcoglan.com/ which is a nifty JS implementation of the Bayeux protocol.

tarikjn• 16 years ago

PHP and Visual Basic

...kidding :)

mrkurt• 16 years ago

Firesheep, actually. It took a scary-to-people-who-know problem and made it scary to people who don't know. I didn't ever expect to explain session hijacking to my dad.

kefeizhou• 16 years ago

1. MongoDB - I see several people also listed mongodb but I particularly want to mention the simplicity of setting up the database and using the API.

2. AndroidOS - It came out few years back but it really took off in 2010. I can’t wait to see the new features for 2011 and how it’ll fare against iOS.

3. Python - even though I’ve been using python for several years I’m still constantly surprised by it’s core features (recently coroutines) and it's plethora of awesome third-party libraries.

morganpyne• 16 years ago

Most of these are not new to 2010 and some are quite old, but here goes:

- All the Amazon offerings. They are innovating like crazy and improving and expanding all their offerings all the time.

- Compass/SASS/SCSS - All the pain gone from CSS

- Capistrano - All the pain gone from software deployment

- Apple laptops & OS X. A bit on the clichéd side now but it really makes my life easier.

- SSDs. Damnit I really need to buy one of these things. After having tried them out it's hard to go back to spinning platters.

Also things I wish I'd worked with but haven't had the chance yet:

- anything in the CNC milling, laser cutting, desktop fabrication and 3d printing fields. This is a huge area to watch.

jmonegro• 16 years ago

Rails 3 and HTML5

PStamatiou3• 16 years ago

Jekyll (https://github.com/mojombo/jekyll)

First touched it two months ago just to tinker with but didn't really do anything with it. Then after numerous frustrations with my current blogging setup, I spent the last 5 days hacking on it over the holidays and I think it's almost ready to launch. Had to do some custom stuff that I'll write about in a post. It's extremely hackable and I love it. The only thing that doesn't work for me is LSI for related posts. Even with a fast computer and gsl/rb-gsl it still takes 10+ hours with my 1,000+ posts. Anyways, having a super fast site is going to be a breath of fresh air. Google was saying 88% of sites loaded faster than mine ( http://paulstamatiou.com ), though likely due to the images in many of my reviews.

Also installed Google mod_pagespeed and all is well so far.

* Though to be fair most of that is just my redesign that is more minimal, less ads, etc, but there's something extremely attractive about simple, flat files. No worrying about if your database will get corrupted. Everything is in git..

rgrieselhuber• 16 years ago

I love Jekyll. It fits into my workflow perfectly and made it really easy to translate the entire site into Japanese for that market. The whole thing took 3 days.

jackowayed2• 16 years ago

Is there any reason you couldn't have just had Wordpress generate HTML that you then statically cached?

PStamatiou3• 16 years ago

I wanted to learn something new. That's probably the only reason I went with Jekyll. :)

rmc• 16 years ago

I tried using Hyde, the python port, but I wasn't sure how to get half of it to work, there was so little documentation.

schmichael• 16 years ago

beanstalkd

I've worked with MongoDB, Cassandra, and a host of other tools, libraries, databases, and frameworks, but beanstalk is the only one to never fail me. It's not a full swiss army knife like Redis or the sexy app of the year like MongoDB: beanstalk does 1 job and does it, as far as I can tell, perfectly.

drewp2• 16 years ago

Looks like resque (or pyres, or other clones), but maybe a little bit easier to integrate?

schumihan• 16 years ago

+1 for beanstalkd. Zero deployment and blazing fast!

spudlyo• 16 years ago

Varnish, the reverse proxy, has been my favorite new-to-me technology of 2010. It sits in front of Apache and caches static content (or anything really) based on rules you define in the Varnish Configuration Language (VCL).

Varnish is cool because it is very fast. It was written by Poul-Henning Kamp, who has a lot of experience in FreeBSD kernel development. He makes effective use of virtual memory, is careful to avoid memory operations that result in expensive bus transactions on mutli CPU systems, and knows how many system calls it takes to serve up a cache hit. All of this work has paid off. Varnish can turn a plodding CMS into a site that screams, and your profiling tools (siege, apache ab) will fall over before the site does.

Of course it helps if your CMS supports cache control headers, and isn't utterly laden with cookies, but that's where the VCL language comes in. You can write code to strip bogus cookies (like google analytics) coming from both the client and the server which vastly improves your cache hit ratios.

I like the way Varnish uses a shared memory pool for statistics and logging -- a wealth of information about the system is available to you but it doesn't generate a ton of I/O logging it to a file unless you ask it to. I love how you can use the telnet admin interface to compile new VCL code into a running system and then switch to it, while keeping old named configurations around in case you need to revert back.

Varnish has really helped me make slow sites fast this year, although it hasn't happened without some VCL coding effort and some understanding of how the sites operate.

drewp2• 16 years ago

But despite all that description, all my deployments have been one-liners with 3-4 cmdline params only. It really adds near-zero deployment cost.

Squid can do what varnish does, but it's 2x slower by my measurements, and it has a gigantic config file. (Squid can do things that varnish can't, so you may have to use it anyway.)

ja27• 16 years ago

This is the first year I've really used the real released Windows 7 - on my new SSD-loaded work laptop and on my personal netbook. It's amazing to see Windows more or less work and do what I want it to do most of the time.

GPU-accelerated VLC on my netbook has been amazing.

I got a Canon T2i / 550D this year. It shoots some amazing HD video and will only get better as I spend more on lenses and develop better techniques.

The Kindle 3 (brighter display and cheap price) have me reading books I've been putting off for years. It's great to have a device that's great at one thing and not very good at random browsing, Facebook, Twitter, HN, etc.

donniefitz2• 16 years ago

Normally, I'm a software producer and I've worked with a few technologies that are great, but this year (as of late) I'm becoming a software consumer.

I've finally gotten to experience the Kindle 3 (Christmas gift) and the Google CR-48 is pretty sweet too. I believe the Kindle will change the amount I read. I have so many books on deck. My biggest challenge is balancing development time with watching movie time and more reading time.

mkeblx• 16 years ago

three.js (https://github.com/mrdoob/three.js/) An easy to use wrapper for doing 3D graphics via JS using canvas, WebGL, and SVG renderers. Check out the cool demos. I'm betting 2011 will see a lot done with this and similar libraries.

naba• 16 years ago

At work, I've used the Java Play framework and absolutely loved it. Been recommending it to only java guys ever since. Learnt python and django this year and was blown away.

tfs• 16 years ago

Web2py :-)

nivertech• 16 years ago

COBOL ;)

ww520• 16 years ago

The Play Framework is amazing. Its rapid development capability allowed me to finish one project with highly compressed schedule ahead of time.

rkalla• 16 years ago

+1 to the Play! Framework; as someone who did Struts/Java EE 5/EJB3 for a long time, not needing descriptors all over has been awesome.

From reading this thread I see Java doesn't get much love, but for us poor saps that spent 10 years using and learning it and can't give it up yet, Play is great.

nRike• 16 years ago

Well, i still was in the university but i've had chance to play with a few ones:

LCDS, WebORB specifically and Flex 3 RoR Lift Web Framework

And in the Q4 of the year i used all my time to learn Android and a lot of cool API's:

Overlay-Manager to recognize gestures in Android AndEngine Geocoding and reverse geocoding Notifications by vibrating SMSManager

I really enjoyed developing Android stuff, and i'm keeping up with these for a while.

lscharen• 16 years ago

I have to develop a from-scratch application for work and have been pleasantly surprised with the current crop of .NET technologies and how well they can be integrated with open-source systems.

MVC.NET 3 + Entity Framework 4 + OpenRasta + Membership Framework + MEF + LINQ + dojo has been a good experience so far.

AndrewGreen• 16 years ago

Apologies for blowing my own trumpet, but pound for pound, the neatest thing I've worked with this year is a C++ template I wrote. I like to have the tightest possible scoping of names, but a common pattern makes that difficult. If you've got a function that produces a good value or indicates that it couldn't do so one way to write it is:

  Type theVar;
  if (theFunction(theVar)
    { /*do something with theVar*/ }

theFunction returns true if it set theVar, false otherwise. The problem is that theVar's visibility extends beyond our interest in it. The ZQ template lets me write this:

  if (ZQ<Type> theQ = theFunction())
    { /*do something with theQ.Get()*/}

and all of a sudden I don't have to come up with anywhere near as many meaningful names as before.

To me it's neat because I've found many unanticipated uses for it e.g. wrapping the values in option-specifying structures where a default is cleanly indicated with a default-inited (or subsequently Clear()ed) ZQ, rather than having a separate 'use default' boolean, or 'set default' function.

http://zoolib.svn.sourceforge.net/viewvc/zoolib/trunk/zoolib...

megrimlock• 16 years ago

You might be interested in boost::optional, even if only as a point of comparison: http://boost.org/doc/libs/1_38_0/libs/optional/doc/html/inde...

ecounysis• 16 years ago

LINQ

andrewljohnson• 16 years ago

Here are some great open source iPhone libraries I use:

* Mopub - mix and match ad networks, server side - open source SDK (brand new start-up that just got funded, out of AngelPad)

* ASIHTTP - makes networking easy

* TouchJSON - the fastest JSON library, AFAIK

* Appirater - easy drop-in widget for prompting for reviews

elviejo• 16 years ago

Seaside - a WebFramework based on smalltalk and continuations that make developing complex WebApps extremely easy. Seaside led me to learn:

Smalltalk - What a powerful language. This is what OOP should look like.

Object Oriented Databases - Gemstone and db4o. Not having to deal with the OO and Relational mismatch is a breath of fresh air.

enneff• 16 years ago

Go. I've had more fun writing Go programs and working on the Go project than any engineering work I'd done before.

Luyt• 16 years ago

The combination of CherryPy, memcache, oursql and DBUtils. This is a kind of lean and mean Python webapp stack.

nsm2• 16 years ago

redis, node.js, socket.IO, ccache (not new, but new for me), QML

squar3h3ad• 16 years ago

Not new technologies - but I got started with Django and jQuery. Delved deeper into numpy - loved all of them!

neduma• 16 years ago

Nobody mentioned GIT. I went too deep in Git this year.

Others would be Sproutcore, Rails3, Coffeescript, Erlang.

keegangrayson• 16 years ago

iPod touch, flip video recorder, droid 2 global, linux mint on usb, 1.5 TB drive, and a remote control helicopter... good year

yankoff• 16 years ago

This post made my day. I've found some new interesting stuff from the comments. Thank you.

2010 was a year of discoveries for me. I started learning and using technologies like Ruby, Rails, Sinatra, HAML, Google Maps API v3. I started reading HN. Just in the end of the year I've discovered that with technologies like Rhodes framework, Appcelerator or Phonegap I can create iPhone/Android applications with HTML/Javascript or Ruby without knowing objective C. And this is just the most recent excitement I got.

d3fun• 16 years ago

hypertable

dgudkov• 16 years ago

Vertica (http://vertica.com) - massively parallel columnar DBMS for querying multi-terabyte databases. BTW, heavily used by Zynga in 200+ nodes cluster.

herrherr• 16 years ago

Google App Engine.

ljegou• 16 years ago

- WebServices, to provide access for R, Python, and spatial calculations (WPS norm). Complex calculations without installing any client software, anywhere with an Internet connection.

- PostGIS raster capabilities (at last some raster storage and computing inside the database).

- Devon:Think / Bookends / Nisus Writer : Scientific papers and books intelligent storage, bibliography management and scientific writing.

kingnothing• 16 years ago

Ruby on Rails 3: It's much more succinct than Rails 2.

Ruby 1.9.2: It was time to move up from 1.8.7.

MongoDB: I introduced this new technology to the company I work at which has now adopted it for two significant projects. One was the project I researched it for initially, which handles millions of writes per week, and the other is a rewrite of something we used to use MySQL for. It currently has a hundred million or so documents and is going strong. It's new and fun. My collection uses dynamic sharding; I think the other one does as well. One is hosted in our data center, the other is in the cloud. Both are in production and running with 100% uptime so far.

jrockway2• 16 years ago

PSGI/Plack: http://plackperl.org/

node.js for HTTP-related activities. (I needed a rate-limiting proxy that returned a special HTTP code when the rate limit was exceeded. 20 lines of node.js later...)

0MQ: the way network messaging should be. (Did you know that the same socket can be bound and connected multiple times? Amazingly flexible.)

kokoloko• 16 years ago

Scala - It's what Java should be.

mindcrime• 16 years ago

The closest to "cool, shiny and new" I got was Scala. And I never found time to dig as deeply into it as I wanted, so I still haven't done any meaningful coding in it yet. But I did sit down last week and spent a couple of days working through the Programming Scala book, and one of my major goals in 2011 is to learn Scala well.

Other than that, the stuff I did this year that was merely "new to me" was mostly about Groovy and Grails. I spent a ton of time working with Grails, and I'm really liking it.

thomasknowles• 16 years ago

Redis, that super quick key value pair data store which integrated support for hashes has made my life easier for message queuing and session management.

cageface• 16 years ago

Juce: http://www.rawmaterialsoftware.com/juce.php

It makes cross-platform native app development easy, and is a huge leg up for audio work.

bauchidgw• 16 years ago

video + canvas + v8 js engine

2011 we will see in-browser video editing

SeanDav• 16 years ago

Probably redundant to mention it here but hands down and by a country mile: news.ycombinator.com aka Hacker News.

ihumanable• 16 years ago

Flourish Unframework for PHP (http://flourishlib.com) I've looked at it in the past, but this was the first time I was able to work in it professional thanks to a change in career.

It's a really great core library for building web applications, takes the 1389408103 functions in PHP and produces a nice modular library that gives you everything you need and nothing you don't.

wensing• 16 years ago

haXe + FlashDevelop. http://www.flashdevelop.org/wikidocs/index.php?title=Feature... Lightning fast compilation and IDE plus a language that can target multiple platforms = major time savings for a bootstrapped startup.

EricR9• 16 years ago

Definitely Rails 3 for me. I've started taking it more seriously and developing with it professionally.

wil2k• 16 years ago

#1 - MongoDB: see comments above. :) #2 - Redis: also see comments above. ;)

#3 - new to me: Twisted as a server framework; more specific Cyclone which is a Twisted-based clone of the Tornado server framework.

http://github.com/fiorix/cyclone/

Comes with built-in MongoDB (TxMongo) and Redis (TxRedisAPI) support too! :)

sea6ear• 16 years ago

Neither of these are truly "new" but maybe new to mainstream?

1.Haskell or "how I learned to stop worrying (about monads) and just do io." Still fighting with the type system occasionally but I think it's getting better.

2.Erlang - I so love this language. The concurrency support makes me think about programming the way I want to think about programming. I also like that's it's most of the fun of functional programming (Haskell style) but without having to deal with types.

rick_2047• 16 years ago

I worked on LPC2148, an ARM7 based controller. A refreshing experience I guess. Made me realize how easy AVR series actually is. Started working with Atmega8s again this Wednesday and realized that I find it easier to work on.

enjalot• 16 years ago

OpenCL - this year I've been learning about GPU acceleration, and while it may not be good for everything it is looking very interesting for various applications.

While my area is currently graphics/simulation I'm wondering how effective adding GPUs as accelerators to large scale web problems would be. It's really taking of in the Super Computing area, so I'm sure there is room for it!

elithrar• 16 years ago

For me?

· Rails 3 became everything I wanted Rails to be — I've come from Django and am really loving the ecosystem and the way the documentation has matured.

· Varnish — just an awesome piece of software. Fantastic job of caching, from small sites to large, without having to write mountains of config files. It's something you can drop it from an early stage with little cost in time, and know it'll be ready to help an application as it grows/scales.

· SSD's: didn't realise how good they were until I got a machine with one. I don't think I can buy a new machine without one now.

jamesbritt3• 16 years ago

Just realized that I need to add Mirah (http://www.mirah.org/) to my list of cool 2010 tech.

I only started using about a week or so ago, but, hey, that;s still 2010.

I was trying to manipulate Kinect data in JRuby, but it was too slow. However, I may be able to use Mirah instead, and if all goes well get Rawr to auto-compile Mirah files as part of the build process. Mirah's still a bit rough, but knowing Charlie I expect it to rock.

I'm pretty excited about 2011. Which should be starting in about 30 minutes for me ...

Happy new year, all!

dho• 16 years ago

Bundler (http://gembundler.com/) for managing the dependencies of Ruby/Rails applications.

Ask HN: What are the best technologies you've worked with this year?

Related Stories