AeroFS is x87 faster than Dropbox in LAN syncing [video]

http://blog.ram.rachum.com/post/33073905775/aerofs-is-x87-faster-than-dropbox-in-lan-syncing

by cool-RR • 14 years ago

33 58 14 years ago

blog.ram.rachum.com

georgebashi2• 14 years ago

This is one of my major annoyances with Dropbox — I'd love to shift everything to my Dropbox, but the slow sync speed is painful.

I signed up a long time ago for an AeroFS invite but had no joy. Anyone got one they could share? I'd love to try this out.

cool-RR10• 14 years ago

Sent you an invite :)

georgebashi2• 14 years ago

Received! Thanks! I noticed from your profile you wrote LOGO for python — I did the same for processing! http://terrapin.sourceforge.net/ Great minds :)

checker6593• 14 years ago

Can I have an invite too? Pleeaassseee. :)

zgubi2• 14 years ago

can I have one as well, please?

gerrynjr• 14 years ago

If anyone else has an invite, I wouldn't mind trying this out

antr• 14 years ago

I love AeroFS. Although it is missing many of Dropbox's features (e.g. web storage of files, better version history, etc), the fact that it is extremely fast and there is no cap on P2P sync makes it my weapon of choice when sharing files/folders with colleagues.

FireBeyond2• 14 years ago

Sounds like exactly what I need - and what I usually use Dropbox for.

If anyone could spare me an invitation...

cool-RR10• 14 years ago

I'll be happy to invite you, but I don't have your email address.

stcredzero• 14 years ago

What would this get someone who already has Dropbox and Air Drop on OS X?

Answer: compatibility! Now that walled gardens are going up, there's pain in getting through the walls. If they can make this compatible with Dropbox, it would be a great combination. There's also the possibility that Dropbox could add Bonjour/Rendevous to their client side software, reducing AeroFS to just a feature.

newman3143• 14 years ago

Not really, the attraction of AeroFS is not having a connection/reliance on S3. So for something like 1Password syncing, it would be great not to have a copy sitting somewhere in the cloud.

mikeash• 14 years ago

If you use a strong master password, and given that 1Password uses a secure key-derivation function, does it really matter if your 1Password file is sitting somewhere in the cloud?

alistair752• 14 years ago

Just tried this myself with a couple of 8.5MB MP3 files. One appeared on the second machine in about a minute, the other in about a minute 30.

Not sure why this is taking upwards of 12 minutes for the OP.

cool-RR10• 14 years ago

I'm jealous that on your computer, instead of being incredibly slow, it's only slow.

tmx• 14 years ago

OP probably didn't disable dropbox speed limiting - this is the default:

http://i.imgur.com/wTWzG.png

alistair752• 14 years ago

For what it's worth, I haven't changed those settings on either of my machines.

cool-RR10• 14 years ago

Thanks for that tip. I disabled the limiting now and it sped up from 11:42 minutes to 01:40 minutes! Now Dropbox is only x12.5 slower than AeroFS.

The real solution, of course, would be for Dropbox to transfer the file over the LAN immediately before waiting for it to be uploaded to the Dropbox servers.

newman3143• 14 years ago

AeroFS looks cool but I'm not too keen on having to run Java just to run AeroFS given that I had disabled Java on MacOS due to the recent exploits.

xyzzy123• 14 years ago

I wouldn't worry about it.

The Java to be disabling is the Java browser plugin, which allows un-trusted web sites to run applets in a sandbox on your machine. As you know, there have been a lot of issues with Java sandboxing.

However, AeroFS runs locally (as far as I understand, I don't have an invite) so should be fine as long as you trust the provenance of the code.

spartango• 14 years ago

I believe those exploits are Java applets breaking out of the browser-plugin sandbox, which is designed to limit application access to even simple things like files and class loading. To be clear, these aren't strictly JVM vulnerabilities, and more plugin security-model vulnerabilities.

Java "desktop" applications don't have such a sandbox and thus they already have access to things that the vulnerabilities enable (such as manipulating system properties). Really, we ought to treat Java desktop apps no differently than native binaries, bounded by the the OS' security model.

mekwall• 14 years ago

This is like comparing apples and oranges. I'm inclined to think that the creator of this video is biased towards AeroFS.

cool-RR10• 14 years ago

Funny, I'm actually biased towards Dropbox. I use it for most of my stuff because of the versioning and the Packrat feature. But there's no reason for Dropbox not to do direct LAN syncing, and no reason for AeroFS not to offer infinite versioning. It may be more complex to design, but definitely feasible. So I don't think that this is an apples-vs-oranges comparison.

TillE• 14 years ago

> But there's no reason for Dropbox not to do direct LAN syncing, and no reason for AeroFS not to offer infinite versioning.

Really, no reason? None at all?

For "infinite versioning", it's obvious - there's no upper bound on the amount of data the server has to store. Storage space costs money.

As for no direct LAN syncing, someone's already mentioned the reason - consistency. Syncing is already a hard problem, and it's dangerous to allow more things to go wrong because the clients synced but the server didn't receive all the data.

sepbot• 14 years ago

People often misunderstand what the Dropbox LAN Sync does. The file needs to be already in the cloud before it can be synced over LAN. This means that when you add a new file, it will first get uploaded to Dropbox servers then transferred to other computers over LAN. Considering that most home connections are asynchronous (slow up, fast down) the entire processes gets bottle-necked by that slow upload rate.

cool-RR10• 14 years ago

You've given an excellent answer to the question Why is Dropbox's LAN Sync so slow? but the more interesting question is Why don't the Dropbox engineers change how LAN Sync works so it won't be so slow anymore?

yskchu• 14 years ago

Also, uploading the data to Dropbox server, and then downloading again, wastes valuable quota for those under a data cap.

CJefferson• 14 years ago

I can understand why, particularly given Dropbox's aim of being as simple as it can possibly be. At the moment the rule is simple. At the moment the cloud can be relied on as the authorative copy which everyone syncs with. If I have 3 or more local clients, all talking and sharing over LAN, many issues get very complicated.

rarrrrrr• 14 years ago

This is also how SpiderOak's LAN sync works. Both Dropbox and SpiderOak guarantee that the single point of truth is the cloud, for good reason.

Making exceptions to that approach (like allowing individual machines to sync with eachother directly before transferring to the cloud) creates opportunities for conflicts and inconsistencies that are very difficult to resolve because all the information might not be available.

dfc3• 14 years ago

Your second paragraph reads like a defense of CVS. git-annex handles this fine for me on my network at home with multiple machines and multiple copies of the repository/archive/drop-box-folder on each machine.

gvb• 14 years ago

Nitpicky, but you meant the typical home internet service is asymmetrical, not asynchronous.

rogerbinns• 14 years ago

Note that technically the file contents don't need to be in the cloud, but rather the metadata and indexing do. I'm guessing that the indexing is how Dropbox breaks the file into blocks, checksums them and does some form of duplicate detection to save on storage costs.

fox91• 14 years ago

It's nonsense, they are 2 different technologies

martin-adams• 14 years ago

What's the best way of writing this. Is it x87 or 87x faster? Thank goodness it wasn't x86 faster as that would have confused me.

On a related note, I've been using Livedrive for a number of years now and they have a lan transfer option to obtain a file over the network than over the internet. I suspect however a lot of use cases are separated by the internet and generally aren't on the same network.

What would be awesome however is if after the sync both computers were able to contribute to uploading the file to the live server. So I could sync my files over lan to my laptop, go to work, then have my home/work computer upload them to the net, thus 2x quicker to store it in the cloud. But that would be a bit of an edge use case I think.

bigtones• 14 years ago

I've always thought it's 87x as in 'eighty seven times' - the other way around makes it seem like a long lost Intel instruction set.

mdellabitta• 14 years ago

x87 is the original FPU instruction set of the x86 family, so time to be confused again. But now you can be .75 confused instead of 1 confused.

lutusp• 14 years ago

> But now you can be .75 confused instead of 1 confused.

A confusion index of 1.0 would be described as perfectly confused. But, as is often said, nothing is perfect. :)

rgbrgb• 14 years ago

What protocol does AeroFS use?

Hotspam• 14 years ago

I would love an invite if anyone could spare one. My email address is hotspam{at}gmail.com. I've been on the sign up list for over a year but haven't heard a thing. Thanks in advance!

AeroFS is x87 faster than Dropbox in LAN syncing [video]

Related Stories