Yeah, I was thinking of similar, would be good to see how it works out for you. There's obviously the command line tools for building, but I would miss the integration of Xcode as an IDE for iOS storyboards etc.
Otherwise I've been looking at using remote servers from macincloud.com / xcodeclub.com, but haven't tried that yet.