Why make any sort of prediction for its success based on your own tastes or issues with privacy? By those standards Facebook should have failed massively already because a lot of people don't like it (I for one) and its obviously handled privacy poorly in a number of well publicized instances.
Google Glass is a tool that augments existing tools and for a lot of people that will probably be fine - and they'll use it occasionally while on vacation or at a party or what have you. For some it'll be a game changer, and those people will use it all the time; but those people already use their cameras, smartphones etc constantly and Glass will just help them create a better workflow.
Some people will like it, some won't; beyond that I don't see how anyone here can make sweeping declarations about how 'society' - whatever / wherever that means - is going to take it.
Finally, why is assumed that everyone who uses it will be recording surreptitiously on a constant basis??? I don't do that with any of the many recording devices I've owned, and I don't know anyone else who does either.
Just because it'll be easier doesn't mean this garish anti-privacy vision will come to pass. And just a heads up: any time you're in public, you're in public - you're not in private and you're likely recorded, looked at, or noticed by someone, or something in any modern society. Get over it.