Google Glass only needs to get over its initial days in which it is viewed as awkward and then it will be socially acceptable. Unlike the first cellphones, its plainly visible even when you're not using it, and like Bluetooth headsets there's a risk of being perceived as someone not caring about their surroundings.
Even on a forum like Slashdot which is populated by uber-geeks, here's the results of an ongoing poll with ~5000 people voting.
Head-mounted displays / sensors like Google Glass are:
Creepy 1823 votes / 32%
Cool 821 votes / 14%
Ugly 502 votes / 8%
Baffling 323 votes / 5%
Intriguing 1498 votes / 26%
Short-sighted 413 votes / 7%
I've got my own adjective! (Explained in comments.) 208 votes / 3%
http://slashdot.org/poll/2577/head-mounted-displays--sensors...
The 40% positive outlook is still not bad though.