With Google Glass at least you were actually seeing their real eyes. I always got the vibe that the attitude came from the fact that 1) looking at you also pointed a camera at you 2) you could never tell what the person wearing the glasses was looking at while talking to you, if anything.

If people start wearing this thing to go grocery shopping, you'll probably get similar reaction. If people are obviously in the middle of doing something and you walk up to ask them a question, I'd expect that would be less of an issue.