Society on the whole doesn't like change and doesn't take well to things not going the norm. That's a given and while it's not a pleasing topic, it's easier to accept rather than get mad about it. Now, you need to take your own advice and not get antsy about people openly disliking your choices in life. That's going to happen no matter what you do and you become the better person by letting them rant and rave about it while you enjoy your life. Let them think what they want to think and you carry on with your life. If you want to wear constantly, then do it.