Anytime you go against mainstream, you're going to face criticism. Whether it's SS, fixed gear, the wrong clothing, or any other deviation from norms.
People deviate from the norms for reasons, people who don't, imagine those reasons must be insanity, stupidity, or other mental failings.
The answer to your question is as much about facing social pressure, as it is about the appropriate tool for the job.