Maybe I have not flown with as many folks as you all have, but my experience is nothing like that.
Not that I am looking that closely, or checking.
The occasional "5pm shadow" maybe.
More important than the uniform, is the impression we as pilots make during our customer service interaction with the flying public.
A friendly attitude, a smile and the willingness to help, goes a long way in making a positive impression when it comes to the pax.
That is where most judgement is passed, not on what we wear.
FA's overall do a good job, there should be absolutely no room for attitude in that profession.

I like my stags, never had to take them off for TSA.