To be fair, customer service agents need to stand out from the public. A bright, uncommon color signals they're helpers, not passengers. I used to wear the ugliest Mustard coat as a guide for a tour operator in Orlando. I was instantly identifiable. So, there is a good reason for FAs and gate agents to have a look that is unique and not likely to be worn by a random passenger.
On the other hand our uniforms already are distinct from a business suit. Nobody wears hats anymore, just ball caps. Nobody has stripes on their sleeves, or insignia on their chest. We need more conservative colors, not less, to avoid being clownish.