Quick stop at the gas station, grocery store, drug store, etc. on your way to/from the airport? Not toolish if you happen to be in uniform.
Loitering around the food court at the mall mid-afternoon with a Jamba Juice in full uniform? Extremely toolish.
But in all cases, loose the hat! On that, I think we can all agree.