They probably don't know you are late. Often times the company will swap aircraft and one that arrives on time or early suddenly becomes the one that is now delayed two hours.
I never got the whole "too cool for school" thing when guys go slow on purpose, or burn a bunch of extra gas to shave 0:01 off your flight time only taxi at 15 kts, etc. etc.
We get paid well for what we do. If this job wasn't union we'd be making half easy of what we currently get paid and I'd bet my pay check things would run a lot better to boot. Eventually we'll get another wake up call and have to take massive pay cuts. Oh and the guys who say they'll walk if that happens, they will be flying 100 hr months.