The captain has all the authority he/she needs to deal with things like that, certainly. I could absolutely have returned to the gate and had him replaced without fear of retribution, at least not from MY company. YMMV...