The captain should have said he wanted to wait for the weather. Refusing because the A/P is inop is lame. You are supposed to be a professional. What, can't hand fly?
Leave out the A/P excuse and I would agree

I know several people who used to have to hand fly a Lear at 410 from the midwest to the west coast.