and it is the responsibility of the gate agent and ground crew/station manager to close the ramp. If the pilot holds the passengers on the airplane even though the ramp is open, that is involuntary imprisonment and can get the pilot arrested.

The ground crew are at fault of this one.