I suspect, as PIC, that you could call security, and get anyone removed, physically, from the airplane. As an FO, you could do that also. However, I can't imagine doing that unless I thought they were inebriated or a security threat.