"'I'm guilty of never calling them. I guess that's the only solution. "

Yep you're part of the problem.

Call Pro Standards (kind of like filing an FSAP) and just confront the Captain before the trip even starts; and a good place to do so is the initial flight planning. If this body gives you any push back just tell him/her the two of you are going straight into the flight office to work this out.

Be prepared to have some future vacation, sick list or even a WOP charged to you for the trip. Unless you are willing to pay the price and do something about this pilot's actions nothing will change.