Be professional, but do what's best for your family. I've been in your situation, I think most pilots get there at some point. I emailed a chief pilot I had given a firm yes to and told him no, and he thanked me for at least contacting them - they had gotten many no-shows. An exhange like that can save a bridge you might need to cross later.