Captain Teezy,
If everyone hates you, don't be bothered. Pilots are supposed to have thick skins. Work where you want and live where it's convenient. Help your wife get her PhD, then let her go to work, while you stay home and tend the house. It's a rough world out there and my advice to you is to stay at home, raise the kids, and enjoy life.

And, seriously, I'd not worry about what anyone else thinks, after all, it's your life.
Good luck with your decision.