Only you can determine what will make you happy. From your last few sentences, I think you have already come to the conclusion that will work for you. Don't base your life decisions on what anyone else thinks! You must do what is best for you and your family. You can always get back into 121 later on...

I completely agree that the industry is not for everyone, and the time away from family is a significant sacrifice.

Good luck and Stay true to yourself!