As long as you are financially secure (which you seem to be) and as long as your family supports you (which I assume they do), then good luck to you! When my husband wanted to fulfill his dream of becoming a pilot, we planned, prepared, prayed and made the jump. We always expect the worst. Expect the worst and be prepared. In the four years that we've been living on less than half of what we used to live on, we've actually been able to start a "furlough fund."
For me, personally, I didn't get my husband back until he started flying. He was so miserable at his old job he was a different person. Any sacrifice has been worth it.