Keep your family first. Don't sacrifice time with them to go flying, especially if you're considering a career out of it. You'll have plenty of time to make them wish you were around when you get that first flying job.