I'm in the same boat you are in right now my friend, just a few years before. It is going to be one of the hardest things both of us will ever do. If you want it bad enough, you will make it happen. If not, you could always pursue the office gig and buy a house/start a family etc, and fly on weekends.
As you know the industry isn't the most stable as far as job security goes, and the pay is mediocre unless you're at the top level. I think it is something that only those who dreamed of being a pilot as a kid should pursue. But if you get a good bit of luck on your side and things work out, then in my opinion there is no better way to spend a lifetime than to be a pilot. Either way, good luck to you.