Man life's short, Live it.
That said be realistic about what you are doing. Aviation is a tough business. I have personally worked for three outfits that no longer exist. I got out of it once and it sucked me back in. You have to consider that you want to get into a very narrow segment of aviation. And one, which being a government job, a lot of people are going to be competing for. I don't know anyone in this business who got their dream job on the first, second, or third try, outside of military drivers.
Bearing that in mind good luck.