Get your private and stop there.
Time Lord,
I still would get the private license even if you don't have the resources to fly as a hobby right now. Hopefully you will have 40 years or so to see your aviation dream mature. If you have a private then you can fly on the side over the years and who knows what the future might bring.
Aviation makes for a great retirement job after the kids are grown and gone and the money is in the bank.
Skyhigh