Look at it as a hobby. Keep your day job to support your hobby, get your private license, instrument, commercial, CFI, CFII, MEI, etc. See how you feel about it after each license or rating and go from there.

I worked a fulltime position and flew in the evenings and on weekends, within the first year as a part time instructor I logged over 500 hrs. Take it one license or rating at a time.

I was an Adjunct Faculty Member within an Aviation Program at a local Junior College and the biggest impediment that prevented students from completing their training was the lack of funds.