Wannabe:

As in most of life's greater pleasures and endeavors, follow your heart.

Rick is right in that you won't know if you made a good career decision ($) until the day you retire.

Hvydrvr is right that only you will know if it made you happy.

One thing that hasn't been addressed here: what is your end-game goal? If you are trying to get hired at a Major, I think your color-blindness may be a show-stopper, regardless of the Class 1. That is, an airline can have a higher standard than what is required by the FAA.

I'm not sure if that would be an impediment at a Regional or not...someone else will chime-in here who knows. I know it's a stopper for the military.

Smaller 135, Flight Schools, or Helo Operations would probably be OK with it.

With a realistic expectation, ask yourself what kind of flying job you would want to do, that could still provide for you and a family. Most guys make these decisions when they are single and childless; it's funny how it is never mentioned in the glossy ads for aviation schools......

And, I'd like to reinforce the advice to get a degree. Not an aviation degree, but something marketable during downturns. Same thing there: major in something you are interested in (heart), that could still be a viable living ($) for you and a family. You write exceptionally well for a guy with no degree. It suggests to me that college would be time easily and well-spent.

Good luck.