I know guys in their 30s who made this mistake and are still trying to recover. They can't get their dream job without a degree and are stuck in their current gig trying to fly, raise a family and finish college.
Be smart...go to a college with an aviation program. Get your degree. Move on.