In regard to the loans: With an engineering degree from a decent school you should be able to pay off your college debt quite quickly. There's no reason to let it become a ball and chain. Live below your means and pay off the debt.
Also, you're right about "don't go to an aviation college". Learning to fly isn't degree worthy. It's skilled labor. Engineering, on the other hand, is one of the "professions". You can get your ratings on the side and be in a much better place than the Part 141 grad if you do decide to fly.