Definately stick with your current studies. I'm guessing you're not actively flight training at this moment? Either way, take some lessons, you can do your degree and do the lessons on the side because FAA ratings have no bearing on a college degree, and vice versa(well maybe some programs will honor the ratings).

With an EE degree, down the road you could set yourself up in the Avionics industry, and being able to fly would really give you an advantage over others since you know what it is pilots are looking for. Think about them apples.