Can't speak for the heavy side, but obviously the difference between fighters and airline is like night and day. The only downside to military aviation in my opinion is non-flying duties and requirements that need to be done. With the airlines, unless your mgmt, in the training dept, or have a checkride coming up, when you're not flying your time is your own. That is the best thing about the job!