Actually being locked in the tube and getting to fly is the fun part of the job. The rest of the stuff like sitting reserve, low pay, no job stability, etc is the real crap sandwich of the career.
Back to the topic, take the medical job. You can always come back to aviation if you get sick of the medical stuff.