Having done both flying and office work; while getting paid, I'd take the flying anyday. I made about 60K sitting in an office with no windows, sending emails and giving briefings all day. I never want to do that again. So I threw away all the bennies and now I'm going to be begging for a job at 20K. Either way, it is WORK, you might as well do something you remotely enjoy. Oh yeah, I also worked 12-15hr shifts (probably just a little more than most pilots) which means if you add it up you are missing 67%+ of your family life. When I wasn't on shift I worked up to 100 hours a week so I was very happy to move to rotating shifts 3X12 hr days, 3 off then 3x12hr nights on and on. Plus, when I was told to go somewhere for 8 weeks 3 days after my wedding, I went.
Oh, and garbage guys in New York make more money that a lot of highly skilled people around the country. But I probably had more disposable income when I was a cadet on $60 a month.