if you don't absolutely love it, leave..
if you absolutely love it and don't see yourself doing anything else then why leave. stuff happens.
talk to the guys who have had other careers, desk job etc. this is barely a job. waking up and going to fly a few legs a few times a week is a whole lot better than other careers. trust me.
now look at being with a legacy in 20 years. you're making over 1/4 million dollars a year and barely working. guys who make that much work their tail off.

one more thing. we don't bring our work home. you finish flying a trip, you go home and relax. before your trip you literally get ready and show up to the gate. that is what you cannot beat.

this is just my opinion though. Ive had another career before this and my dream was always to fly. I was miserable at my last career. one day i said screw it and started flying . haven't looked back since and wouldn't change a thing... I also do not have a family. that is a big difference and if you are worried about not providing for them, do what you have to do.