As someone who left pretty early in and currently working 8-5 in an office: If you feel you have to leave, do it, but leave the door open on your way out. In other words, don't burn any bridges and try to get a few hundred hours logged. That way, if you ever do decide to come back, you'll have a little bit of a leg to stand on and something to compare your non-flying job to.
Edit: Also, if you're still young, going into an office job for a few years isn't such a bad thing either. You'll either decide you prefer that or decide to go back into flying with a new perspective you can't get any other way. That could ultimately help your satisfaction to have a longer aviation career than if you just try to slog it out now. I think another career is good thing to have so you have enoough control over your life to say "no" when aviation employers treat you like crap or try to get you to do something unsafe/illegal.
Last edited by Rotors2Planks; 02-19-2016 at 12:01 PM.