5 failures is a game changer, but not necessarily a game ender. If you can pass the instrument ride it is really the toughest one. ATP, type ratings are the same thing with different and higher performing airframes.
Figure out the problem and fix it.
And to be honest, this career is not for everyone. Without knowing the full story, it is difficult to say whether it's time to give it up or not.