Let nothing stop you
It seems to me that if a guy is destined to become a pilot then they let little get in their way. I can understand the medical issue however if one little girl friend was able to bump you off track then what is going to happen when the next one comes along?
When I was 16 years old wild horses couldn't stop me from my aviation dream. Against reason, girl friends, money and advice it is just something that you have to do. If you have already been able to be side tracked so easily then maybe what you really want is a lifestyle and career change and not necessarily to aviation.
I would pursue a four year degree (other than in aviation) or other similar professional certification and change jobs. Hopefully your new profession will provide enough surplus income to permit you to flight train on the side.
Skyhigh