I would agree with you in your situation. Hard to fly to points when the points there is nothing but blue ocean around islands. Sounds like your not "flying the compass" though. More referencing it for map orientation and using other means to keep on that relative heading. Maybe I read what you said wrong though.