Like HIFLYR said, don't get turned down. The sport pilot route is certainly okay, but ...
A waiver is possible, I'm almost certain. The first guy who took me flying (and let me fly!) had vision in only one eye. Officially a waiver is called a "statement of demonstrated ability". I'm disappointed that the AME you talked to wasn't a bit more aggressive in at least pointing you in the right direction for information. AOPA has a pretty good medical department; even though you probably aren't a member they may talk to you as a prospective pilot.
AOPA Online: . You should be able to get a good idea of your chances for a waiver before you apply for the medical. If I'm wrong and your chances aren't good, sport pilot (and / or private pilot - glider) is just fine! Good luck!