The crux of the matter is that the actual folks in charge of hiring don't agree with you. When it comes down to it, the vast majority of applicants who get to that test do have the demonstrated aptitude over time and training success as well. You might have an excellent background, but so does everyone else taking the test.

In other words, they give you the test already knowing that you should know how to fly an airplane. They still want to make you do it. Your record speaks nothing as far as the test is concerned, but it does make it easier to get to take it.

I don't necessarily agree with how the process works, but I do agree thinking your background should exempt you doesn't really fly, any more than it does DCI pilots because they flew planes with passengers on Delta tickets.

The real question is are the standards too high relative to the alternative paths available.