Thanks for your responses. I tend to agree with SonicFlyer and disagree with Rick..7777.
It's my understanding that as humans we are given inalienable rights such as the right to travel. Aviation falls within traveling. Licensing, medicals, etc. are generally used for commercial endeavors because banks and insurance companies rule the world. You would present an insurance liability if you commercially flew an airplane without a licensed pilot (for example).
My argument is that in order to serve in a Federal Administration, you are usually required to swear an oath to the Constitution and the Constitution requires due process. I would imagine that due process would therefore, need to be followed in Administrative agencies. Correct? It appears that administrations like the FAA do things arbitrarily, which would be a violation of oath.
With that being said, no one has given me any examples of what past pilots have done in the past in regards to remedy, besides a lawsuit.