You may have misread my question...
"Do they have authority under 61.3(L) & 61.51(a) to demand this inspection given that I am a passenger on a plane who just happens to have a certificate?"

In other words, do they have such authority over passengers? Could they draw a certificate out of the hat and make that pilot produce his logbook without specific cause?