An agent is not a supervisor. A TSA-approved air carrier ID is all that is required to access a sterile area. Sometimes it’s just not worth the fight, but putting up a fight, will always help the cause. Never take the advice of a TSA agent, they’re usually wrong, despite security being their job.