Although cant be 100% certain, I think it's highly unlikely (and thats an understatement) for anything will come down on you. From a legal perspective, there's a lot of mitigating factors here- i.e. they had the tapes of the 2 way radio communications, the "clip" was not egregious but merely a mistake, you called the phone number and owned up to it and the supervisor said you were fine. Also submit a NASA report as everyone else was mentioning. I think that will cover all your bases. These things happen from time to time, controllers understand that.
Also, it's a significant amount of time and paperwork resources for a report and full investigation to be carried out. It would be a lot of work for little to no benefit so when you called I'm sure they just let it go. The controllers need to "pick their battles" per se, and this to me just doesn't rise to a level where it would make sense for them to go after you, and for you to lose sleep over it.
It would be a different story if you called the number and said something along the lines of "screw off, you wannabe metropolitan Class B controllers, you work for ME" etc... that would probably have a different outcome.