Sounds to me like you're fine. I'd still file a NASA report...couldn't hurt. I'd also ask a mentor or someone more experienced locally if there's a more preferable way wrt getting back to your airport when the tower is closed.