I would be shocked if any controller would violate you busting for a few seconds, unless it cause you to deviate another aircraft. On my personal scale of things that could go wrong I would rate it about a 2 out of 10. I would sweat it. About 5 years ago the controller said he would call my base. I turned in and came way to close to a cargo plane on final. The controller called me and said I needed to wake up. He said all the bells went of in the tower. Nothing happened.