ATC must have thought you were rnav able. If you were not, you can not accept a clearance direct a waypoint. (If you were within a degree or two of a defining radial you could intercept it and fly outbound and nobody would be the wiser)