I understand this, but if you're not GPS/RNAV equipped and are using VOR's, how are you going to navigate to your clearance limit which is the airport? I think an IAF is appropriate in this situation.

If you are /U, there has to be a VOR nearby somewhere, probably at the field. That's where you go. If there is no VOR, and you can't navigate to the field directly, then that might be a good cause for 91.3 and you can choose to go to the IAF, just make sure you know why you chose that.

Alright, I think we're finally on the same page. I'm willing to bet that the reg was written before GPS and therefore is not inclusive of direct navigation. I'd be interested to hear a FSDO explanation of this.

There's tons of regs that were written before the 60's that are still in effect. I'd say an overhaul of the regs is due, but then I'd be afraid of what they would think of!