Yeah, that thought flutters into my mind every now and then - and an (apparent) display of terminal stupidity like 3407 is enough to make it happen a bit more often. We all know that flying is "BY FAR THE SAFEST MODE OF TRANSPORTATION", but it always feels just that much safer when my butt's in the front seat.
Can't say it's ever affected my travel plans, though.