I see both sides of the issue... There are some GA pilots that scare the hell out of me at a local airfield, and there are at least two doctor-pilot colleagues of mine who I won't fly with. One has already destroyed an airplane, no kidding, NTSB report and everything, still has his cert., and another just makes me concerned with his attitude / actions, without going in to details.
However, I think most GA pilots are safe and competent. Just like everything in life, there are good and bad eggs. I don't think you'd want to judge all airline pilots by Marvin and Rebecca.
My CFII once said to me, "If you feel that flying an airplane is extremely difficult, you probably should not be flying an airplane." I think there is some truth to that. Obviously the flip side of that is complacency, which is equally dangerous.