Safety is expensive. Infinitive safety has infinite cost, the regulators can only mandate so much before the whole enterprise fails.
For political reasons, they have to make the airlines very safe.
That doesn't apply to niche and private operations, they basically set a floor and allow the customers to choose... some operations are very bit as safe as airlines, and quite expensive too.
If you expect .gov to extend airline safety to charter/fracs, why stop there? What about generic 91? What about private pilots? Shouldn't they have two pilots with ATP's, two engines, and the ability to climb out after a V1 cut too? And a dispatcher, etc? ASEL should clearly be illegal.
Airline safety is set for very specific reasons (including international conventions). Those reasons don't apply to other segments. The argument "but safety!" is meaningless out of context.