Also, don’t forget Amtrak is charged with stopping at every farm field, doing milk can runs. Back before deregulation, Ozark did those runs from Memphis to Minneapolis. Five intermediate stops. Took all day to get there with a DC-9. Often only picked up or dropped off two or three passengers at each intermediate stop.
Plus, most places they run on freight tracks. They are second priority. A “Z“ express freight can put an Amtrak on a siding, waiting for the express freight to pass.