Yeah, the main issue is mostly that the network is designed for lowest-cost, non-time-sensitive freight, and fast, time-sensitive Amtrak trains inevitably get stuck behind something slow, or waiting for something slow to clear from the other direction. A passenger-first network would look like Japan, with lots of double-track, few sharp turns, etc. It would cost more overall too.