[akurtzhs]

> I've resorted to making an "actual_requirements.txt" file manually listing only direct dependencies and whatever version constraints make sense.

Pip-tools has an elegant solution for this. You write an requirements.in where you list packages and optionally versions, then pip-compile turns that into a requirements.txt with every package including dependencies specified by versions. You can use it to update specific packages as well.