[andyjohnson0]

Turing's Cathedral by George Dyson is a good source on the history and development of computation in the 1930s through to the 50s. It's very centred on the work that was done at Princeton by Von Neumann et al [1] and lacks coverage of important work that was going on at the same time in Germany, the UK, and other places.

You might want to look into how the idea of computation came out of mathematical work in the early twentieth century. The Annotated Turing by Charles Petzold is good if you're up for some maths.

Aerospace and spaceflight were some of the first activities that required large-scale software development. You could check-out Starburst and Luminary by Don Eyles and Digital Apollo by David Mindell.

[1] The author's father was Freman Dyson who was at the Institute for Advanced Study (at Princeton) with Einstein, Gödel and others.