That's exactly how startups think, though. The king raises an army to conquer rich lands and pay off debt. The founder makes hacky products, to get users, then raises money to hire engineers.
It has to be moderated by comprehension. If a leader doesn't understand what interest rates are, they'll borrow money every time it's available. A startup needs to borrow enough to succeed, but not so much to be bankrupted by debt payments. Same for technical debt; enough to move fast, but not so much the software (or staff) collapses before revenue.