Penny-wise and pound-foolish. If cheaper means throwing the time of your most expensive resource (engineers) down the drain to save some money on rent and Ikea furniture, then sure.
How is this foolish? This saves the company money, and helps executives get bigger bonuses. This might cause the company some problems in 5 years, but who cares? By then, the executives have already collected their bonuses and left.