It should go without saying that this system is not Turing-complete anymore if you bound the runtime.
In most systems with finite memory, the halting problem is solvable anyway.
(this includes linear bounded automatons and deterministic/non-deterministic machines with finite memory).
It's just going to take a long ass time.