Having technology recursively create technology does not lead to unlimited potential. Such infinite structures lead to stack overflow and do not exist in the natural world without limits.
But how many people actually think the potential is unlimited? Clearly there is a limit, but its likely far enough away from our current position that it doesn't particularly matter.