[bdr]

Yes, there is a byte limit to the size of a block. If blocks become infrequent enough due to decreased mining power, it's conceivable that a backlog of transactions would build up. At the next difficulty adjustment, though, speed would pick back up again.