I've been facing the issue of shifting data with the eBay browse api. Unfortunately they don't offer ID based pagination. What's the best way to deal with it, manually track queried data yourself?
This is something that can only really be handled on the server side, but you can implement some mitigation strategies, like manually deduplicating entities. It's a lot of work for marginal gain, and you can never completely make up for problems on the server side in the end if you can't change the server.