Hacker News new | ask | show | jobs
by amelius 2001 days ago
Well, one exception could be that some parts of the web need to be crawled more often than others.

But tbh, I think incremental updating of a matrix only makes sense if the other parts of your pipeline are also incrementalized.