Hacker News new | ask | show | jobs
by amelius 1999 days ago
How about the PageRank algorithm, where your crawler detects new links and you need to insert new weights into the matrix from which you then later compute page ranks?
1 comments

Wouldn't it be easier to first do your crawling and then construct the matrix in one go? But graphs more broadly sounds like an area where you might want to update the matrix yeah.
Well, one exception could be that some parts of the web need to be crawled more often than others.

But tbh, I think incremental updating of a matrix only makes sense if the other parts of your pipeline are also incrementalized.