[hoppp]

You download the html, hash it with sha512 , then run the Ai and the webscraping and cache the api content

When the cache is invalidated you refetch the html, check the sha512 hash to see if anything changed then proceed based on yes or no

Or something like that. Its not fast but hashing and comparing is fast compared to inference anyways

[Aaargh20318]

I’m not sure what that would solve? Your API call is still broken. Best case you’re serving stale data.