Thanks for the feedback. Yes, adding content is a high priority. So far it's a proof of concept with couple sites. A big part of the app was the backend crawling infrastructure. I want to make it easy to crawl new site. Now new site crawling can be defined in couple hours. Similar pages within a site can be done in minutes, like the subreddits or the digg categories. There's plan to open up the backend to allow anyone to define crawling for any site.
Storage is so far under control since I'm not as ambitious as Way Back Machine to archive the whole internet. It might be a problem once I open up to allow anyone to define crawling.
Good idea for applying the UI to Way Back Machine's data. I'll look into that. Thanks.
Storage is so far under control since I'm not as ambitious as Way Back Machine to archive the whole internet. It might be a problem once I open up to allow anyone to define crawling.
Good idea for applying the UI to Way Back Machine's data. I'll look into that. Thanks.