Hacker News new | ask | show | jobs
by zeroq 29 days ago
I'm sorry for not taking the time to read the docs, but I have a question.

Some 20 years ago a friend of mine has set up a local proxy (python if I'm not mistaken) that was gathering all his web traffic and served him as a long term memory. The proxy had a web interface and allowed him to quickly find something he saw ca. 10 days ago, or that specific algorithm he recalls but can't remember it's name.

For years I've been collecting links to different work related trivia which I use on a daily basis as a rabbit-from-a-hat solution to answer random question from friends and coworkers. For example someone randomly asked me for an idea for color palette for data charts and I can immediately give them a scientific research into the color palette. Or an obscure algorithm.

But with time the collection has grown substantially and it's really cumbersome to find the proper things.

Would your project be a good fit for my problem?

3 comments

Absolutely, this is a great example where Hister can shine.

I started Hister as a proxy as well, but quickly switched to the current extension based approach, because intercepting HTTPS traffic requires a MiTM proxy which is much more painful to setup than installing a browser extension.

I found Hister a few month ago and was amazed by it.

Now for many of us the browser extension approach is not possible (mobile usage, security, etc.)

My feeling is for a lot of users there is really a third way apart from the MiTM proxy or Browser extension approach. I actually do not want my "personal" / "logged in" pages to be indexed. This is a bit like the MS recall nightmare (self hosted version).

Any way to get the list of URL visited (with something like Privoxy, or maybe one of those popular ad blockers like Pi Hole but I guess they just get DNS queries?) and then importing it with some filtering rules with a nightly batch job is good enough for a lot of people.

The browser import [1] is great but I guess hard to use with mobile...

- [0] https://www.privoxy.org/

- [1] https://hister.org/docs/importing-browser-history

Thanks for the kind words =]

There is already an ongoing discussion about the topic: https://github.com/asciimoo/hister/issues/387

The currently discussed solution relies on the browser extension, but mobile Firefox has extension support.

would it be possible to gdrive/rsync/git the data between machines and then use the data on an online server for retrieval (given that I would handle data sync myself)?

also what exactly are you using for search? does it support trigrams? how do you sort results?

Also very interested in this. I was playing around with doing the same thing with YaCY. I want the proxy aspect so that I can proxy my phone traffic through it as well.
Unfortunately mobile Chrome browsers don't support browser extensions, but our extension works well on mobile Firefox.
Would you mind sharing these links? Or a subset? I want to grow my collection which is tiny because I started way too late