Hacker News new | ask | show | jobs
by ljlolel 17 days ago
I’m offering a fully end to end encrypted open source version and hosted version of open router : https://trustedrouter.com/
3 comments

I'm reading the website and nothing about this addresses the compute running the models. If that's going to a third party (just like openrouter is), then there are no guarantees, other than words on paper.
Proving my point. Your prompt gets sent through TR, to another provider on the other end.

There are zero guarantees beyond "trust me bro" that the inference provider isn't taking your prompts and selling them to promptbase or one of a dozen other similar services.

Venice claims no logs, which may or may not be true, but what happens to your prompt after they proxy it to the service running the GPUs?

From their website:

"The GPUs that process your inference requests come from multiple decentralized providers, and while each specific provider can see the text of one specific conversation, it never sees your entire history, nor knows your identity."

Which is an absurd claim if your prompt has your company name in it.

It doesn't matter if it is encrypted in transport, once it hits the company running the GPUs, it is open season for them.

Boggles my mind that people are ok with this.

TR is end to end encrypted to the provider, and we offer providers like Tinfoil that are also end to end that we also attested using Secure Enclaves. OpenRouter doesn't provide that guarantee.

This is entirely transparent. TR is also 100% open source.

It'd be nice if you acknowledged the value of this.

The only solution to this problem is to run the compute yourself.
You need to learn about Secure Enclaves
You need to learn to not make assumptions.

I went to AMD's offices and learned about them from the greybeards that built it.

If you think that's the end all solution, you're wrong. Tip of the iceberg...

https://www.amd.com/en/resources/product-security/bulletin/a...

You stopped using any software that has had a security vulnerability?
Someone give this man one hundred million dollars asap
The link is not working.