[_zekiel]

We open sourced our instant answers platform a couple years ago, in the hope to get more eyeballs on them (for quality and quantity): http://duckduckhack.com/ It might not address your point but any underlying flaws (randomness, etc) can be caught/fixed by the community.

[ucarion]

Sounds like that still requires that we trust DDG to be actually using the code in its git repo.

[andreasvc]

Yes, just like you're trusting the gazillion lines of code running on your own computer. No one is able to audit all of them in their lifetime.

[skj]

Giving the benefit of the doubt to the gazillion lines of code running on your computer, that you and several million other people downloaded from the same place, with verified SHA sums, is actually pretty reasonable. If you're truly paranoid, all you have to do to ensure that you're benefiting from crowd-sourced verification is verify the SHA sum code.

Stuff running on some website that only the web site admins can see is not in the same ballpark.

[andreasvc]

Where you download it from and SHA only gives guarantees about integrity of the data transfer. I am talking about trusting that the code does what it is supposed to do. Bugs can hide in code for years, whether inserted accidentally or intentionally, as the Heartbleed episode demonstrates. SHA does absolutely nothing against this.

[skj]

I'm addressing malice, not oversight. The SHA allows you to be confident that you've got the same code as everyone else.

[andreasvc]

I was addressing malice as well. Having the same code is no guarantee that it does not contain an intentional bug that can be exploited. Neither is knowing that it came from some specific entitity (code signing), because again this presupposes establishing trust. There is no technical solution to trust.