[maxerickson]

In the privacy settings "Optional connected experiences" will turn off the app previews (and web previews).

[taspeotis]

I was very excited to turn this off, but it turns out it's already off.