AMP isn't limited to Google cache. Websites and CDNs (like Bing and Cloudflare) can roll their own AMP and cache it themselves, while still getting the icon in search results.
Example: https://amp.reddit.com/r/AskReddit/comments/6yj6iw/what_did_...