There are thousands of mindblowingly delicious fruits that are simply incompatible with modern supply chains so most people don't even know exist. I recommend "Weird Explorer" on youtube to get a small glimpse.
Nice! Will check that out. I just saw a thing yesterday about nutmeg, the fruit it comes from and the 'mace' which is a beautiful webbing around the pit. Never heard of any of it.
Farmers markets very occasionally will have interesting fruit, often I suspect as a side project for the farmer, sitting at the back of their stall for a couple of weeks only.
In Californian farmers markets and fruit stalls I've been able to get some relatively uncommon fruit with unique flavours: feijoa, persimmon, passionfruit, pomegranate.
Travel is another way to be exposed to new fruit via alternate supply chains. Most Americans have never heard of feijoa but New Zealand in autumn is awash with them! You don't even need to buy them cause everyone has a friend, relative or neighbour with a tree trying to git rid of theirs before they go off!
I ate some ants, primate style with a stick, to mess with my kids and some of their friends at a party. They were surprisingly tasty. I don't know if it was the ants or the pine tar that was stuck to them but something gave me horrible gas pains for a day lol.