I think Firefox focus does that on android, I'm sure there's a way to get the same result on a desktop with some flags and pointing to a config file (or a read only profile folder maybe?)
AFAIK Firefox Focus doesn't have extensions at all:( Although yes, it effectively has only private/incognito sessions that are erased when you close the app.