I've read that Inuit have a larger liver. I wonder if this is a case of genetics or if increasing the percent of meat in your diet leads to a larger liver.
Agriculture is a recent invention, only about 10kya old, and many cultures never adopted it for various reasons. It makes sense that evolution has had a bit of time to work its random magic on plant eaters.