anecdotal evidence is evidence, its just not of a good quality.
a lot of things rely on it for their justification. the best example i think i can give in the context of wanky hipster startups would be "agile methodologies"... despite the completely different area of concern they are also attributed properties which are inherently difficult to measure and perform experimentation with. i've seen very little evidence except for anecdotal evidence to back the claims surrounding them (although certainly, they are based on quite reasonable conclusions to reach with no evidence at all - by using logic and "common sense" to derive from better known quantities)
i'd say its often too wooly to even call a single data point, but in other cases its obviously very many.
if 1000s of people are telling the same story, thats 1000s of potential data points... they lose value from being ill defined rather than being small in number.
> if 1000s of people are telling the same story, thats 1000s of potential data points... they lose value from being ill defined rather than being small in number.
reply
They don't exist in isolation though. If thousands are telling the same story and there is no independent corroboration then it's more likely that one person told a story and thousands repeated it.
a lot of things rely on it for their justification. the best example i think i can give in the context of wanky hipster startups would be "agile methodologies"... despite the completely different area of concern they are also attributed properties which are inherently difficult to measure and perform experimentation with. i've seen very little evidence except for anecdotal evidence to back the claims surrounding them (although certainly, they are based on quite reasonable conclusions to reach with no evidence at all - by using logic and "common sense" to derive from better known quantities)