I don't remember hearing anything about Cochrane in mainstream news until they put out an unfavorable review on the effectiveness of mask usage during covid 19.
A very unfortunate, badly run meta analysis as I understand it which fundamentally undermined trust in their governance because it was so easily critiqued. I haven't seen a robust defence of that one.
I haven't seen compelling critiques of it[0]. Curious to read them.
Their findings:
On medical/surgical vs. nothing:
"Wearing masks in the community probably makes little or no difference to the outcome of laboratory‐confirmed influenza/SARS‐CoV‐2 compared to not wearing masks (RR 1.01, 95% CI 0.72 to 1.42; 6 trials, 13,919 participants; moderate‐certainty evidence)"
On N95/P2 respirators vs. medical/surgical:
"The use of a N95/P2 respirators compared to medical/surgical masks probably makes little or no difference for the objective and more precise outcome of laboratory‐confirmed influenza infection (RR 1.10, 95% CI 0.90 to 1.34; 5 trials, 8407 participants; moderate‐certainty evidence)."
Thats a revision of a paper with roots back to 2006. I applaud them for having a rich source, but the primary objections can be understood to be in their apologia:
The original Plain Language Summary for this review stated that 'We are uncertain whether wearing masks or N95/P2 respirators helps to slow the spread of respiratory viruses based on the studies we assessed.' This wording was open to misinterpretation, for which we apologize. While scientific evidence is never immune to misinterpretation, we take responsibility for not making the wording clearer from the outset. We are engaging with the review authors with the aim of updating the Plain Language Summary and abstract to make clear that the review looked at whether interventions to promote mask wearing help to slow the spread of respiratory viruses.
The problem was how they communicated. The data is the data.
My opinion (feel free to have another one) is that it points to the need for training and more comfortable masks. The studies weren't WRONG per se, but they are very hard to interpret.
My whacky opinion: human facing sciences (medicine, psychology, diet, sociology, economics, etc.) have a huge problem with solutions that require motivation to succeed. In other words, if you are motivated, you can make masks work. If you are motivated, you can make intermittent fasting work. Same for EVs, Solar Panels, etc.
"Evidence-based medicine (EBM’s) traditional methods, especially randomised controlled trials (RCTs) and meta-analyses, along with risk-of-bias tools and checklists, have contributed significantly to the science of COVID-19. But these methods and tools were designed primarily to answer simple, focused questions in a stable context where yesterday’s research can be mapped more or less unproblematically onto today’s clinical and policy questions. They have significant limitations when extended to complex questions about a novel pathogen causing chaos across multiple sectors in a fast-changing global context. Non-pharmaceutical interventions which combine material artefacts, human behaviour, organisational directives, occupational health and safety, and the built environment are a case in point: EBM’s experimental, intervention-focused, checklist-driven, effect-size-oriented and deductive approach has sometimes confused rather than informed debate. While RCTs are important, exclusion of other study designs and evidence sources has been particularly problematic in a context where rapid decision making is needed in order to save lives and protect health. It is time to bring in a wider range of evidence and a more pluralist approach to defining what counts as ‘high-quality’ evidence. We introduce some conceptual tools and quality frameworks from various fields involving what is known as mechanistic research, including complexity science, engineering and the social sciences. We propose that the tools and frameworks of mechanistic evidence, sometimes known as ‘EBM+’ when combined with traditional EBM, might be used to develop and evaluate the interdisciplinary evidence base needed to take us out of this protracted pandemic. Further articles in this series will apply pluralistic methods to specific research questions."
I don't understand, this paper is describing how EBM works today and calling it EBM+ for some inexplicable reason. This is a long winded rant basically concluding with face validity is important...