Also, 30,000 fake papers out of 1 million+ does not indict or threaten science as a whole. This entire "science is in crisis from within" narrative is a right-wing myth.

For their analysis, the scientists built a database of more than a million scientific papers. They searched for the papers in online forums where sleuths share duplicated images and tortured phrases, as well as the Retraction Watch Database, maintained by the Center for Scientific Integrity.

The researchers compiled a list of 30,000 papers that have either been retracted or show signs of having come from a paper mill. They discovered connections between the papers that strongly hinted that they were the product of large-scale fraud. Many of these connections linked clusters of editors and authors who often worked together.

I think this quote is both unsustainable and unsupported by the analysis in the piece. First and foremost, it portrays fraud as consuming science rather than merely growing alongside it. Much of the β€œfraud” in the paper is just metric gaming whackamole that doesn’t get read, cited or used.

Replies

  1. I will say that a few high-profile cases (Sylvain Lesne and his retracted Alzheimer’s work, for instance) HAVE had dramatic impacts and likely wasted millions of dollars in efforts built on his fraud (vested interest as happened at my University)

    1
  2. a couple of important caveats though: this is why peer review exists, and why it is critical, and also, its why the bedrock institutions of medical literature (JAMA, NJM, lancet, nature) have to be protected. if they are compromised, then its going to be very hard to do actual medical research

    1
  3. It's bonkers anyone would reach this conclusion. The biggest advances tend to publish in the journals with high rates of desk rejection, so papers like these retracted ones might not make it into review in those. Journals like PLOS One have different purposes.

    0
  4. Really appreciate your work, Michael, but I think this is an overstatement. Entire areas of Alzheimer’s research have been found to be based on fabricated research. I think calling scientific critique of shoddy science a right-wing op pushes the pendulum too far back in the other direction

    2
  5. Let's see...$30,000 is 3% of one million.

    So the top 97% of scientific papers pass this scrutiny.

    Now where do you think the bottom 3% get published?

    This is not a problem for respectable journals or peer reviewed papers or indeed for 97% of all of them no matter where they are published.

    0
  6. It could just be that what’s increasing is just detection of fraudulent papers, and the actual rate of publication of fraudulent papers isn’t changing too much. The authors mention this in their limitations section but deserves more attention www.pnas.org/doi/pdf/10.1...

    Limitations
A limitation of our study is the comprehensiveness of the data we consider. Our analyses rely on the instances of scientific fraud that have been reported. It is likely that many fields and journals are underrepresented in the corpora we consider. Indeed, the consensus among experts is that the vast majority of paper mill products have not been detected (30, 79, 82). Further, some of our case studies focus on particular disciplines, outside of which our findings may not be generalizable.
Additionally, temporal changes in detection effort or in the tention paid to different fields may produce spurious trends.
Indeed, the many unknowns about the global enterprise of scientific fraud leave open the possibility that the scale of systematic fraudulent activity has always been large but that only now has been detected. We comment further on this possibility in SI Appendix.
    0
  7. Seems like the bigger problem here is that people aligned with RFK can set up woo woo scientific journals and woo woo panels that masquerade as science to further their own beliefs and this is exactly what they are doing. They want to build out an alternative infrastructure to produce "science'

    0
  8. To some extent, the right wing opposition to science has always been there. I’ve been reading the new William F. Buckley biography and the Birchers were opposed to fluoridated water all the way back in the 60’s.

    5
  9. Md PhD here and the way bigger threat is the use of AI tools that obscure hallucinations of citations as well as deter actual thoughtful analysis of the source and quality of the underlying studies. It says all answers with the same confidence.

    0
  10. This is a very good paper on the myth.

    P-hacking, failure to replicate and fraud are real problems but don't remotely represent science collapsing in on itself. The existential threat to science comes from conservatives, full stop.

    Empirical data do not support the conclusion of a crisis of public trust in science. They do support the conclusion of a crisis of conservative trust in science: polls show that American attitudes tow...

    From Anti-Government to Anti-Science: Why Conservatives Have Turned Against Science

    Empirical data do not support the conclusion of a crisis of public trust in science. They do support the conclusion of a crisis of conservative trust in science: polls show that American attitudes tow...

    13
  11. this feels in hand with the way that some sectors of the media (hello, daytime TV) credulously report anything published in a journal as the monolithic β€œscience.” right-wingers thrive in the literacy gap.

    0
  12. no human endeavor is immune to human impulses, but the overriding goal of science to β€œbe right about things” makes it the only self-policing institution in society. all the corrupting influences come from outside whereas uncovering sloppiness & fraud is rewarded from within.

    1
  13. @michaelhobbes.bsky.social have you watched Bobby Broccoli’s YouTube videos on science frauds and failures? They’re so great, fantastically produced and insightful! One thing I find reassuring the he shows is that once fraudsters face the scientific community they’re always picked apart and stopped.

    1
  14. It would not shock me if some of these were the β€œresearch papers” some high school kids β€œwrite” to say they were published in a journal for college admissions.

    0
  15. The science in crisis narrative is one more unintended outcome of Rule by Centrists since their neoliberal focus on metrics incentivised counter-productive practise.

    The Centrists’ myth of a meritocracy (allowing rule by billionaires) opened the door to fascism across society, not just in science.

    0
  16. I also have serious questions about retraction watch’s integrity since their coverage of transgender healthcare begins with a guest essay by Alice Dreger and ends with an interview by Michael Bailey.

    0
  17. Yes. Reading through comments, there's conflation of two different things. There's what you might call high-status fraud, especially people going to some effort to invent data. Then there is the paper mill stuff, aimed at gaming metrics but unlikely to ever be taken seriously.

    1
  18. "been retracted" that's not a bad thing? That doesn't ipso facto mean it's a sham? If a paper fails reproducibility but was earnest work that arrived at an erroneous conclusion, then retraction is a good and natural conclusion

    0