Early warnings in tweets: detecting pre-retraction signals and their association with retraction timing through natural language processing and survival analysis

Mahsa Amiri () and Hajar Sotudeh ()
Additional contact information
Mahsa Amiri: Eram Campus, Shiraz University, Department of Knowledge & Information Science, School of Education & Psychology
Hajar Sotudeh: Eram Campus, Shiraz University, Department of Knowledge & Information Science, School of Education & Psychology

Scientometrics, 2025, vol. 130, issue 11, No 21, 6425-6453

Abstract: Abstract This study investigates the early warning signs of scientific paper retractions by analyzing X discourse before formal retraction. Leveraging natural language processing techniques—including sentiment analysis (to assess public emotional reactions) and keyword extraction (to identify topics and Red-Flag terms)—alongside survival analysis (to model time-to-retraction), we examined 1239 retracted papers indexed in PubMed (2019–2022) that received at least one tweet before their official retraction. 13 highly tweeted viral papers were detected and excluded. Co-word analysis of the tweets revealed nine distinct thematic clusters: Computational Methods & Analytical Approaches; Evidence, Journals & Research Practices; Scholarly Communication & Online Discourse; Research Practice & Misconduct Issues; Publication Ethics & Retraction Contexts; Research Issues & Conceptual Problems; Validation & Findings; Causality, Change & Methodological Patterns; and Integrity, Authorship & Reproducibility. These topics, alongside the presence of critical retraction-related terms called Red Flags, highlighted X’s role as an informal yet insightful platform for public scrutiny. The Cox proportional hazards model showed that tweet negativity and Red-Flags are significantly associated with retraction acceleration, with Red-Flags showing particularly strong effects. Tweet length was also positively associated with shorter time-to-retraction, though this effect diminished when Red-Flags were present, indicating that explicit misconduct signals outweigh discursive detail in their relationship to retraction timing. By contrast, the open-access status and journal impact factor did not exhibit significant effects once time-dependent dynamics and social media signals were taken into account. Moreover, more recent critical discussions on social media were associated with an acceleration of the retraction process, whereas isolated early tweets did not trigger prompt action. These relationships may reflect broader scrutiny patterns rather than direct causation, as multiple factors likely contribute to retraction decisions. These findings contribute to understanding how social media activity coincides with scientific self-correction processes, highlighting how digital discourse may serve as one of several indicators in research integrity monitoring. The study underscores the need for further research to examine the complex interplay between online discourse and editorial decision-making.

Keywords: X; Twitter; Scientific misconduct; Topic modeling; Survival analysis; Cox regression; Misinformation (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11192-025-05477-x Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:scient:v:130:y:2025:i:11:d:10.1007_s11192-025-05477-x

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11192

DOI: 10.1007/s11192-025-05477-x

Access Statistics for this article

Scientometrics is currently edited by Wolfgang Glänzel

More articles in Scientometrics from Springer, Akadémiai Kiadó
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().