REVIEW 4 major objections 6 minor 43 references
More than 1,000 special issues a year are 'Published in Support of Self,' with guest editors authoring over a third of the papers.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · deepseek-v4-flash
2026-08-03 11:02 UTC pith:D7BZXQGM
load-bearing objection A large, openly shared measurement of special-issue endogeny that makes a defensible qualitative case — exact counts rest on unvalidated name-matching, so treat them as estimates. the 4 major comments →
The Issue with Special Issues: when Guest Editors Publish in Support of Self
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central discovery is that endogeny — guest editors publishing non-editorial articles in their own special issues — is endemic in special-issue-centered publishing. About one in seven special-issue papers is endogenous on average, and although the majority of guest editors publish responsibly, around 1,100 special issues per year cross the paper's one-in-three threshold and are labelled PISS. The abuse is concentrated: journals that host many special issues host almost all PISS issues, with a small number of journals accounting for the majority. The paper also finds that endogeny declined after indexers announced stricter policies, suggesting enforcement works.
What carries the argument
The paper's core machinery is a large special-issue dataset (over 100,000 closed special issues, roughly one million papers, 2015–2025) and a name-matching procedure that flags an article as endogenous when a cleaned guest-editor name (given name plus first surname) matches a paper author. On top of this, the paper defines the threshold concept PISS (Published in Support of Self): any special issue where more than 33% of non-editorial articles are authored by at least one guest editor. The threshold is deliberately set above existing publisher limits so the label is conservative.
Load-bearing premise
The entire count of PISS issues rests on the assumption that cleaning names to 'given name + first surname' and matching them to author lists reliably identifies which articles are authored by guest editors; the paper notes errors are most likely false negatives, so if anything the headline numbers could be understated.
What would settle it
A validation study on a random sample of special issues comparing the name-match flags against manually verified guest-editor identities (via ORCID or editorial-board pages) would settle whether the matching undercounts or overcounts. Similarly, checking publisher archives for special-issue tags that were later removed would reveal whether the true PISS count is higher than reported.
If this is right
- If these numbers hold, special-issue-based growth strategies at several large open-access publishers produce a volume of conflict-of-interest papers comparable to the estimated volume of fraudulent or questionable research.
- Indexers and publishers can enforce existing endogeny caps because the required metadata — author lists and guest-editor names — is already available and tracked.
- Journal-level auditing is sufficient: a small number of high-volume special-issue journals host most PISS output, so targeted action at those journals would eliminate the majority of the problem.
- The post-2023 decline in endogeny that the paper links to an indexer's 25% policy change suggests that announced, enforced limits change guest-editor behavior.
Where Pith is reading between the lines
- If the name-matching underestimates endogeny, as the paper concedes, the true PISS count could be higher, placing the problem at the larger end of the paper's own range.
- The same dataset could be extended beyond guest editors to 'network endogeny' — papers by co-authors, frequent collaborators, or former students — which would likely substantially raise the estimated volume of self-serving special-issue publishing.
- The paper documents that some publishers post-hoc remove special-issue tags from under-filled issues; comparing current metadata to archived web pages would quantify how many endogenous articles were reclassified as regular papers, a concrete test of hidden endogeny.
- The one-in-three threshold itself could be empirically calibrated by surveying researchers on which special issues they would judge as misconduct, testing whether the cutoff matches community norms.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper presents a large-scale descriptive study of 'endogeny' in special issues: guest editors publishing non-editorial articles in their own special issues. Using data from over 100,000 special issues published 2015–2025 by MDPI, Frontiers, BMC, Discover, and the Royal Society's Phil Trans, the authors define a special issue as 'Published in Support of Self' (PISS) when more than 33% of its articles are authored by at least one of its guest editors. They report that although most guest editors engage in endogeny moderately or not at all, more than 1,000 PISS special issues are published annually, hosting tens of thousands of endogenous articles, with MDPI and Frontiers accounting for the vast majority. The paper argues that excessive endogeny is a form of scientific misconduct, that current publisher/indexer policies are insufficiently enforced, and that simple metadata-based enforcement would largely solve the problem.
Significance. If the quantitative claims hold, this is the first systematic estimate of a specific and previously under-measured conflict-of-interest mechanism in scholarly publishing, and it provides a transparent, policy-relevant framework and a shared replication package (data and scripts on Figshare, plus a Shiny app). The qualitative pattern — endogeny concentrated in special-issue-heavy journals and publishers — is likely robust to several measurement concerns, and the paper explicitly distinguishes between the definitional threshold and the sensitivity of the results to that threshold. The authors also credit existing policy efforts (e.g., DOAJ's 25% rule) and identify a small number of journals whose remediation would address a large share of the problem. These strengths make the paper valuable to the scientometrics and research-integrity communities despite the methodological caveats noted below.
major comments (4)
- [Methods and Data, 'Data collection' (name-cleaning paragraph)] The central quantitative claims — 126,596 endogenous articles and ~1,100 PISS special issues per year — rest entirely on cleaning names to 'given name + first surname' and text-matching guest editors against author lists. The paper asserts that matching errors 'would most likely be false negatives,' but no validation set, manual audit, or sensitivity analysis is provided. Common names (particularly in large author pools at MDPI and Frontiers) will generate false positives, and name variations or transliteration issues will generate false negatives. The direction and magnitude of the net bias are unknown. A small percentage of false positives in the ~126k flagged endogenous articles could materially change the PISS special-issue count. Please report a validation exercise (e.g., manual inspection of a random sample, comparison with ORCID-linked identities, or a stricter matching rule) and
- [Methods and Data, Table 2 and 'one-in-three rule'; Results, Table 4] The 33% threshold is acknowledged as debatable, and the authors helpfully report endogeny volume distributions across thresholds (Table 4). However, the headline 'more than 1,000 PISS special issues per year' and the comparison to the magnitude of scientific fraud are stated as point values, with no uncertainty intervals and no explicit sensitivity of the annual PISS count to threshold choices (e.g., 25%, 30%, 40%). Since the threshold is a normative and arbitrary demarcation, the main quantitative claims should be presented as a function of the threshold, at least in sensitivity form, so readers can assess how much of the 'endemic' conclusion is driven by the chosen cutoff. A simple bootstrap of the journal-level or article-level estimates would also clarify sampling uncertainty.
- [Methods and Data, 'Data collection' (BMC paragraph)] BMC data were manually curated because the publisher's web architecture prevented scraping, and 1,929 collections were annotated by hand. BMC also shows the highest PISS rate (24%) of all publishers in Table 4. The paper recommends caution in extrapolating BMC trends, but the manual curation step is a potential source of systematic error that is not quantified. In particular, the exclusion rule for post-hoc collections (publication date range > 2 years) could bias BMC endogeny estimates either upward or downward, and the paper notes that BMC sometimes defines collections post-hoc. Please report inter-annotator reliability or a reproducibility check for the BMC dataset, and clarify how sensitive the BMC-specific PISS percentages are to the 2-year window.
- [Discussion, paragraph beginning 'Such publishers often offer the rebuttal...'] The paper documents that publishers sometimes remove the special-issue tag from articles if an issue fails to meet minimum size, which would cause endogeny to be undercounted. This is an important mechanism, but it is only described qualitatively. If the goal is to establish the lower bound of PISS, the paper should attempt to estimate the frequency of such metadata modifications in the sample (e.g., by comparing archived snapshots with current metadata, or by citing the authors' own File S2 examples systematically). Without this, it is unclear whether the 'conservative' framing is correct for all publishers, since the same metadata-retagging practice could also affect the guest-editor-to-issue mapping itself.
minor comments (6)
- [Abstract and Results, 'PISS is concentrated in some journals'] The abstract states 'more than 1,000 hacked SIs are published each year,' while the text uses 'approximately 1,100 PISS special issues are published per year.' Please harmonize the phrasing and provide the precise annual average in the abstract.
- [Results, 'PISS is concentrated in some journals', paragraph 5] The phrase 'collectively host ~38% of the journals in our dataset' is ambiguous: it refers to BMC, Discover, and Phil Trans, but the number should be stated explicitly (e.g., 'collectively cover X of 904 journals'). Please clarify.
- [Discussion, paragraph 6] The comparison to scientific fraud relies on estimates from papers with different journal universes (Web of Science, Scopus). Since the PISS dataset covers only 904 journals, the comparison should be framed explicitly as an upper/lower bound with the relevant caveat that the two quantities are not directly commensurable.
- [Methods and Data, 'Data collection'] 'Name cleaning involved removing titles, hyphens, extra spaces and converting character strings to lower case.' Converting all names to lower case is fine, but the paper should state how diacritics, non-Latin scripts, and multi-part surnames were handled, as these are common in the author populations of MDPI and Frontiers.
- [Table 5] The table header states ranking by 'mean percent of special issues that are PISS,' but the text also mentions absolute counts for the worst offenders. Please add the absolute counts to the table or clarify the ranking criterion in the caption.
- [General] The phrase 'up over 200,000 persons' in the Discussion should be 'over 200,000 persons.' Also, 'Paper mills' footnote i is helpful; please ensure all supplementary files (File S1, S2, Tables S3–S7) are included in the replication package and are discoverable from the DOI.
Circularity Check
No circularity: PISS is a stipulated definition applied to independently collected metadata; self-citations are background, not load-bearing.
full rationale
The central quantity, the number of PISS special issues, is a count produced by applying the paper's explicit definition (endogeny >33%) to guest-editor and author metadata collected from publisher pages and CrossRef. The definition is not fitted to the data; the paper also reports endogeny across thresholds and argues the 33% cut is higher than existing policies (DOAJ 25%, Frontiers 30%), so the headline count is transparent rather than constructed by the definition. The name-cleaning/matching step is a measurement with asserted error direction ('most likely false negatives'); this is an accuracy and validation concern, not circularity, because matching is not defined in terms of the PISS outcome and no parameter is tuned to produce the headline figure. Self-citations (refs 1, 18, 33) support background claims about growth, Discover inclusion, and economic drain; none is invoked to define PISS, set the threshold, or validate the count. There is no fitted-input-called-prediction, no imported uniqueness theorem, and no ansatz justified solely by prior author work. The derivation therefore does not reduce to its inputs by construction.
Axiom & Free-Parameter Ledger
free parameters (4)
- PISS endogeny threshold =
33%
- APC cost assumption =
€2000 per article
- Worst-offender minimum scale =
≥55 special issues
- BMC post-hoc exclusion window =
2 years
axioms (4)
- domain assumption Guest editor names and author lists in publisher metadata and CrossRef accurately identify the same persons after cleaning.
- domain assumption Special-issue article membership is correctly tagged in the scraped/web data; post-hoc delisting is rare.
- ad hoc to paper The one-in-three rule is a sensible demarcation of misconduct.
- domain assumption Endogeny is a valid indicator for conflict-of-interest abuse by guest editors.
invented entities (2)
-
PISS (Published in Support of Self, a.k.a. SI-hacked)
independent evidence
-
Endogeny volume
independent evidence
read the original abstract
The recent exceptional growth in special issues has led to the largest delegation of editorial power in the history of scientific publishing. Has this power been used responsibly? We provide the first systematic analysis of endogeny, the practice of publishing articles in ones own special issue. While moderate levels of endogeny are common, excessive endogeny constitutes scientific misconduct, as it stems from a clear conflict of interest. We define special issues containing more than 33% endogeny as SI-hacked. We build a dataset of over 100,000 special issues published in 2015-2025 by five leading publishers. The large majority of guest editors engage in endogeny responsibly, if at all. Nonetheless, despite endogeny policies by publishers and indexers, SI-hacking is endemic. All journals heavily relying on special issues host SI-hacking; more than 1,000 hacked SIs are published each year, hosting tens of thousands of endogenous articles. Egregious SI-hacking is rare, editors exceeding endogeny thresholds mostly to the extent that publishers allow them to. This is not good news, as it reflects a widespread normalisation of guest editor conflicts of interests. Fortunately, SI-hacking can be solved by enforcing existing common sense policies. We provide data and analyses needed for indexers and regulators to act.
Figures
Reference graph
Works this paper leans on
-
[1]
The strain on scientific publishing
Hanson MA, Barreiro PG, Crosetto P , Brockington D. The strain on scientific publishing. Quant Sci Stud. 2024; 1–29. doi:10.1162/qss_a_00327
-
[2]
Do pressures to publish increase scientists’ bias? An empirical support from US States Data
Fanelli D. Do pressures to publish increase scientists’ bias? An empirical support from US States Data. PloS One. 2010;5: e10271. doi:10.1371/journal.pone.0010271
-
[3]
Modelling science trustworthiness under publish or perish pressure
Grimes DR, Bauch CT, Ioannidis JPA. Modelling science trustworthiness under publish or perish pressure. R Soc Open Sci. 2018;5: 171511. doi:10.1098/rsos.171511
-
[4]
Quan W, Chen B, Shu F. Publish or impoverish: An investigation of the monetary reward system of science in China (1999 -2016). Aslib J Inf Manag. 2017;69: 486 –502. doi:10.1108/AJIM-01-2017- 0014
-
[5]
Overcitation and overrepresentation of review papers in the most cited papers
Miranda R, Garcia -Carpintero E. Overcitation and overrepresentation of review papers in the most cited papers. J Informetr. 2018;12: 1015–1030. doi:10.1016/j.joi.2018.08.006
-
[6]
COPE Guidelines: Guest edited collections
COPE Council. COPE Guidelines: Guest edited collections. 2025. doi:10.24318/Bp64sd1c
-
[7]
The oligopoly’s shift to open access: How the big five academic publishers profit from article processing charges
Butler L-A, Matthias L, Simard M -A, Mongeon P , Haustein S. The oligopoly’s shift to open access: How the big five academic publishers profit from article processing charges. Quant Sci Stud. 2023; 1–
2023
-
[8]
The oligopoly of open access publishing
Shu F, Larivière V . The oligopoly of open access publishing. Scientometrics. 2024;129: 519 –536. doi:10.1007/s11192-023-04876-2
-
[9]
Abalkina A. Publication and collaboration anomalies in academic papers originating from a paper mill: Evidence from a Russia‐based paper mill. Learn Publ. 2023; leap.1574. doi:10.1002/leap.1574
-
[10]
Bishop DVM. Red flags for paper mills need to go beyond the level of individual articles: a case study of Hindawi special issues. PsyArXiv; 2023 Feb. doi:10.31234/osf.io/6mbgv
-
[11]
The entities enabling scientific fraud at scale are large, resilient, and growing rapidly
Richardson RAK, Hong SS, Byrne JA, Stoeger T, Amaral LAN. The entities enabling scientific fraud at scale are large, resilient, and growing rapidly. Proc Natl Acad Sci. 2025;122: e2420092122. doi:10.1073/pnas.2420092122
-
[12]
Estimating the predictability of questionable open-access journals
Zhuang H, Liang L, Acuna DE. Estimating the predictability of questionable open-access journals. Sci Adv. 2025;11: eadt2792. doi:10.1126/sciadv.adt2792 Crosetto et al., 2026. arXiv. Interactive access to our data available at: bit.ly/PISSpaper - 13 -
-
[13]
Governing the commons: the evolution of institutions for collective action
Ostrom E. Governing the commons: the evolution of institutions for collective action. 10th printing. Cambridge: Cambridge University Press; 2019
2019
-
[14]
MDPI Experience Survey Results
Brockington D. MDPI Experience Survey Results. In: Dan Brockington - Research and Writings [Internet]. 18 Apr 2021 [cited 4 Dec 2025]. Available: https://danbrockington.com/2021/04/18/mdpi - experience-survey-results/
2021
-
[15]
We have amended our Special Issues criteria
DOAJ. We have amended our Special Issues criteria. 25 Jan 2024 [cited 19 Oct 2025]. Available: https://blog.doaj.org/2024/01/25/weve-amended-our-special-issues-criteria/
2024
-
[16]
A Large-Scale Analysis of Impact Factor Biased Journal Self-Citations
Chorus C, Waltman L. A Large-Scale Analysis of Impact Factor Biased Journal Self-Citations. Glanzel W, editor. PLOS ONE. 2016;11: e0161021. doi:10.1371/journal.pone.0161021
-
[17]
Wilhite A, Fong EA, Wilhite S. The influence of editorial decisions and the academic network on self- citations and journal impact factors. Res Policy. 2019;48: 1513 –1522. doi:10.1016/j.respol.2019.03.003
-
[18]
Springer Nature Discovers MDPI
Crosetto P, Hanson MA, Brockington D, Gómez Barreiro P. Springer Nature Discovers MDPI. In: The Daily Strain [Internet]. 15 June 2025 [cited 19 Oct 2025]. Available: https://hal.science/hal-05113253
2025
-
[19]
rvest: Easily Harvest (Scrape) Web Pages
Wickham H. rvest: Easily Harvest (Scrape) Web Pages. 2025. Available: https://rvest.tidyverse.org/
2025
-
[20]
MDPIexploreR: Web Scraping and Bibliometric Analysis of MDPI Journals
Gómez Barreiro P. MDPIexploreR: Web Scraping and Bibliometric Analysis of MDPI Journals. 2024. Available: https://github.com/pgomba/MDPI_exploreR
2024
-
[21]
Crossref: The sustainable source of community -owned scholarly metadata
Hendricks G, Tkaczyk D, Lin J, Feeney P. Crossref: The sustainable source of community -owned scholarly metadata. Quant Sci Stud. 2020;1: 414–427. doi:10.1162/qss_a_00022
-
[22]
doi:10.1162/qss_a_00272
-
[23]
Editorial endogamy and endogeny: Challenges on the path to DOAJ
Nazarovets M, Nazarovets S. Editorial endogamy and endogeny: Challenges on the path to DOAJ. In: DOAJ blog [Internet]. 4 Dec 2025 [cited 5 Dec 2025]. Available: https://blog.doaj.org/2025/12/04/editorial-endogamy-and-endogeny-challenges-on-the-path-to-doaj/
2025
-
[24]
Endogeny in measuring research excellence
Sadowski I, Zamęcki Ł. Endogeny in measuring research excellence. In-house publishing and conflict of interests in Polish science evaluation. Res Policy. 2025;54: 105134. doi:10.1016/j.respol.2024.105134
arXiv 2025
-
[25]
Proposals for Special Issues
The Computer Journal. Proposals for Special Issues. 2025 [cited 19 Oct 2025]. Available: https://academic.oup.com/comjnl/pages/special-issues-instructions
2025
-
[26]
Guest editor responsibilities and guidelines for Special Issues
Wiley. Guest editor responsibilities and guidelines for Special Issues. In: Editor Resources [Internet]. 2025 [cited 19 Oct 2025]. Available: https://www.wiley.com/en -in/publish/article/editor- resources/special-issues/guidelines
2025
-
[27]
Topic editor guidelines
Frontiers. Topic editor guidelines. In: Frontiers Host Editor Guidelines [Internet]. 2022 [cited 19 Oct 2025]. Available: https://www.frontiersin.org/Design/pdf/Host_Editor_Guidelines.pdf
2022
-
[28]
Information for Guest Editors
The Royal Society. Information for Guest Editors. 2025 [cited 19 Oct 2025]. Available: https://royalsocietypublishing.org/rsta/guest-editors
2025
-
[29]
Propose a Special Issue
SciencePG. Propose a Special Issue. In: Science Publishing Group [Internet]. 2025 [cited 19 Oct 2025]. Available: https://sciencepublishinggroup.com/journal/636/propose-a-special-issue
2025
-
[30]
Aquarius R, Bik EM, Bimler D, Oksvold MP, Patrick K. Tackling paper mills requires us to prevent future contamination and clean up the past – the case of the journal Bioengineered. Bioengineered. 2025;16: 2542668. doi:10.1080/21655979.2025.2542668
arXiv 2025
-
[31]
The Existence of Stealth Corrections in Scientific Literature —A Threat to Scientific Integrity
Aquarius R, Schoeters F, Wise N, Glynn A, Cabanac G. The Existence of Stealth Corrections in Scientific Literature —A Threat to Scientific Integrity. Learn Publ. 2025;38: e1660. doi:10.1002/leap.1660
-
[32]
Author -paid publication fees corrupt science and should be abandoned
Morgan TJH, Smaldino PE. Author -paid publication fees corrupt science and should be abandoned. Sci Public Policy. 2025;52: 805–809. doi:10.1093/scipol/scaf026
-
[33]
2024 Annual Report
agence national de la recherche. 2024 Annual Report. 2025. Available: https://anr.fr/fileadmin/documents/2025/ANR-Annual-Report-2024.pdf
2024
-
[34]
The Drain of Scientific Publishing
Beigel F, Brockington D, Crosetto P , Derrick G, Fyfe A, Barreiro PG, et al. The Drain of Scientific Publishing. arXiv; 2025. doi:10.48550/ARXIV .2511.04820
-
[35]
Reformation of science publishing: the Stockholm Declaration
Sabel B, Larhammar D. Reformation of science publishing: the Stockholm Declaration. R Soc Open Sci. 2025;12: 251805. doi:10.1098/rsos.251805
-
[36]
Oviedo-García MÁ. Journal citation reports and the definition of a predatory journal: The case of the Multidisciplinary Digital Publishing Institute (MDPI). Res Eval. 2021;30: 405 –419a. doi:10.1093/reseval/rvab020
-
[37]
Finland downgrades MDPI and Frontiers – will others follow suit? TImes Higher Education
Grove J. Finland downgrades MDPI and Frontiers – will others follow suit? TImes Higher Education. 20 Dec 2024. Available: https://www.timeshighereducation.com/news/finland-downgrades-mdpi-and- frontiers-will-others-follow-suit. Accessed 7 Nov 2025. Crosetto et al., 2026. arXiv. Interactive access to our data available at: bit.ly/PISSpaper - 14 -
2024
-
[38]
Sandnes FE. Are there too many papers by the same authors within the same conference proceedings? Norms and extremities within the field of human –computer interaction. Scientometrics. 2025;130: 1659–1699. doi:10.1007/s11192-025-05271-9
-
[39]
Fast -growing open -access journals stripped of coveted impact factors
Brainard J. Fast -growing open -access journals stripped of coveted impact factors. 2023. doi:10.1126/science.adi0098
-
[40]
Now you see it, now you don’t: the strange world of disappearing Special Issues at MDPI
Bishop. Now you see it, now you don’t: the strange world of disappearing Special Issues at MDPI. In: BishopBlog [Internet]. 2024 [cited 19 Oct 2025]. Available: https://deevybee.blogspot.com/2024/09/now-you-see-it-now-you-dont-strange.html
2024
-
[41]
Image sleuth faces legal threats
O’Grady C. Image sleuth faces legal threats. Science. 2021;372: 1021 –1022. doi:10.1126/science.372.6546.1021
arXiv 2021
-
[42]
Errors found in dozens of papers by top scientists at Dana -Farber Cancer Institute. 2024. doi:10.1126/science.z0oibzm
-
[43]
OpenAlex: A fully -open index of scholarly works, authors, venues, institutions, and concepts
Priem J, Piwowar H, Orr R. OpenAlex: A fully -open index of scholarly works, authors, venues, institutions, and concepts. arXiv; 2022. doi:10.48550/ARXIV .2205.01833 Endnotes i Research paper mills coordinate fraudulent article publishing in service to bad-faith authors. ii Strangely, these publishers and others (e.g. Elsevier) have policies in place to p...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.