REVIEW 3 major objections 5 minor 6 references
Does Open Access Foster Interdisciplinary Citation? Decomposing Open Access Citation Advantage
T0 review · 3 major / 5 minor · reviewed 2026-08-12 · deepseek-v4-flash
Pith's one-line read Gold open access raises cross-field citations in 13 of 18 sciences.
desk verdict Useful descriptive decomposition of the OA citation advantage, but the causal framing outruns the unadjusted, megajournal-driven evidence. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing instrument is the decomposition of the OACA into $IOACA$ and $WOACA$, applied to all gold-OA and non-OA articles and reviews published in 2017 in 18 natural-science fields, with citations counted over a six-year window and papers stratified by journal impact factor quartile. The decomposition turns a total citation count into a directional measure of cross-field flow: a positive $IOACA$ with a negative or nil $WOACA$ identifies fields where OA's effect is specifically interdisciplinary. The journal-quartile stratification and citation window are the controls used to dampen the two classic confounds of OA-citation studies, early online availability and selection of high-quality papers into OA.
What would settle it
The claim would be overturned if the interdisciplinary citation advantage vanished in a comparison that matched gold-OA and non-OA papers on author record, funding, preprint availability, and journal, or in a natural experiment where a journal's move to gold OA changed access while authors and submission pools stayed fixed.
Extended reading notes
Core claim
The paper's central claim is that gold OA increases the number of citations a paper receives from other fields in 13 of 18 natural-science fields, and that in chemistry, computer science, and clinical medicine this interdisciplinary advantage exists while the within-discipline advantage does not. The authors reach this by decomposing the open access citation advantage (OACA), the percentage by which average citations of gold-OA papers exceed those of comparable non-OA papers, into two parts: the interdisciplinary OACA ($IOACA$), based only on citations from papers outside the field, and the within-discipline OACA ($WOACA$), based only on citations from the same field. They interpret positive $IOACA$ values as evidence that OA fosters knowledge transfer to other fields.
Load-bearing premise
The argument assumes that, after comparing gold-OA with non-OA papers within the same journal-impact-factor quartile, the remaining difference in citations is caused by open access rather than by unmeasured differences such as paper quality, author prestige, funding, or institutional reputation.
Editorial extensions
If this is right
- In 13 of 18 natural-science fields, gold OA papers receive more interdisciplinary citations than non-OA papers, so OA can serve as a channel for cross-disciplinary knowledge transfer.
- In chemistry, computer science, and clinical medicine, gold OA shows an interdisciplinary citation advantage without a within-discipline advantage, meaning cross-field readers are the ones gained.
- In agricultural science, engineering, environment/ecology, and materials science, gold OA shows no advantage of either type, so the knowledge-transfer effect is not universal.
- In clinical medicine, the effect is not explained by a few journals or by OA papers covering different topics; OA and non-OA papers have similar citation topics, and OA papers are cited more from nearby fields, pointing to accessibility as the driver.
- At the field level, some advantages are journal-driven: chemistry's Q2 gold journals and computer science's Q1 gold journals account for most of their fields' interdisciplinary citations.
Reading between the lines
- If the association is causal, gold OA is one of the few concrete policy levers available to increase the flow of findings into neighboring disciplines, alongside other levers such as data sharing or plain-language summaries.
- The same decomposition applied to green OA would clarify whether the cross-field effect comes from accessibility itself or from the publication venue, since green OA separates free availability from journal choice.
- For fields with no interdisciplinary advantage, the result suggests that access alone may not change citation flows; field-specific indexing and disciplinary reading habits may dominate.
- A sharper test would compare the same journal before and after flipping to gold OA, or compare papers subject to funder OA mandates, to see whether the interdisciplinary share of citations rises when access changes.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a decomposition of the open access citation advantage (OACA) into an interdisciplinary component (IOACA) and a within-discipline component (WOACA), and applies this decomposition to Web of Science data for 2017 gold-OA and non-OA articles in 18 natural science fields with a six-year citation window. The authors report that in 13 fields both IOACA and WOACA are positive, while in chemistry, computer science, and clinical medicine only IOACA is positive. They then present a case study of clinical medicine using citation-topic cosine similarities to argue that gold OA increases interdisciplinary citations by improving accessibility rather than by publishing topically different papers.
Significance. If the causal interpretation were supported, the paper would make a valuable contribution to the OA citation advantage literature and to policy discussions about knowledge transfer across disciplines. The decomposition is a useful descriptive tool, the dataset is large and well described, and the field-level comparisons are transparent. The authors also deserve credit for explicitly investigating the role of specific journals and for presenting robustness checks by year and by JIF quartile. However, the central claim that 'OA increases interdisciplinary citations' is not supported by the evidence as presented, because the measure is an unadjusted aggregate comparison and the paper's own journal-level analyses show that several field-level results are driven by a small number of multidisciplinary megajournals. The clinical medicine case study is more plausible but still observational.
major comments (3)
- [Methods, 'JIF quartile'; Results, 'OACAs by field'] The central causal claim that gold OA increases citations, including interdisciplinary citations, rests on the IOACA, which is an unadjusted ratio of field-level means. The JIF-quartile stratification is described in the Methods and shown descriptively in Fig. 4, but it is not used to produce controlled estimates; no within-quartile averages, regression adjustment, or matching is performed. The authors themselves state in the Results that the raw OACAs 'may have been influenced by the proportion of gold OA journals in higher JIF quartiles within a field.' Because gold OA status is assigned at the journal level, the OA/non-OA contrast reflects differences between journal portfolios and subfields, not just the effect of open access on otherwise comparable papers. The abstract and conclusion use causal language ('OA increases'), which is not justified by the design. I recommend either reframing the findings as descriptive associations or adding an adjusted analysis, such as computing IOACA within JIF quartiles and pooling, or a regression with JIF quartile and field fixed effects.
- [Results, 'Distribution of interdisciplinary citations by journal'; Tables 2 and 3] The paper's own journal-level tables show that the field-level IOACA for chemistry and computer science is driven by a very small set of multidisciplinary gold-OA journals. In chemistry, three Q2 journals (International Journal of Molecular Sciences, Sensors, Molecules) account for 82% of Q2 gold-OA interdisciplinary citations; in computer science, two journals account for 92% of Q1 gold-OA interdisciplinary citations. The authors acknowledge this, but they still present the field-level IOACA as evidence that OA fosters interdisciplinary citation in these fields. This is a load-bearing issue: the headline claim that OA increases interdisciplinary citations in chemistry and computer science cannot be distinguished from the claim that a few megajournals with broad scope attract interdisciplinary citations. I suggest a robustness analysis that recomputes the field-level IOACA excluding these journals, or at least a quantitative concentration measure, and a correspondingly cautious interpretation if the results disappear.
- [Results, 'Case study of clinical medicine'; Table 4] The clinical medicine case study is the strongest part of the paper because the high IOACA appears across JIF quartiles rather than being concentrated in a few journals. However, the interpretation that 'OA has improved these papers' accessibility' (and therefore caused more interdisciplinary citations) is a causal claim that is not identified from the data. The cosine similarity between OA and non-OA citation-topic distributions shows that the topics of the two groups are similar, but it does not rule out unmeasured confounders such as author prestige, institutional reputation, funding, or the authors' deliberate choice of a broader-audience journal. The comparison remains observational. I recommend softening the causal language and explicitly discussing residual confounding, or, ideally, supplementing the analysis with a quasi-experimental approach such as a natural experiment involving journal flips to OA or a within-journal comparison over time.
minor comments (5)
- [Throughout] The paper would benefit from uncertainty quantification. Although the dataset is the total population of eligible WoS papers, the interpretation of differences between fields and between groups would be stronger with confidence intervals, bootstrapped standard errors, or at least a significance test. The current presentation of every difference as meaningful makes it hard to know which findings are stable.
- [Methods, 'OA type'] The text says DOAJ data were used to 'identify cited papers definitively categorized as gold OA in 2017.' A DOAJ listing is not necessarily definitive for the publication year 2017, because journals can enter the directory later. Clarify how the temporal match was performed (e.g., whether the DOAJ record used reflects the journal's status in 2017 or at the time of data access).
- [Results, 'Distribution of interdisciplinary citations by journal'; Tables 2 and 3] The titles of Tables 2 and 3 suggest that the listed journals represent the entire distribution, and the 'Total' row sums to 100%, but the text implies these are only the top journals. Please state explicitly whether these tables cover all Q2 gold-OA chemistry journals and all Q1 gold-OA computer science journals, or only a selected subset, and clarify what the total represents.
- [Results, 'Case study of clinical medicine'; Table 4] In the text near Table 4, the phrase 'oa_same and no_same' appears to be a typo for 'oa_same and non_same.' Please correct.
- [Discussion and Conclusion] In several places the paper uses causal phrasing such as 'OA has been shown to foster knowledge transfer' and 'OA effectively enhances interdisciplinary citations.' Given the observational design and the issues raised in the major comments, these statements should be replaced with associational formulations unless additional analyses are added.
Circularity Check
No circularity: the IOACA/WOACA metrics are direct descriptive ratios of observed citation counts, with no fitted parameters, no self-citation chain, and no derivation that reduces to its inputs.
full rationale
After checking the paper's equations (OACA, IOACA, WOACA in the Methods section), all three metrics are computed directly from observed average citation counts of OA versus non-OA papers, split by whether the citing paper is in the same field or a different field. There is no fitted parameter, latent variable, or auxiliary model that is later renamed as an outcome. The field-level results (Figs. 1-4 and Tables 2-3) are descriptive aggregations of these observed counts, and the clinical medicine topic-similarity case study is a direct cosine-similarity comparison of citation-topic distributions, not an output derived from the metrics themselves. No load-bearing argument relies on prior work by the same authors; the reference list contains no self-citations. The JIF-quartile stratification is borrowed from external prior work (Niyazov et al., 2016) and is used descriptively. The main threat to the causal claim that 'OA increases interdisciplinary citations' is unmeasured confounding at the journal or paper level, which the authors partly acknowledge when they state that the OACAs for each field 'may have been influenced by the proportion of gold OA journals in higher JIF quartiles within a field' and when Tables 2-3 show megajournal concentration in chemistry and computer science. That is an inference-validity problem about confounding, not a circularity: the arithmetic is transparent, and interpreting the association causally does not make the metric equal to its inputs. Therefore no circular step can be exhibited, and the appropriate score is 0.
Assumptions & free parameters
assumptions (4)
- domain assumption Citation counts in WoS are an accurate measure of scholarly impact.
- domain assumption Journal-level ESI field assignment accurately represents the content and interdisciplinarity of individual papers.
- ad hoc to paper Stratifying by JIF quartile adequately controls for the selection bias postulate.
- domain assumption DOAJ matching correctly identifies gold OA status in 2017.
Cite this review
Pith. "Pith review of Does Open Access Foster Interdisciplinary Citation? Decomposing Open Access Citation Advantage." pith.science (2026). https://pith.science/paper/46TQ3B3W
@misc{pith2026241114653,
author = {Pith},
title = {Pith review of: Does Open Access Foster Interdisciplinary Citation? Decomposing Open Access Citation Advantage},
year = {2026},
howpublished = {\url{https://pith.science/paper/46TQ3B3W}},
note = {Machine review of arXiv:2411.14653}
}
read the original abstract
The existence of an open access (OA) citation advantage, that is, whether OA increases citations, has been a topic of interest for many years. Although numerous previous studies have focused on whether OA increases citations, expectations for OA go beyond that. One such expectation is the promotion of knowledge transfer across various fields. This study aimed to clarify whether OA, especially gold OA, increases interdisciplinary citations in various natural science fields. Specifically, we measured the effect of OA on interdisciplinary and within-discipline citation counts by decomposing an existing metric of the OA citation advantage. The results revealed that OA increases both interdisciplinary and within-discipline citations in many fields and increases only interdisciplinary citations in chemistry, computer science, and clinical medicine. Among these fields, clinical medicine tends to obtain more interdisciplinary citations without being influenced by specific journals or papers. The findings indicate that OA fosters knowledge transfer to different fields, which extends our understanding of its effects.
Reference graph
Works this paper leans on
-
[1]
1 Does Open Access Foster Interdisciplinary Citation? Decomposing Open Access Citation Advantage Kai Nishikawa1, 2 knishikawa@slis.tsukuba.ac.jp 0000-0001-5949-3610 Akiyoshi Murakami2 1 Institute of Library, Information and Media Science, University of Tsukuba, 1-2, Kasuga, Tsukuba, 305-8550, Ibaraki, Japan. 2 National Institute of Science and Technology ...
work page 2001
-
[4]
Biochemistry & Molecular Biology
from the JCR and assigned them to the cited papers by matching the journal titles. Metrics We used the proportion of the difference between the average citations of OA and non-OA papers relative to the latter as a metric of the OA citation advantage, following an approach used in cross-disciplinary studies on the OA citation advantage (Sotudeh et al., 201...
work page 2017
-
[5]
was as high as 0.93. This indicates that clinical medicine papers cited from close fields tended to have similar topics regardless of OA status. Furthermore, as shown in Table 4, the cosine similarity between OA and non-OA papers tended to be high when the citing paper field was consistent between the two (e.g., oa_same and no_same) and not only between o...
work page 2015
-
[337]
https://doi.org/10.1136/bmj.a568 Dorta-González, P., González-Betancor, S. M., & Dorta-González, M. I. (2017). Reconsidering the gold open access citation advantage postulate in a multidisciplinary context: an analysis of the subject categories in the Web of Science database 2009–2014. Scientometrics, 112(2), 877–901. https://doi.org/10.1007/s11192-017-24...
-
[2017]
Therefore, the OA type of the cited papers in this study was gold OA, excluding hybrid OA
Specifically, we matched cited papers with DOAJ data using 6 the journal name, ISSN, and e-ISSN as keys and identified papers published in journals whose publication year was listed as 2016 or earlier in the DOAJ. Therefore, the OA type of the cited papers in this study was gold OA, excluding hybrid OA. Contrastingly, non-OA papers were not classified und...
work page 2016
-
[2019]
Rather than simply examining whether making a paper OA increases the number of citations, those scholars investigated the effect of OA on the diversity of fields, regions, and institutions among the citing parties. Their findings revealed a strong correlation between OA status and an increased diversity of attributes among citing papers. Similarly, Young ...
work page 2020
Reviewed August 12, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.