Cui Prodest? Reciprocity of collaboration measured by Russian Index of Science Citation

Ekaterinburg; Mark Akoev (Ural Federal University; Moscow; Olga Moskaleva (Saint Petersburg State University; Russia); St. Petersburg; Vladimir Pislyakov (National Research University Higher School of Economics

arxiv: 1907.05521 · v1 · pith:HWDJ4XB2new · submitted 2019-07-11 · 💻 cs.DL

Cui Prodest? Reciprocity of collaboration measured by Russian Index of Science Citation

Vladimir Pislyakov (National Research University Higher School of Economics , Moscow , Russia) , Olga Moskaleva (Saint Petersburg State University , St. Petersburg , Mark Akoev (Ural Federal University , Ekaterinburg This is my paper

Pith reviewed 2026-05-24 22:16 UTC · model grok-4.3

classification 💻 cs.DL

keywords scientific collaborationreciprocitybibliometricsRussian Index of Science Citationjournal classificationinstitutional evaluation

0 comments

The pith

Dividing journals in the Russian Index of Science Citation into best and others reveals asymmetric collaboration patterns and their effect on paper quality.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper examines how scientific collaborations are frequently non-reciprocal, with stronger organizations supplying resources or expertise to weaker partners. Standard bibliometric techniques can quantify such imbalances, yet the authors introduce an additional layer by using the Russian Index of Science Citation's separation of journals into top-tier and ordinary sets. This split creates two distinct publication universes that make visible whether collaborative papers appear in higher-quality outlets. The approach is presented as a way to infer the relative scholarly standing of the participating organizations from their joint output rather than from isolated metrics.

Core claim

Separating the best journals from others on the same platform of the Russian Index of Science Citation provides additional methods to study how collaboration influences the quality of papers published by organizations.

What carries the argument

The split of RISC journals into a 'best' group and an 'others' group, treated as two separate journal universes that allow comparison of collaborative publication quality.

If this is right

Collaboration patterns can be measured for reciprocity using existing bibliometric methods such as those described by Glanzel.
Joint publication data can reveal more about an organization's level than evaluations that treat each organization in isolation.
The two journal universes created by the RISC split allow direct observation of whether collaboration raises or lowers the quality tier of resulting papers.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

The same journal-split technique could be tested on other national citation databases that maintain tiered journal lists.
Longitudinal tracking of the same pairs of organizations might show whether repeated collaboration gradually changes the quality tier of their joint papers.
The method might be extended to distinguish domestic from international collaborations within the same dataset.

Load-bearing premise

The RISC division of journals into best versus others functions as a stable and meaningful indicator of scholarly quality.

What would settle it

Finding that the share of collaborative papers from weaker organizations appearing in the best RISC journals shows no systematic difference from their share in ordinary journals.

read the original abstract

Scientific collaboration is often not perfectly reciprocal. Scientifically strong countries/institutions/laboratories may help their less prominent partners with leading scholars, or finance, or other resources. What is interesting in such type of collaboration is that (1) it may be measured by bibliometrics and (2) it may shed more light on the scholarly level of both collaborating organizations themselves. In this sense measuring institutions in collaboration sometimes may tell more than attempts to assess them as stand-alone organizations. Evaluation of collaborative patterns was explained in detail, for example, by Glanzel (2001; 2003). Here we combine these methods with a new one, made available by separating 'the best' journals from 'others' on the same platform of Russian Index of Science Citation (RISC). Such sub-universes of journals from 'different leagues' provide additional methods to study how collaboration influences the quality of papers published by organizations.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Desk Editor's Note private letter to a colleague

The paper suggests splitting RISC journals into 'best' and 'others' to extend Glänzel's collaboration metrics but supplies no data, examples, or checks on the approach.

read the letter

The main point is that the authors want to measure asymmetric collaboration by combining Glänzel's 2001 and 2003 methods with the RISC database's division of journals into top-tier and the rest. They argue this split can reveal more about how partnerships affect the quality level of papers from different organizations than looking at institutions in isolation. That is the only new element: a proposed application to one national index rather than a fresh derivation or large-scale test. The logic is straightforward and fits the existing literature on non-reciprocal ties in science. It could be useful for anyone already working with RISC data who wants another angle on collaboration patterns. The description itself is clear and cites the right prior work without overclaiming. The clear limitation is the complete absence of any results. The text stops at outlining the idea and does not include even a small worked example, a table of numbers, or a comparison showing whether the tier split produces different or better signals than plain Glänzel metrics. There is also no check on whether the RISC 'best' category actually functions as a stable quality proxy; it is simply assumed. If that classification turns out to be noisy or driven by factors other than scholarly level, the added value disappears. This leaves the central claim without demonstrated support. The paper is aimed at bibliometric researchers who already follow national citation indexes and collaboration studies. A reader in that niche might pick up an idea to try on their own data. For anyone else it offers little. I would not bring it to a reading group. I would not cite it. It does not look ready for peer review in its current form because the proposal needs the missing empirical step before it can be evaluated.

Referee Report

2 major / 0 minor

Summary. The manuscript proposes combining Glänzel's (2001, 2003) methods for evaluating collaborative patterns with a new approach based on separating 'the best' journals from 'others' within the Russian Index of Science Citation (RISC) platform. This separation is claimed to create sub-universes that provide additional methods for studying how collaboration influences the quality of papers published by organizations and for inferring the scholarly level of collaborating partners from reciprocity patterns.

Significance. If the RISC classification functions as a stable, independent proxy for scholarly quality, the approach could extend existing bibliometric tools for analyzing asymmetric collaborations, particularly in national contexts like Russian science. The paper does not demonstrate this extension with data or comparisons.

major comments (2)

[Abstract] Abstract: The central claim that separating RISC journals into 'best' versus 'others' supplies additional methods (beyond Glänzel) for studying collaboration's effect on organizational paper quality is presented without any definition of the RISC split criteria, validation against external quality signals (e.g., citation rates or peer review), or a worked example showing metrics that differ from or improve upon prior methods.
[Abstract] Abstract: No empirical data, error analysis, or reproducibility details are supplied to support the assertion that the RISC partition can be used to infer partner levels from collaboration patterns; the soundness assessment is therefore limited to the outline of an intended approach.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the constructive comments on our manuscript. We address each major comment point by point below, indicating revisions where appropriate to clarify the proposed method.

read point-by-point responses

Referee: [Abstract] Abstract: The central claim that separating RISC journals into 'best' versus 'others' supplies additional methods (beyond Glänzel) for studying collaboration's effect on organizational paper quality is presented without any definition of the RISC split criteria, validation against external quality signals (e.g., citation rates or peer review), or a worked example showing metrics that differ from or improve upon prior methods.

Authors: We agree that the abstract is too concise and omits a definition of the RISC split criteria as well as a worked example. In the revised manuscript we will expand the abstract to state that the separation uses RISC's own journal ranking tiers (top quartile versus lower tiers). We will also add a short worked example in the main text illustrating how the resulting sub-universes produce collaboration metrics distinct from those obtained with Glänzel's original formulation. A full external validation against citation rates or peer-review outcomes lies outside the scope of this methodological note but can be noted as a direction for future research. revision: yes
Referee: [Abstract] Abstract: No empirical data, error analysis, or reproducibility details are supplied to support the assertion that the RISC partition can be used to infer partner levels from collaboration patterns; the soundness assessment is therefore limited to the outline of an intended approach.

Authors: The manuscript presents a methodological combination rather than a large-scale empirical study. We accept that the current abstract supplies no data, error analysis, or reproducibility details. In revision we will include an illustrative numerical example using a small RISC-derived dataset to demonstrate how reciprocity patterns change under the journal-tier partition and how these patterns may be interpreted as signals of partner scholarly level. We will also add explicit reproducibility information (exact RISC query parameters and tier thresholds) in a dedicated methods subsection. revision: yes

Circularity Check

0 steps flagged

No circularity: external RISC partition applied to Glänzel methods

full rationale

The manuscript applies Glänzel (2001/2003) collaboration metrics to RISC data and proposes using the platform's pre-existing 'best' vs 'others' journal split as an additional lens. No equations, fitted parameters, or predictions are defined within the paper that later reappear as outputs. The RISC classification is treated as an external input supplied by the database, not derived or validated inside the work. No self-citations are load-bearing for any derivation, and the text contains no self-definitional loops or renamed known results. The central claim is therefore an application of independent external resources rather than a closed derivation chain.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 0 invented entities

The claim depends on the untested assumption that RISC journal tiers reliably indicate quality differences usable for inferring organizational scholarly level; no free parameters or invented entities are introduced in the abstract.

axioms (1)

domain assumption RISC journal separation into 'best' and 'others' accurately reflects differences in scholarly quality.
Invoked to justify the new method for studying collaboration effects on paper quality.

pith-pipeline@v0.9.0 · 5723 in / 1075 out tokens · 18232 ms · 2026-05-24T22:16:12.612449+00:00 · methodology

discussion (0)

Lean theorems connected to this paper

Citations machine-checked in the Pith Canon. Every link opens the source theorem in the public Lean library.

IndisputableMonolith/Cost/FunctionalEquation.lean washburn_uniqueness_aczel unclear

?

unclear
Relation between the paper passage and the cited Recognition theorem.

separating 'the best' journals from 'others' on the same platform of Russian Index of Science Citation (RISC). Such sub-universes of journals from 'different leagues' provide additional methods to study how collaboration influences the quality of papers
IndisputableMonolith/Foundation/RealityFromDistinction.lean reality_from_one_distinction unclear

?

unclear
Relation between the paper passage and the cited Recognition theorem.

Jaccard index is a ratio of the cardinality of the intersection of two sets to the cardinality of the union... collaborative gain... ratio between percentage of papers found in the RISC Core for joint papers

What do these tags mean?

matches: The paper's claim is directly supported by a theorem in the formal canon.
supports: The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
extends: The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
uses: The paper appears to rely on the theorem as machinery.
contradicts: The paper's claim conflicts with a theorem or certificate in the canon.
unclear: Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.