HelioIndex: A Directory of Active Researchers in Solar and Heliospheric Physics

Peter R. Young

REVIEW 3 major objections 3 minor 3 references

HelioIndex: A Directory of Active Researchers in Solar and Heliospheric Physics

T0 review · 3 major / 3 minor · reviewed 2026-08-07 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read An ORCID-based, software-maintained directory counts 1,910 active solar and heliospheric researchers across 55 countries.

desk verdict A real, honestly built community directory whose 'comprehensive' claim rests on a thin one-institute validation; worth a full peer review, not a desk reject. read the letter →

arxiv 2506.00159 v1 pith:B6DXT6NP submitted 2025-05-30 astro-ph.SR astro-ph.IM

Peter R. Young This is my paper

classification astro-ph.SRastro-ph.IM

keywords solarphysicsheliosphericORCIDidentifiersresearcherdirectorybibliometricsscientificpublishingworkforcedemographicscareerage

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

HelioIndex is a directory of researchers currently active in solar and heliospheric physics, assembled automatically from open researcher identifiers and bibliographic metadata rather than by hand. The paper's claim is that this software pipeline produces a reliable, regularly updated census of the field: as of January 2025 it lists 1,910 active researchers in 55 countries, with the United States, China, and the United Kingdom contributing 29%, 15%, and 8% of the total. The directory also carries each researcher's publication list, first-author paper counts, citations, institute, country, and subfield, so it can answer questions such as where the field's scientists work and which journals they publish in. If the claim holds, the community gains a reproducible, self-maintaining demographic baseline that committees and funding agencies can track over time.

What carries the argument

The load-bearing object is the ORCID identifier: a unique persistent author key that lets software merge an author's publication trail across name changes and name collisions. The pipeline combines ORCID records with bibliographic-database metadata, then applies two filters: publication-data criteria (recent activity, career age, at least one first-authored refereed paper, and a points threshold for publications) and a keyword filter that computes the fraction of an author's journal keywords containing 'Sun', 'solar', or 'interplanetary', keeping authors above 0.15. Authors are then assigned to solar, heliospheric, or both fields by a separate keyword balance, and affiliations and countries are extracted by string matching from their latest article. This machinery does the work of turning raw identifiers into a census.

What would settle it

Take the complete employment roster of a large solar physics research center and compare every researcher's verified first-author refereed publications against HelioIndex; if the missing-author fraction clearly exceeds the paper's 21% estimate or the missing-paper fraction exceeds 27%, the completeness claim would need to be revised downward.

Watch

Extended reading notes

Core claim

The central discovery is that open researcher identifiers plus bibliographic metadata can be turned into a field-wide directory with minimal human intervention, provided the selection is filtered by publication criteria and journal keywords. The pipeline starts from four search streams—papers citing review articles, recent papers in the core journal of the field, and abstracts mentioning major missions or field-specific keywords—then filters candidates by requiring a recent refereed paper, a career age of at least two years, at least one first-authored refereed paper, and a minimum publication point score. A keyword-based solar fraction is then used to decide who is a solar or heliospheric physicist. The resulting January 2025 snapshot contains 1,910 authors from 55 countries, with 56.7% assigned to solar physics, 27.4% to heliospheric physics, and 15.9% to both; the average author publishes 0.69 first-authored refereed papers per year and the median paper receives 15 citations. The author also states that the directory deliberately excludes PhD students and support staff, and that a check against one large institute suggests at most 21% of researchers and up to 27% of first-author papers may still be missing because of incomplete identifier records.

Load-bearing premise

The directory is only as complete as researchers' ORCID records: if active solar and heliospheric scientists do not have ORCID identifiers or have not attached all their publications to them, they will be missed or undercounted.

Editorial extensions

If this is right

Bimonthly updates mean demographic trends—numbers per country, career-age distribution, and journal choices—can be tracked from now on.
The US estimate of 558 active researchers is consistent with survey- and proposal-based figures, giving an independent check on earlier demographic estimates.
Because the directory deliberately excludes PhD students and support staff, future comparisons with community surveys can separate research-active, PhD-holding authors from the broader workforce.
Lower counts of Earth-science journals than a previous study suggest that earlier keyword-based counts included magnetospheric and ionospheric papers outside the field's scope.
As ORCID take-up increases, the directory should become more complete, while headline fractions such as country shares and the solar/heliospheric split are expected to remain stable.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

The same query-and-filter pipeline could be rerun for any well-defined subfield, giving comparable directories for neighboring disciplines such as stellar physics or planetary science.
Because ORCID adoption varies by country, the country-level percentages are probably not equally accurate everywhere; a country with low identifier uptake would be undercounted relative to the United States and Europe.
If an author completes their ORCID record after a snapshot was generated, HelioIndex can regenerate that past date with the fuller data, making the archive a living historical record rather than a frozen one.

Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

Quick take: this is a real, useful artifact with an honest methods section, but the completeness claims are resting on a thin validation sample. Worth a proper referee, not a desk reject.

The genuinely new thing is HelioIndex itself: an automated, bimonthly-updated directory of solar and heliospheric physicists built from ORCID and ADS, with publication lists, country/institute assignments, subfield labels, journal stats, and citation data. The paper fills a gap the Decadal Survey flagged—no regular, systematic demographic data collection in the field. The construction is described in detail: queries, filtering rules, career-age definition, keyword thresholds. The author also does real external comparisons (SPD membership, Schrijver 2016, NASA proposal counts) and, unusually, quantifies the incompleteness of his own directory. That honesty is to his credit.

The soft spot is exactly where the stress-test note lands. The completeness estimate comes from 34 civil servants at one institute—NASA GSFC—with a median career age of 20, more than double the directory's median of 9.7. One senior author accounts for 27% of the FAR paper missing-count. That's a tiny, non-random sample. It cannot support the claim in Section 9 that the headline statistics are 'unlikely to change significantly.' The 21% missing-researcher rate and the country percentages could well be biased by differential ORCID adoption across countries and career stages, which the author himself acknowledges in Section 6.3. The keyword cutoffs (0.15, and the f_sh boundaries) are chosen from the distribution plus personal judgment; reasonable, but not independently validated. Also, no code is provided, just the data snapshot on Zenodo, which limits independent replication of the pipeline.

None of this is disqualifying. The weaknesses are disclosed, the directory is real, and the limitations are addressable. A serious referee should ask for a second, independent completeness check (e.g., an institute with different ORCID adoption, or an ADS author-disambiguation roster), and for bootstrapped confidence intervals or at least sensitivity analyses on the thresholds. The paper should be accepted after those revisions. Who is it for: program managers, review committees, and anyone studying the SHP community. It deserves a peer review and likely a publication.

Referee Report

3 major / 3 minor

Summary. This paper describes HelioIndex, an automated ORCID- and ADS-based directory intended to census active solar and heliospheric physics researchers. The author details four ADS query families used to seed a masterlist, a two-stage filter based on publication activity and journal keywords, and the resulting public tables with country, institute, journal, career-age, and citation statistics for the 22 January 2025 release (1,910 authors from 55 countries). A completeness check based on 34 NASA GSFC civil servants and comparisons with the 2024 National Academies survey, AAS/SPD membership, and the Schrijver (2016) publication statistics are also presented. The paper carefully documents many filtering decisions and explicitly acknowledges several data limitations, including dependence on ORCID uptake and incomplete publication records.

Significance. If the directory performs as claimed, HelioIndex would be a valuable community infrastructure: a reproducible, bimonthly updated snapshot of the SHP workforce that complements episodic surveys. It ships an archived Zenodo data release, a public website, and cross-checks against external demographic data, which makes the work more than a one-off tabulation. The main caveats are that completeness depends on ORCID adoption and that the validation sample is small and non-random; these caveats affect the strength of the headline demographic claims, but they do not eliminate the practical value of the dataset itself.

major comments (3)

[Section 7 and Section 9/Abstract] The completeness estimate is internally inconsistent. For the 27 GSFC civil servants who are in HelioIndex, the paper reports 528 first-author refereed papers found via ADS but only 300 found by HelioIndex, i.e., about 43% missing; the 27% figure quoted in the abstract and repeated in Section 9 is obtained only after excluding one senior author. As written, the abstract's 'up to 27%' understates the direct estimate, and Section 7's statement that 'the estimate of 27% missing F AR papers is likely an upper limit' needs justification: one should either report the 43% full-sample figure as the direct upper bound, or explain more rigorously why excluding that author is appropriate for the overall completeness claim.
[Section 5.2 and Section 6.1] The keyword-fraction cutoff of 0.15 and the solar/heliospheric field boundaries f_sh = 0.20 and 0.50 are chosen from the shape of the observed distributions and from the author's personal knowledge, with no sensitivity analysis. Because these thresholds determine both the 1,910-member roster and the 56.7/27.4/15.9% S/H/SH split, the paper should show how the roster and field percentages change under plausible threshold variations (for example, keyword fraction 0.10 and 0.20, or f_sh boundaries 0.15 and 0.35), or explicitly state that these quantities are threshold-dependent rather than robust measures.
[Section 8, Table 3, and Section 9] The demographic representativeness of HelioIndex is not sufficiently established to support the claim in Section 9 that the country percentages and other statistics are 'unlikely to change significantly.' The only validation sample is a single US institute with 34 civil servants, and Section 6.3 itself notes that ORCID uptake may vary by country. With roughly 21% of that small sample missing from the directory, the US/China/UK shares and related statistics in Table 3 should be presented with an explicit caveat about possible differential completeness, and ideally supplemented by an independent roster test such as matching against national society membership from a second country or against a conference program.

minor comments (3)

[Section 5, paragraph after the filter list] The sentence 'The publication data and keyword criteria result in 2007 and 3105 of the masterlist authors from making it to the HelioIndex author list' is grammatically unclear; please state explicitly which number corresponds to the publication-data filter and which to the keyword filter.
[Section 6.2 and Figure 3] The caption of Figure 3 would be clearer if it stated that the vertical career-stage boundaries are derived from the estimated PhD date defined as career age plus two years, since the text introduces that convention before the figure is discussed.
[Section 2 and Section 6] The term 'bimonthly' is ambiguous: Section 2 says updates occur on a bimonthly cadence, while Section 6 says filtering is performed on the 8th and 22nd of each month. Please clarify whether releases are twice per month or every two months, and align the wording in the abstract and body.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: HelioIndex is a data-collection and infrastructure paper whose claims are validated against external samples, not derived from its own outputs.

full rationale

HelioIndex is not a derivation paper; it presents a software pipeline that assembles a directory from ORCID and ADS metadata. The central claims (1,910 authors, country percentages, journal statistics) are outputs of an automated filter, not predictions derived from fitted parameters that are then used to generate the same outputs. The selection thresholds (e.g., the 0.15 solar-keyword fraction, the f_sh boundaries of 0.20/0.50, the three-year activity window, and the six-point publication criterion) are stated as author-chosen definitions and are applied once; they are not fit to the final statistics and then re-presented as discoveries. The Section 7 completeness check uses the author's own institute and personal knowledge of 34 GSFC civil servants; while this is self-referential in the sense that the author is a member of the community being measured, it is an external validation sample with its own independent enumeration, not an input to the HelioIndex construction. The disclosed limitations (21% missing researchers, up to 27% missing first-author refereed papers, possible country-dependent ORCID uptake) weaken the strength of the completeness claims but do not create circularity. Comparisons against SPD membership, National Academies estimates, and Schrijver (2016) provide independent benchmarks. No equation, parameter, or cited result in the paper reduces by construction to another part of the paper's input, so the appropriate score is 0.

Assumptions & free parameters 5 free parameters · 5 assumptions · 0 invented entities

HelioIndex introduces no new physical entities; the free parameters are the thresholds and criteria defining membership and field assignment, all disclosed in the text. The axioms reflect the data-source and metadata assumptions the pipeline depends on, with the most important being ORCID coverage and representativeness, which the paper itself partially validates and partially flags as a limitation.

free parameters (5)

SHP keyword fraction cutoff = 0.15
Threshold for classifying an author as SHP based on the fraction of Sun/solar/interplanetary keywords; chosen from the shape of the distribution in Figure 1 and manual inspection of authors with fractions 0.11-0.15 (Section 5.2).
f_sh solar/heliospheric boundaries = 0.20 and 0.50
An author is assigned to solar physics if f_sh <= 0.20 and to heliospheric physics if f_sh >= 0.50; the boundaries were 'selected by the author based on his knowledge of scientists' expertise and their keyword data' (Section 6.1).
PhD date offset = career age + 2 years
The estimated PhD award date is set to career age plus two years, based on the mean difference between thesis publication date and first first-authored refereed article for 174 authors with linked theses (Section 6.2).
Activity window = 3 years since most recent refereed paper
Criteria defining 'currently active'; chosen to allow short career breaks such as parenting or sickness while keeping the directory current (Section 5.1).
Minimum career age and points = career age >= 2 years; >= 6 points (2 per first-authored refereed paper, 1 per co-authored paper)
Criteria chosen to approximately exclude PhD students and support scientists while requiring original first-authored research (Section 5.1).

assumptions (5)

domain assumption ORCID and ADS provide accurate author-article linkage and publication metadata
The entire pipeline is based on ORCID iDs and ADS records; Section 7 acknowledges incomplete ORCID coverage, and Section 6.3 notes ORCID usage may vary by country, so this assumption is partially violated but explicitly bounded.
domain assumption ADS flags for refereed status and document type are reliable
Section 5.1 uses the ADS 'property' field to identify refereed articles and 'doctype' to filter document types; Section 4 notes that SHINE meeting abstracts are incorrectly flagged as 'inproceedings' and must be removed manually, indicating the flags are not perfect.
domain assumption The first affiliation in the author's most recent article represents the current institute and country
Section 6.3 uses only the first affiliation from the most recent article, which may misattribute authors who move institutions or list secondary affiliations first.
ad hoc to paper The keyword fraction and the selected S/H keyword lists correctly separate solar and heliospheric physics from related fields
The lists and thresholds in Sections 5.2 and 6.1 are authored by the paper's author based on personal knowledge and inspection of the data, not derived from an external standard, so the classification is purpose-built for this paper.
domain assumption The NASA GSFC civil servant sample is representative of the broader SHP community for completeness estimates
Section 7 uses 34 GSFC civil servants to estimate global missing-author (21%) and missing-paper (27%) rates; the paper acknowledges this is a single institute and that the true missing-paper rate is likely lower, but the extrapolation is still an assumption.

how reviews work

0 comments

Cite this review

Pith. "Pith review of HelioIndex: A Directory of Active Researchers in Solar and Heliospheric Physics." pith.science (2026). https://pith.science/paper/B6DXT6NP

@misc{pith2026250600159,
  author       = {Pith},
  title        = {Pith review of: HelioIndex: A Directory of Active Researchers in Solar and Heliospheric Physics},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/B6DXT6NP}},
  note         = {Machine review of arXiv:2506.00159}
}

read the original abstract

HelioIndex is a directory of authors who are active in solar and heliospheric physics (SHP). It is available at the webpage HelioIndex.org, and it includes several derived products such as publication lists, country and institute data, journal data, and lists of the most cited articles in the field. HelioIndex is built from ORCID identifiers and publication data obtained from the Astrophysics Data System and ORCID. Selection criteria have been chosen to approximately correspond to a researcher having completed a PhD and published original research in a refereed journal. HelioIndex is intended to be a comprehensive directory of SHP authors that is generated and maintained through software procedures, with minimal human intervention. At the time of writing, 1910 SHP researchers are listed in HelioIndex and they belong to 55 countries. The countries with the largest numbers of researchers are the US, China and the UK, with 29%, 15%, and 8% of the total, respectively. HelioIndex authors average 0.69 first author papers per year over their careers, and the median citations for a paper is 15. Based on journal keyword data, it is estimated that 57% and 28% of HelioIndex authors belong to solar physics and heliospheric physics, respectively, with the remainder overlapping both disciplines.

Figures

Figures reproduced from arXiv: 2506.00159 by the authors.

**Figure 1.** A plot of the solar keyword fractions for the 6986 authors in the masterlist. The plot is truncated in the y-direction, with the peak occurring at 2402 authors for a fraction of zero. The red line shows the cutoff value of 0.15 used to identify SHP authors. are returned as they may reference articles in LRSP, for example. These authors are filtered out through journal keywords assigned to the authors’ articles. Most… view at source ↗

**Figure 2.** A plot showing the distribution of the solar/heliospheric keyword fraction (fsh) for the 1910 authors in the HelioIndex author list. The plot is truncated in the y-direction, with a peak of 432 for a fraction of zero. The red lines shows the boundaries that separate S, SH and H authors. since each of these is unique in the database: an author’s co-authored papers are likely FAR papers of other HelioIndex authors. St… view at source ↗

**Figure 3.** Panel (a) shows the distribution of the FAR papers per year of the HelioIndex authors. Panel (b) shows the distribution of career ages, with the red vertical lines marking the boundaries between early-career, mid-career and senior researchers. Panel (c) shows the distribution of age-corrected h-indices for the authors, with the mean value indicated. SOLA: ms.tex; 24 September 2025; 4:14; p. 17 [PITH_FULL_IMAGE:figu… view at source ↗

Figures from the paper (1 more)

**Figure 4.** Figure 4: The percentages of articles written by HelioIndex authors and published in three journals as a function of time for the past ten years. The journals are The Astrophysical Journal (ApJ; blue), Astronomy and Astrophysics (AA; orange) and Solar Physics (Sol Phys; grey). S…

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

3 extracted references · 2 canonical work pages

[1]

botherref National Academies : 2024, National Academies of Sciences, Engineering, and Medicine. 2024. The Next Decade of Discovery in Solar and Space Physics: Exploring and Safeguarding Humanity's Home in Space. Technical report, The National Academies Press, Washington, DC. https://doi.org/10.17226/27938 . https://doi.org/10.17226/27938. botherref

doi:10.17226/27938 2024
[2]

: 2016 , Publication Statistics on the Sun and the Heliosphere

barticle Schrijver , C.J. : 2016 , Publication Statistics on the Sun and the Heliosphere . 291 , 1267 . https://doi.org/10.1007/s11207-016-0884-3 . 2016SoPh..291.1267S . barticle

work page doi:10.1007/s11207-016-0884-3 2016
[3]

, Fletcher , L

barticle Schrijver , C.J. , Fletcher , L. , van Driel-Gesztelyi , L. , Asai , A. , Cally , P.S. , Charbonneau , P. , Gibson , S.E. , Gomez , D. , Hasan , S.S. , Veronig , A.M. , Yan , Y. : 2016 , Division E Commission 10: Solar Activity . Transactions of the International Astronomical Union, Series A 29A , 245 . https://doi.org/10.1017/S174392131600079X ....

work page doi:10.1017/s174392131600079x 2016

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.

[1] [1]

botherref National Academies : 2024, National Academies of Sciences, Engineering, and Medicine. 2024. The Next Decade of Discovery in Solar and Space Physics: Exploring and Safeguarding Humanity's Home in Space. Technical report, The National Academies Press, Washington, DC. https://doi.org/10.17226/27938 . https://doi.org/10.17226/27938. botherref

doi:10.17226/27938 2024

[2] [2]

: 2016 , Publication Statistics on the Sun and the Heliosphere

barticle Schrijver , C.J. : 2016 , Publication Statistics on the Sun and the Heliosphere . 291 , 1267 . https://doi.org/10.1007/s11207-016-0884-3 . 2016SoPh..291.1267S . barticle

work page doi:10.1007/s11207-016-0884-3 2016

[3] [3]

, Fletcher , L

barticle Schrijver , C.J. , Fletcher , L. , van Driel-Gesztelyi , L. , Asai , A. , Cally , P.S. , Charbonneau , P. , Gibson , S.E. , Gomez , D. , Hasan , S.S. , Veronig , A.M. , Yan , Y. : 2016 , Division E Commission 10: Solar Activity . Transactions of the International Astronomical Union, Series A 29A , 245 . https://doi.org/10.1017/S174392131600079X ....

work page doi:10.1017/s174392131600079x 2016