REVIEW
The Geography of Scientific Productivity: Scaling in U.S. Computer Science
Physics and Society · Submitted 28 Mar 2006 · 38 references
Pith's verdict: A useful early map of U.S. computer science output whose headline exponents hinge on unquantified address-parsing assumptions.
T0 · AI review
Why Pith says this
Highlight any text to comment on it.
Referee report
The paper
The paper claims
U.S. computer-science output per ZIP code follows a power law; spatial clusters persist even after rescaling by population and R&D.
The reading
What carries the argument
The load-bearing machinery is the pairing of ZIP-code-level fractional counting with the two-point correlation function of a spatial point process. Fractional counting gives each co-author an equal share $1/\phi$ of a paper, with non-U.S. addresses counted as one share and U.S. addresses split among $m$ ZIP codes, so each ZIP code's output is a well-defined productivity measure. The two-point correlation function $g(r)$, estimated with Ripley's edge correction, measures how much more likely a research centre is to have a neighbour at distance $r$ than a random Poisson process would predict; $g(r) = 1$ means randomness, while power-law decay means self-similar clustering. Cartograms from Gastner and Newman's diffusion method are then applied to rescale the map by R&D and population, providing the control experiment: if the clustering vanished under rescaling, it would be attributable to those demographic variables.
Extended reading notes
Core claim
The central claim, stated on the authors' own terms, is that U.S. computer science productivity is heavy-tailed and spatially scale-invariant in a way that population and R&D density do not explain. Using fractional counting over 128,348 U.S. papers in Citeseer, they estimate the cumulative distribution of paper output per ZIP code as a power law with exponent $\alpha = 1.55$ between the two modes of a bimodal density; the upper tail cannot be resolved because data are scarce. For the 1,046 centres with at least two papers, the two-point correlation function of their geographic positions decays as $g(r) \sim r^{-\gamma}$ with $\gamma \simeq 1.16$, indicating clustering at all measured distance scales. After density-equalizing cartogram transforms that control for state-level R&D, state-level population, and county-level population, a power-law decay of $g(r)$ persists, so the observed clustering is not merely an artifact of where people or research money are concentrated.
Load-bearing premise
The power-law and spatial-scaling conclusions rest on the assumption that the 52.9% of Citeseer papers with complete author addresses, and the ZIP codes parsed from them, are representative of all U.S. computer science output, so missing or inaccurate address fields are not correlated with institution size or location.
Editorial extensions
If this is right
- If the fitted exponent $\alpha = 1.55$ is correct, U.S. computer science output is concentrated in a thin tail of ZIP codes, so a small number of institutions dominate the field's production.
- Because $g(r)$ decays as a power law out to hundreds of kilometres, research-centre clustering is self-similar: concentration shows up at every distance scale, not just within metropolitan areas.
- The persistence of the power-law decay after cartogram normalization by state R&D and state and county population implies that demographic and funding density do not, by themselves, generate the observed geography.
- The bimodal productivity distribution, together with the unresolved upper tail, suggests that small and large research centres may be governed by different growth mechanisms, a question the present data cannot settle.
- ZIP-code-level fractional counting provides a fine-grained unit for future bibliometric indicators that are sensitive to the internal geography of institutions.
Reading between the lines
- A direct test of the parsing assumption would rerun the analysis on a complete address source, such as publisher metadata or a national researcher registry; if the exponents shift materially, the claimed scaling laws are artifacts of missing addresses.
- Applying the same ZIP-code methodology to other research disciplines could reveal whether $\alpha = 1.55$ and $\gamma = 1.16$ are universal scaling exponents or field-specific.
- The survival of clustering after population normalization suggests a generative process in which new centres form near existing ones; the paper does not test this mechanism, but it is a natural next step.
- Repeating the study on current open metadata could test whether preprint culture and remote collaboration have weakened the geographic anchoring of research productivity.
Original abstract
Here we extract the geographical addresses of authors in the Citeseer database of computer science papers. We show that the productivity of research centres in the United States follows a power-law regime, apart from the most productive centres for which we do not have enough data to reach definite conclusions. To investigate the spatial distribution of computer science research centres in the United States, we compute the two-point correlation function of the spatial point process and show that the observed power-laws do not disappear even when we change the physical representation from geographical space to cartogram space. Our work suggests that the effect of physical location poses a challenge to ongoing efforts to develop realistic models of scientific productivity. We propose that the introduction of a fine scale geography may lead to more sophisticated indicators of scientific output.
The compiled record
The paper's own sentences, arranged, kept beside the review and separate from it. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
The abstract, sentence by sentence
Here we extract the geographical addresses of authors in the Citeseer database of computer science papers. We show that the productivity of research centres in the United States follows a power-law regime, apart from the most productive centres for which we do not have enough data to reach definite conclusions. To investigate the spatial distribution of computer science research centres in the United States, we compute the two-point correlation function of the spatial point process and show that the observed power-laws do not disappear even when we change the physical representation from geographical space to cartogram space. Our work suggests that the effect of physical location poses a challenge to ongoing efforts to develop realistic models of scientific productivity. We propose that the introduction of a fine scale geography may lead to more sophisticated indicators of scientific output.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | Here we extract the geographical addresses of authors in the Citeseer database of computer science papers. | method 0.96 | 0.94 | 0.02 | asserted 0.96 |
| s1 | We show that the productivity of research centres in the United States follows a power-law regime, apart from the most productive centres for which we do not have enough data to reach definite conclusions. | result 1.00 | 0.96 | 0.66 | asserted 1.00 |
| s2 | To investigate the spatial distribution of computer science research centres in the United States, we compute the two-point correlation function of the spatial point process and show that the observed power-laws do not disappear even when we change the physical representation from geographical space to cartogram space. | result 0.69 | 0.97 | 0.20 | asserted 1.00 |
| s3 | Our work suggests that the effect of physical location poses a challenge to ongoing efforts to develop realistic models of scientific productivity. | interpretation 1.00 | 0.38 | 0.47 | hedged possibility 1.00 |
| s4 | We propose that the introduction of a fine scale geography may lead to more sophisticated indicators of scientific output. | future work 1.00 | 0.17 | 0.11 | hedged possibility 1.00 |
What was examined, and what was not
- arXiv listing abstract v3
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
Figures
Figures reproduced from arXiv:physics/0603242 by the authors.
References
Discussion
Disagree with the review, or know something it missed? Leave a comment, highlight any passage above to comment on it, or challenge this review formally.