pith. sign in

arxiv: 2604.22965 · v1 · submitted 2026-04-24 · 📊 stat.ME

Agreement coefficients for continuous variables: A review

Ronny Vallejos This is my paper

Pith reviewed 2026-05-08 10:58 UTC · model grok-4.3

classification 📊 stat.ME
keywords agreement coefficientscontinuous variablesBland-Altman methodconcordance correlationspatial statisticsrepeated measuresprobability of agreementmeasurement error
0
0 comments X

The pith

A review organizes the main statistical tools for checking numerical agreement between continuous measurements.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper reviews methods that determine whether different techniques produce similar numbers for the same continuous quantity. It begins with the classic Bland-Altman difference plots and Lin's concordance correlation coefficient, then traces extensions that handle outliers, multiple variables at once, repeated observations on the same subjects, and spatial arrangements such as maps or images. This matters because many applications in medicine, environmental monitoring, and data validation require knowing if values are close in absolute terms rather than merely related. The synthesis also covers newer ideas like the probability that two measurements agree within a tolerance and measures using other distance functions, while noting where current approaches still fall short.

Core claim

This review establishes a connected overview of agreement coefficients for continuous variables by starting from the foundational Bland-Altman and Lin contributions and systematically presenting their extensions to robust, multivariate, repeated-measures, and spatial settings, together with probability-of-agreement and alternative-distance formulations, while cataloguing limitations and open questions.

What carries the argument

Agreement coefficients, which quantify numerical concordance between measurement methods by incorporating both accuracy and precision rather than correlation alone.

If this is right

  • Practitioners gain access to tailored tools for longitudinal or repeated-measurement studies.
  • Spatial versions become available for image analysis and geostatistical applications.
  • Newer probability-of-agreement approaches allow direct statements about how often measurements fall within a chosen tolerance.
  • Identified limitations in existing measures point to specific gaps for future methodological work.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The emphasis on spatial generalizations suggests these coefficients could be tested directly on raster data from remote sensing.
  • Standard statistical packages could incorporate the reviewed measures to reduce ad-hoc implementations in applied work.
  • Open challenges around multivariate and high-dimensional cases may connect to similar problems in sensor fusion.

Load-bearing premise

The field has advanced enough since the previous major reviews to make a new synthesis useful and that the selected extensions represent the main current directions.

What would settle it

Locating a widely used agreement method for continuous data developed in the last fifteen years that is not mentioned or connected in the review would show the synthesis is incomplete.

Figures

Figures reproduced from arXiv: 2604.22965 by Ronny Vallejos.

Figure 1
Figure 1. Figure 1: Panel of figures showing the visual effect of contamination of forest image. (a) Reference view at source ↗
Figure 2
Figure 2. Figure 2: Effect of 1% contamination on the gray label pixels of image displayed in Figure view at source ↗
Figure 3
Figure 3. Figure 3: Bland–Altman plot comparing the images displayed in Figures view at source ↗
Figure 4
Figure 4. Figure 4: PA between image shown in Figure view at source ↗
Figure 5
Figure 5. Figure 5: (a) Scatterplot illustrating the relationship between NO view at source ↗
Figure 6
Figure 6. Figure 6: (a) Scatterplot of NO2 measurements at station SUD3 versus sensor ASE10, including the fitted regression line. (b) Scatterplot of observed SUD3 values versus predicted ASE10 values obtained from the regression model (27). of this nature, it is reasonable for sensors to be placed in close proximity to reference monitoring stations, since the primary objective is calibration. Consequently, positioning sensor… view at source ↗
Figure 7
Figure 7. Figure 7: PA between the variables of model for 27 for different values of c. between the two predictors. This issue can be investigated in the spirit of the agreement-on-the-line framework introduced by Baek et al. (2022). The notion of agreement can be generalized to quantify concordance between two spatial net￾works. Because the definition of a network is not unique, a natural starting point is to consider two ra… view at source ↗
read the original abstract

Agreement coefficients provide a fundamental framework for quantifying the concordance between two or more measurement methods applied to the same continuous variable. Unlike correlation, which measures the strength of a linear relationship, agreement focuses on assessing whether measurements are numerically similar, capturing both precision and accuracy. This review provides a comprehensive overview of the primary statistical approaches for assessing agreement between continuous variables. Such a synthesis is timely, as it has been 15-20 years since the last major review in the field. Beginning with the seminal contributions of Bland and Altman (1986) and Lin (1989), the paper discusses extensions of their methods to robust, multivariate, and repeated-measures settings, as well as recent developments like the probability of agreement and measures based on alternative distance functions measures. Special attention is given to probabilistic and spatial generalizations, including frameworks designed for geostatistical and areal data, which have become increasingly relevant in modern applications such as image analysis and environmental statistics. Through illustrative examples and comparative discussions, this review highlights the evolution, connections, and limitations of existing agreement measures, identifying open challenges and directions for future research.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

0 major / 4 minor

Summary. This manuscript is a review of statistical agreement coefficients for continuous variables. It starts with the foundational contributions of Bland and Altman (1986) and Lin (1989), then surveys extensions to robust, multivariate, repeated-measures, probabilistic, and spatial settings (including geostatistical and areal data applications in image analysis and environmental statistics). The review incorporates illustrative examples, comparative discussions of limitations, and identification of open challenges and future research directions.

Significance. If the summaries of cited methods prove accurate and the coverage representative, the review would provide a timely synthesis after a 15-20 year gap since prior major reviews. It could assist applied researchers in medical, environmental, and imaging fields by clarifying connections among measures and highlighting practical limitations, thereby supporting better method selection and identification of research gaps.

minor comments (4)
  1. The abstract states that the review covers 'measures based on alternative distance functions' but the manuscript would benefit from a dedicated subsection or table explicitly comparing these to the Bland-Altman and Lin frameworks in terms of robustness and computational cost.
  2. In the sections on spatial generalizations, the notation distinguishing geostatistical (point-referenced) from areal data models should be introduced earlier and used consistently to improve readability for readers unfamiliar with spatial statistics.
  3. A summary table listing key agreement measures, their key assumptions, applicable data structures, and main limitations would strengthen the comparative discussion and serve as a quick reference for practitioners.
  4. Several citations to post-2010 methodological papers on probabilistic agreement are mentioned; please ensure the reference list includes DOIs or full bibliographic details for all works discussed in the probabilistic and spatial sections.

Simulated Author's Rebuttal

0 responses · 0 unresolved

We thank the referee for their positive assessment of the manuscript as a timely synthesis of agreement coefficients for continuous variables and for recommending minor revision. We are pleased that the review is viewed as potentially useful for applied researchers in medical, environmental, and imaging fields.

Circularity Check

0 steps flagged

No significant circularity; purely expository review

full rationale

This is a literature review paper with no derivations, equations, predictions, or modeling steps. The abstract and structure describe a synthesis of prior work (Bland-Altman 1986, Lin 1989, and extensions) without advancing any new quantitative claims or load-bearing arguments that could reduce to fitted inputs, self-definitions, or self-citation chains. No circular steps exist by the paper's own text.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 0 invented entities

As a review article the paper introduces no new free parameters, axioms, or invented entities; it relies entirely on previously published statistical methods and frameworks.

pith-pipeline@v0.9.0 · 5478 in / 988 out tokens · 50591 ms · 2026-05-08T10:58:41.627066+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

3 extracted references · 3 canonical work pages

  1. [1]

    on optimal correlation-based prediction,

    R. Christensen. Comment on “on optimal correlation-based prediction,” by bottai et al. (2022). The American Statistician, 77:113,

    work page 2022

  2. [2]

    T. Kim, G. Luta, M. Bottai, P. Chaussé, G. Doros, and E. Peña. Maximum agreement linear prediction via the concordance correlation coefficient.arXiv:2304.04221,https: // doi. org/

    work page arXiv

  3. [3]

    Vallejos, C

    R. Vallejos, C. Ferrer, and J Mateu. A concordance coefficient for lattice data: An application to poverty indices in chile.Spatial Statistics, 70:100936, 2025a. R. Vallejos, F. Osorio, and C. Ferrer. A new coefficient to measure agreement between continuous variables.arXiv:2507.07913,https: // doi. org/

    work page arXiv