REVIEW 2 major objections 2 minor 14 references
Development of test materials for assessment broadcasting video path
T0 review · 2 major / 2 minor · reviewed 2026-05-24 · grok-4.3
Pith's one-line read Existing international color sets miss saturated green and red needed for video path testing, so color atlases should be used to build testing tables.
desk verdict The paper recommends color atlases to fill gaps in standard color sets for broadcasting video test tables, but supplies no spectral data or validation to show the idea works. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
Atlases of colors (satin colors) as an expanded metrological resource for constructing testing tables that cover hues missing from standard sets.
What would settle it
A side-by-side spectral comparison demonstrating that all required saturated green and red colors for video path evaluation can be obtained from the current international sets without gaps.
Extended reading notes
Core claim
Saturated colors of green and red are not provided by spectral samples from the existing sets of colors drawn from international documents and recommendations, therefore the traditional understanding of metrological means should be expanded by using atlases of colors to construct testing tables that can be applied under advanced conditions with varying numbers of testing points.
Load-bearing premise
That the absence of certain saturated colors in existing sets is the primary barrier to accurate path assessment and that color atlases can be used directly to build valid testing tables.
Editorial extensions
If this is right
- Specific colors from existing sets can still be used under stated constraints for certain evaluation tasks.
- Satin colors allow testing in conditions beyond the rigidly regulated studio environment.
- The number of testing points on a table depends directly on brightness values and the chosen evaluation criteria.
- Multiple possible sets of colors can be assembled for different assessment needs.
Reading between the lines
- Normative documents for broadcasting quality assessment could be revised to reference color atlases.
- Real-world deployment of video systems might benefit from tables usable outside laboratory settings.
- The approach could be extended to other signal paths where color fidelity matters for quality metrics.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript analyzes metrological methods for quality assessment of broadcasting video paths, reviews subjective and objective approaches, identifies gaps in normative documents for optical testing tables, examines existing international color sets, substantiates deficiencies in coverage of saturated green and red colors, and proposes expanding metrological tools by incorporating color atlases (referred to as satin colors) to construct testing tables, claiming advantages for non-studio conditions and variable brightness levels.
Significance. If the deficiencies are confirmed with spectral data and the atlas-based tables are empirically validated against broadcasting standards, the work could support updates to metrological practices for video path evaluation beyond studio constraints.
major comments (2)
- [Abstract] Abstract: the claim that 'saturated colors of green and red colors are not provided with spectral from the existing sets' is asserted without any spectral measurements, comparisons to primaries in standards such as Rec.709, or quantitative metrics such as delta-E distances.
- [Abstract] Abstract: the recommendation to use color atlases for testing tables and the stated advantages 'for evaluation in advanced conditions, rather than in the studio' rest on qualitative assertions with no empirical validation, test results on video paths, or normative justification provided.
minor comments (2)
- [Abstract] Abstract: grammatical and phrasing issues ('Are reported a list', 'Satin colors In contrast', 'satin colors') impair readability and should be revised for consistency and correctness.
- [Abstract] Abstract: the number of testing points and their dependence on brightness and evaluation criteria are mentioned but not illustrated with any table, example set, or quantitative relation.
Simulated Author's Rebuttal
We thank the referee for the constructive comments on our manuscript. We provide point-by-point responses below and will revise the manuscript to address the identified issues of substantiation.
read point-by-point responses
-
Referee: [Abstract] Abstract: the claim that 'saturated colors of green and red colors are not provided with spectral from the existing sets' is asserted without any spectral measurements, comparisons to primaries in standards such as Rec.709, or quantitative metrics such as delta-E distances.
Authors: We acknowledge that the abstract presents the claim regarding deficiencies in saturated green and red coverage without accompanying spectral data, comparisons to Rec.709 primaries, or quantitative metrics such as delta-E. The manuscript's analysis is based on the defined gamuts and color specifications in existing international sets, but we agree that including spectral reflectance measurements and such quantitative comparisons would strengthen the assertion. This quantitative support will be added to the revised manuscript. revision: yes
-
Referee: [Abstract] Abstract: the recommendation to use color atlases for testing tables and the stated advantages 'for evaluation in advanced conditions, rather than in the studio' rest on qualitative assertions with no empirical validation, test results on video paths, or normative justification provided.
Authors: The recommendation to incorporate satin color atlases is offered as a means to address identified gaps in metrological tools for non-studio conditions, with advantages reasoned from the physical properties of the atlases (e.g., higher saturation and adaptability to variable brightness). The work is primarily an analysis of gaps in normative documents and a proposal for expansion rather than a report of new empirical tests on video paths. We will revise the abstract and discussion sections to more clearly distinguish the substantiated deficiencies from the proposed approach and to note the value of future empirical validation against broadcasting standards. revision: partial
Circularity Check
No circularity: qualitative analysis and proposal with no derivations or self-referential fits
full rationale
The paper conducts a qualitative review of metrological methods for video path assessment, identifies gaps in existing international color sets (particularly saturated green/red), and recommends color atlases as an expansion of testing materials. No equations, fitted parameters, predictions, or derivation chains exist that could reduce to inputs by construction. References to international documents are external and not load-bearing self-citations; the proposal does not rename known results or smuggle ansatzes. The work is self-contained as a set of recommendations resting on unshown but non-circular analysis.
Assumptions & free parameters
assumptions (2)
- domain assumption Existing international color sets are insufficient for evaluating all necessary colors in telecommunication paths
- domain assumption Atlases of colors provide advantages for evaluation in non-studio conditions
Cite this review
Pith. "Pith review of Development of test materials for assessment broadcasting video path." pith.science (2026). https://pith.science/paper/TWVQ3M3L
@misc{pith2026190711406,
author = {Pith},
title = {Pith review of: Development of test materials for assessment broadcasting video path},
year = {2026},
howpublished = {\url{https://pith.science/paper/TWVQ3M3L}},
note = {Machine review of arXiv:1907.11406}
}
read the original abstract
The analysis of metrological agents for the estimation of the quality of telecommunication path treatments is carried out. Analysis of subjective and objective estimation methods is presented. The justification for choosing an objective method of measuring is presented. Are reported a list of existing goals and objectives, which face the current progress of the implementation of promising systems for broadcasting and improvement of existing ones. The latter include the absence of normative documents and recommendations for optical specimens of testing tables, etc. Researches related to the choice of optical samples from existing sets of colors from a number of international documents and recommendations are presented. Deficiency of these sets is substantiated, as some of the colors necessary for evaluation of telecommunication paths cannot be provided with no color of sets. Provides recommendations and refinements about which colors from existing sets should be used and what constraints exist when used and how to solve. It is shown, that saturated colors of green and red colors are not provided with spectral from the existing sets, therefore, it is proposed to expand the traditional understanding of metrological means by using atlases of colors. Satin colors In contrast to existing ones have a number of advantages and can be used for evaluation in advanced conditions, rather than in the studio that is rigidly defined by the regulations. It is noted that for different brightness values there are a different number of testing points. The number of testing points directly depends on the evaluation criteria, is driven by several possible sets of colors for evaluation. Recommendations for other evaluation conditions are provided. Use satin colors to construct testing tables
Reference graph
Works this paper leans on
-
[1]
R.M., B. (1988). The quality of color television images. Moskov: Radio and Communication
work page 1988
-
[2]
Zubarev Yu. B., K. M. (2001). Tsifrovoe Televizionnoe Veschanie. Osnovyi, Metodyi, Sistemyi. Moskow: NIIR
work page 2001
-
[3]
Objectively Evaluating High Dynamic Range and Wide Color Gamut Color Differences,
J. Pytlarz, E. Pieri и R. Atkins, "Objectively Evaluating High Dynamic Range and Wide Color Gamut Color Differences," SMPTE Motion Imaging Journal, pp. 27- 32, 2017
work page 2017
-
[4]
Subjective quality assessment comparing UHD and HD resolution in HEVC transmission chains,
Y. K. M. B. P. C. Kongfeng Berger, "Subjective quality assessment comparing UHD and HD resolution in HEVC transmission chains," 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX), pp. 1-6, 2015
work page 2015
-
[5]
BT. 2111 -0, R. (2017). Specification of colour bar test pattern for high dynamic range television systems. Geneva: ITU-R
work page 2017
-
[6]
BT. 1729 -0, R. (2005). Common 16:9 or 4:3 aspect ratio digital Television reference test pattern. Geneva: ITU-R
work page 2005
-
[7]
Studio Monitor measurements -test patterns
EBU TEC H 3325 S (2008). Studio Monitor measurements -test patterns. Germany: EBU TECH 8.16066, I. (2003). Graphic Technology -Standard Object colour spectra database for colour reproduction evaluation (SOCS). Geneva: ISO
work page 2008
-
[8]
Retrieved from Floral Reflectance Database: http://reflectance.co.uk/
Show all 14 references
-
[9]
Televidenie: Uchebnik Dlya Vuzov
Dzhakoniya V.E., A.A., Ya, V (2004). Televidenie: Uchebnik Dlya Vuzov. Moskow: Radio i Svyaz
2004
-
[10]
Pyliavskyi, «Development of the algorithm of video image adaptation to spectral power distribution of illuminants,» Eastern -European Journal of Enterprise Technologies, T
V. Pyliavskyi, «Development of the algorithm of video image adaptation to spectral power distribution of illuminants,» Eastern -European Journal of Enterprise Technologies, T. 1, No. 9 (97), pp. 58-67, 2019
2019
-
[11]
Sponsored License: https://www.mathworks.com/
-
[12]
Q., Bodrogi, P., & Vinh, T
Khanh, T. Q., Bodrogi, P., & Vinh, T. Q. (2017). Color Quality of Semiconductor and Conventional Light Sources. Wiley
2017
-
[13]
C., L., Z., L., & al., W. Z. (2017). Comprehensive Color Solutions: CAM16, CAT16, and CAM16‐UCS. Color Res Appl., 703-718
2017
-
[14]
Li, C., Xu, Y., Wang, Z., & Luo, M. R. (2018). Comparing two‐step and one‐ step chromatic adaptation transforms using the CAT16 model. Color Res. & Appl., 633-642
2018
Reviewed May 24, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.