REVIEW 4 major objections 4 minor 37 references
PaCoNet: Deep Data Extraction for Parallel Coordinates
T0 review · 4 major / 4 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read The paper presents PaCoNet as the first deep learning approach to extract per-sample data from parallel-coordinate plots, by separating hue-based categories, restoring line continuity, and detecting polylines with a Hough-prior line…
desk verdict First DL pipeline for parallel-coordinate extraction with a solid synthetic dataset, but the per-sample reconstruction claim is not actually evaluated. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central mechanism is the PaCoNet pipeline, whose load-bearing pieces are a synthetic data generator and a category-separation step. The generator renders parallel-coordinate plots with Vega-Lite using parameter distributions measured from real-world charts, yielding exact ground-truth axes, values, and polyline correspondences for supervised training. Category separation converts a cluttered multi-color plot into per-category binary images by clustering hue values with peak detection or DBSCAN, which makes the dense line-detection problem tractable. The detector is DHLP, a Hough-transform-inspired network that aggregates evidence along full line extents and is therefore suited to dense, overlapping, mostly straight polylines. A U-Net restoration stage and masked filtering are supporting components: the former removes separation artifacts, and the latter suppresses false detections by retaining only lines whose pixels lie mostly inside restored masks.
What would settle it
Annotate a modest set of real-world parallel-coordinate images (for example 100 charts) with ground-truth polylines, run the released PaCoNet models, and compare line-count error and detection accuracy against the synthetic test results; if real-chart performance degrades substantially or matches the unadapted DHLP baseline, the transfer claim collapses.
Extended reading notes
Core claim
PaCoNet's central claim is that data extraction from parallel-coordinate charts is feasible through a modular pipeline rather than a single detector. Given a raster plot, it crops the space between adjacent vertical axes; separates polylines by discrete hue categories using either peak detection or DBSCAN clustering; restores the separated images with a U-Net trained to remove artifacts; detects line segments with a deep Hough-transform-prior line detector (DHLP); and filters detections against binarized restored masks. The authors report that this is the first deep learning approach specifically designed for parallel-coordinate data extraction, and that it outperforms unadapted baselines—vision-language models, DHT, and DHLP alone—by a clear margin on the synthetic test set, with LC-MAE of 0.37–0.38 versus 0.47 for DHLP alone and 0.61–0.80 for vision-language models, and sAP10 of 68.39 versus 46.55. Real-world results are shown qualitatively, including chart reconstruction, category recoloring, and axis reordering.
Load-bearing premise
The argument rests on synthetic training charts, whose parameters were sampled from about 200 curated real-world images, being representative enough of real parallel-coordinate plots that PaCoNet's reported synthetic accuracy carries over to unseen real charts.
Editorial extensions
If this is right
- Static parallel-coordinate images can be transformed into editable, vector-like representations without access to the original dataset.
- Category recoloring and axis reordering become possible on extracted data, enabling accessibility improvements and alternative variable-order exploration.
- A large-scale synthetic parallel-coordinate dataset with exact ground-truth annotations is released, giving future research a training and benchmarking resource.
- PaCoNet serves as a structural preprocessing stage, so combining it with OCR-based axis-scale parsing would recover numeric data values rather than only relative coordinates.
- Ablation results show that each pipeline stage matters: removing restoration or masked filtering lowers detection accuracy, so the modular design is needed for the reported gains.
Reading between the lines
- Beyond the paper's experiments, the same recipe of color-based separation, restoration, and Hough-prior detection may transfer to other dense multi-line visualizations such as Sankey diagrams or streamgraphs, but the paper does not test this.
- Because real-world evaluation is qualitative only, the practical gain over baselines on real charts is unmeasured; a small annotated real-world benchmark would settle whether the synthetic training distribution transfers.
- The hue-based category separation limits the method to discrete-color categorical plots, leaving monochrome and continuous-colormap parallel-coordinate plots out of scope.
- The axis-detection front end assumes regularly spaced vertical axes, so curved, rotated, or otherwise irregular parallel-coordinate variants would require a different geometric detector.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes PaCoNet, a modular deep-learning pipeline for extracting polyline structures from raster parallel-coordinate plots. The pipeline consists of axis-based cropping, category separation by hue (peak detection or DBSCAN/HDBSCAN), U-Net-based restoration, DHLP line detection, and a masked-filtering postprocessing step. The authors introduce a synthetic training/test dataset (5,000 train/validation images and 1,000 test images) whose parameter ranges are informed by statistics collected from roughly 200 curated real-world parallel-coordinate images. Quantitative evaluation on the synthetic test set reports line-count MAE (LC-MAE) and structural Average Precision (sAP), with ablations for category separation, restoration, and masked filtering. Real-world results are shown qualitatively, and the paper demonstrates chart reconstruction, category recoloring, and axis reordering as use cases. The abstract claims that PaCoNet is the first deep-learning approach for parallel-coordinate data extraction and that it 'enables the extraction of individual data samples for further analysis.'
Significance. If the central claims were fully supported, PaCoNet would be a useful contribution to visualization chart mining: it introduces a new task, a large synthetic dataset with exact annotations, and a modular pipeline that outperforms unadapted line-detection baselines (DHLP, DHT) and general-purpose VLMs on the reported synthetic metrics. The paper's strengths include the explicit release of code, models, and data-generation scripts; the use of a real-world chart corpus to shape the synthetic distribution; and a clean ablation structure that isolates the contribution of each pipeline stage. However, the significance is currently bounded by two evaluation gaps: the per-sample data-extraction capability central to the abstract is not measured at all, and real-world generalization is supported only by qualitative examples. The paper also honestly acknowledges in Section 7 that it does not recover numeric axis scales, which tempers the 'data extraction' claim.
major comments (4)
- [§5.1 / §4.4 / Table 1] The evaluation does not test the paper's central claim that PaCoNet 'enables the extraction of individual data samples.' LC-MAE (Table 1a) only compares line counts, and sAP (Table 1b) is computed per cropped region on detected segments; neither metric evaluates whether the linking step described in §4.4 correctly associates segments across axis crops into complete polylines with preserved sample identities. A system can achieve strong LC-MAE and high sAP while scrambling the identities of lines that cross between axes, so the per-sample reconstruction capability is unverified even on the synthetic test set. I request a sample-level metric that matches predicted polylines to ground-truth samples, for example the fraction of samples whose normalized axis coordinates are recovered within a tolerance using Hungarian assignment, reported on the synthetic test set.
- [§5.2 / §7] Real-world validation is only qualitative (Figure 5), and Section 7 explicitly states that 'the absence of quantitative evaluation on annotated real images remains a limitation.' Because the synthetic distribution is derived from only about 200 curated real charts (Section 3.1), the transfer claim is a load-bearing premise for the paper's practical usefulness. I request at least a small annotated real-world test set with quantitative reconstruction errors, or a clearly scoped statement that all quantitative results are synthetic-only and that real-world performance is not yet measured.
- [§4.4 / §7] The output of PaCoNet is a set of image-space polylines, and Section 7 states that the method 'does not recover semantic numeric values such as axis scales, tick labels, or textual annotations.' The abstract's phrase 'extraction of individual data samples for further analysis' therefore overstates what the pipeline delivers: without scale mapping, users cannot obtain the numeric data values that 'further analysis' typically requires. Either add an axis-calibration evaluation that maps image coordinates to data values using detected axes and ticks, or rephrase the claims to describe structural polyline extraction rather than data extraction.
- [§5.1 / Table 1] All quantitative results are reported as point estimates without error bars, confidence intervals, or multiple-seed variance. The claimed 'significant margin' over DHLP (Table 1: LC-MAE 0.38 vs. 0.47; sAP5 61.66 vs. 40.56 with masked filtering) could be affected by training stochasticity and test-set composition. Please report variance across at least three training runs or bootstrap confidence intervals over the test set, so the reader can assess whether the reported improvements are robust.
minor comments (4)
- [§3.1] The sentence 'The later we have carefully collected and curated to form a real-world parallel coordinate data set' is ungrammatical; the intended meaning appears to be that the real-world set was carefully collected and curated.
- [§5.1] The text around 'We use Mean Absolute Error [32] to quantify the difference between the number of predicted and ground-truth lines' is confusing because several MAE variants are introduced; please define LC-MAE and CC-MAE explicitly before their first use.
- [§4.2] The assumption that categories are encoded with discrete, stable color hues is stated only in the method section; because many real parallel-coordinate plots use continuous colormaps or grayscale, this scope condition should also appear in the abstract or introduction.
- [Table 2] The mapping between the text's ablation descriptions and the table panels (b), (c), and (d) is inconsistent; for example, the text says peak-based separation performs best at full resolution, but one of the resolution panels reports lower CC-MAE for downscaled input (1.65 vs. 4.27). Please align the panel references and clarify which panel corresponds to peak-based versus clustering-based separation.
Circularity Check
No circularity: PaCoNet is a standard supervised pipeline whose evaluation does not reduce to its inputs.
full rationale
PaCoNet's derivation chain is a conventional modular supervised system: a synthetic data generator with exact ground-truth annotations, a U-Net restoration network trained on separated-noisy versus clean image pairs, DHLP line detection, heuristic category separation, and mask-based post-filtering. No predicted quantity is fitted from the evaluation target and then reported as a prediction, and no parameter is renamed as a result. The real-world dataset is used only to sample parameter ranges for synthetic generation, not as supervised labels or as a test set, so no train/test identity is hidden. Comparisons against VLMs, DHT, and DHLP are performed on the same synthetic test split and are therefore fair as in-distribution benchmarks. The main limitation, acknowledged in Section 7, is that real-world performance is only qualitative and the evaluation distribution matches the training distribution; this restricts generalization claims but is not deductive circularity. There is no load-bearing self-citation or imported uniqueness theorem: DHLP is an external baseline and component, and the paper's novelty claim rests on the pipeline design rather than on a cited prior result by the same authors. Thus no circular step is present.
Assumptions & free parameters
free parameters (5)
- Binarization threshold tau =
not reported
- Masked filtering threshold alpha =
not reported
- DBSCAN epsilon and min_samples =
not reported
- Peak detection parameters =
not reported
- Synthetic data sampler ranges =
sampled from empirical distributions
assumptions (4)
- domain assumption Categories are encoded with discrete, stable color hues
- domain assumption Real-world parallel-coordinate plots use straight polylines and linear, vertical, regularly spaced axes
- domain assumption The empirical statistics of about 200 curated real-world images define the synthetic training distribution
- standard math DHLP and U-Net architectures and training setups are valid as given by prior work
Cite this review
Pith. "Pith review of PaCoNet: Deep Data Extraction for Parallel Coordinates." pith.science (2026). https://pith.science/paper/4II7IU3A
@misc{pith2026260806030,
author = {Pith},
title = {Pith review of: PaCoNet: Deep Data Extraction for Parallel Coordinates},
year = {2026},
howpublished = {\url{https://pith.science/paper/4II7IU3A}},
note = {Machine review of arXiv:2608.06030}
}
read the original abstract
Extracting data from visualizations has long challenged computer vision, with current research focused on bar, line, and pie charts, among other low-dimensional visualizations. However, parallel coordinates as a widely used high-dimensional data visualization approach, remain largely unexplored in this context. As parallel coordinate plots can quickly become cluttered and difficult to interpret when poorly designed or densely populated, automated data extraction from such visualizations is of particular interest. In this paper, we propose PaCoNet, the first approach for parallel coordinate data extraction. PaCoNet not only extracts line coordinates, but also enables the extraction of individual data samples for further analysis. Towards this end, we make the following contributions. We present the first deep learning approach tailored for parallel coordinate analysis, and demonstrate that it outperforms unadapted baselines by a significant margin. We further introduce a large-scale parallel coordinate dataset for training and testing. Together, these key contributions enable for the first time the automated analysis and redesign of parallel coordinate plots. PaCoNet thus lays the groundwork for complex visualization analysis, and further advances the intersection of computer vision and data visualization. All code, trained models, and data generation scripts will be made publicly available upon acceptance of the paper.
Figures
Figures from the paper (2 more)
Reference graph
Works this paper leans on
-
[1]
In: Visualization and Data Analysis 2010 (2010)
Alsakran, J., Zhao, Y., Zhao, X.: Tile-based parallel coordinates and its application in financial visualization. In: Visualization and Data Analysis 2010 (2010)
work page 2010
-
[2]
In: 2012 IEEE 12th International Conference on Bioinformatics & Bioengineering (BIBE) (2012)
Boogaerts, T., Tranchevent, L.C., Pavlopoulos, G.A., Aerts, J., Vandewalle, J.: Visualizing high dimensional datasets using parallel coordinates: Application to gene prioritization. In: 2012 IEEE 12th International Conference on Bioinformatics & Bioengineering (BIBE) (2012)
work page 2012
-
[3]
IEEE Transactions on Visualization and Computer Graphics (2024)
Cui, Z., Chen, L., Wang, Y., Haehn, D., Wang, Y., Pfister, H.: Generalization of cnns on relational reasoning with bar charts. IEEE Transactions on Visualization and Computer Graphics (2024)
work page 2024
-
[4]
In: International Conference on Pattern Recognition (2024)
Davila, K., Lazarus, R., Xu, F., Rodríguez Alcántara, N., Setlur, S., Govindaraju, V., Mondal, A., Jawahar, C.: Chart-info 2024: A dataset for chart analysis and recognition. In: International Conference on Pattern Recognition (2024)
work page 2024
-
[5]
Ester, M., Kriegel, H.P., Sander, J., Xu, X.: A density-based algorithm for discov- ering clusters in large spatial databases with noise. In: Proceedings of KDD-96. AAAI Press (1996)
work page 1996
-
[6]
In: Proceedings on Seventh International Conference on Information Visualization, 2003 (2003)
Graham, M., Kennedy, J.: Using curves to enhance parallel coordinate visualisations. In: Proceedings on Seventh International Conference on Information Visualization, 2003 (2003)
work page 2003
-
[7]
Han, Q., Zhao, K., Xu, J., Cheng, M.M.: Deep hough transform for semantic line detection. IEEE Transactions on Pattern Analysis and Machine Intelligence (2020), https://api.semanticscholar.org/CorpusID:212644678
work page 2020
-
[8]
Heinrich, J., Weiskopf, D.: State of the art of parallel coordinates. In: 34th Annual Conference of the European Association for Computer Graphics, Eurographics 2013 - State of the Art Reports. Eurographics Association (2013), https://doi.org/10. 2312/conf/EG2013/stars/095-116
work page 2013
Show all 37 references
-
[9]
Hough, P.V.: Method and means for recognizing complex patterns (December 18 1962), uS Patent 3,069,654
1962
-
[10]
The Visual Computer (1985)
Inselberg, A.: The plane with parallel coordinates. The Visual Computer (1985)
1985
-
[11]
In: Proceedings of WACV (2022)
Kato, H., Nakazawa, M., Yang, H.K., Chen, M., Stenger, B.: Parsing line chart images using linear programming. In: Proceedings of WACV (2022)
2022
-
[12]
In: 54th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference (2013)
Kipouros, T., Inselberg, A., Parks, G., Savill, A.M.: Parallel coordinates in compu- tational engineering design. In: 54th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference (2013)
2013
-
[13]
arXiv:2305.01837 (2023)
Lal, J., Mitkari, A., Bhosale, M., Doermann, D.S.: LineFormer: Rethinking line chart data extraction as instance segmentation. arXiv:2305.01837 (2023)
2023 arXiv
-
[14]
In: Proceedings ECCV (2020)
Lin, Y., Pintea, S.L., van Gemert, J.C.: Deep hough-transform line priors. In: Proceedings ECCV (2020)
2020
-
[15]
In: 2009 13th International Conference Information Visualisation (2009)
Lind, M., Johansson, J., Cooper, M.: Many-to-many relational parallel coordinates displays. In: 2009 13th International Conference Information Visualisation (2009)
2009
-
[16]
arXiv:1906.11906 (2019) PaCoNet: Deep Data Extraction for Parallel Coordinates 15
Liu, X., Klabjan, D., Bless, P.N.: Data extraction from charts via single deep neural network. arXiv:1906.11906 (2019) PaCoNet: Deep Data Extraction for Parallel Coordinates 15
2019 arXiv
-
[17]
BMC genomics6(1) (2005)
Lovmar, L., Ahlford, A., Jonsson, M., Syvänen, A.C.: Silhouette scores for assess- ment of snp genotype clusters. BMC genomics6(1) (2005)
2005
-
[18]
In: Proceedings of WACV (2021)
Luo, J., Li, Z., Wang, J., Lin, C.Y.: ChartOCR: Data extraction from chart images via a deep hybrid framework. In: Proceedings of WACV (2021)
2021
-
[19]
In: Findings of the association for computational linguistics: ACL 2022 (2022)
Masry, A., Do, X.L., Tan, J.Q., Joty, S., Hoque, E.: Chartqa: A benchmark for question answering about charts with visual and logical reasoning. In: Findings of the association for computational linguistics: ACL 2022 (2022)
2022
-
[20]
In: Computer Graph- ics Forum (2008)
McDonnell, K.T., Mueller, K.: Illustrative parallel coordinates. In: Computer Graph- ics Forum (2008)
2008
-
[21]
McInnes, L., Healy, J., Astels, S., et al.: hdbscan: Hierarchical density based clustering. J. Open Source Softw.2(11) (2017)
2017
-
[22]
In: 2023 International Conference on Digital Image Computing: Techniques and Applications (DICTA) (2023)
Mustafa, O., Ali, M.K., Moetesum, M., Siddiqi, I.: Charteye: A deep learning framework for chart information extraction. In: 2023 International Conference on Digital Image Computing: Techniques and Applications (DICTA) (2023)
2023
-
[23]
OpenAI: Chatgpt (2025), march 7 version, retrieved from https://openai.com
2025
-
[24]
In: Proceedings of WACV (2023)
P., S.V., Hassan, M.Y., Singh, M.: LineEX: Data extraction from scientific line charts. In: Proceedings of WACV (2023)
2023
-
[25]
In: Proceedings of CVPR (June 2019)
Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., Savarese, S.: Generalized intersection over union: A metric and a loss for bounding box regression. In: Proceedings of CVPR (June 2019)
2019
-
[26]
ArXiv (2015), https://api.semanticscholar.org/CorpusID: 3719281
Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomedi- cal image segmentation. ArXiv (2015), https://api.semanticscholar.org/CorpusID: 3719281
2015
-
[27]
IEEE TVCG (2016)
Satyanarayan, A., Moritz, D., Wongsuphasawat, K., Heer, J.: Vega-lite: A grammar of interactive graphics. IEEE TVCG (2016)
2016
-
[28]
In: Proceedings of the ACM Symposium on User Interface Software and Technology (UIST) (2011)
Savva, M., Kong, N., Chhajta, A., Fei-Fei, L., Agrawala, M., Heer, J.: Revision: Automated classification, analysis and redesign of chart images. In: Proceedings of the ACM Symposium on User Interface Software and Technology (UIST) (2011)
2011
-
[29]
arXiv preprint arXiv:2312.11805 (2023)
Team, G., Anil, R., Borgeaud, S., Alayrac, J.B., Yu, J., Soricut, R., Schalkwyk, J., Dai, A.M., Hauth, A., Millican, K., et al.: Gemini: a family of highly capable multimodal models. arXiv preprint arXiv:2312.11805 (2023)
2023 arXiv
-
[30]
IEEE TVCG (2023)
Tyagi, A.K., Estro, T., Kuenning, G., Zadok, E., Mueller, K.: PC-Expo: A metrics- based interactive axes reordering method for parallel coordinate displays. IEEE TVCG (2023)
2023
-
[31]
Chapman and Hall/CRC (2018)
Wilks, A.R.: The new S language: a programming environment for data analysis and graphics. Chapman and Hall/CRC (2018)
2018
-
[32]
Climate research (2005)
Willmott, C.J., Matsuura, K.: Advantages of the mean absolute error (mae) over the root mean square error (rmse) in assessing average model performance. Climate research (2005)
2005
-
[33]
In: Proceedings of CVPR (2021)
Xu, Y., Xu, W., Cheung, D., Tu, Z.: Line segment detection using transformers without edges. In: Proceedings of CVPR (2021)
2021
-
[34]
In: Proceedings of CVPR (2020)
Xue, N., Wu, T., Bai, S., Wang, F.D., Xia, G.S., Zhang, L., Torr, P.H.S.: Holistically- attracted wireframe parsing. In: Proceedings of CVPR (2020)
2020
-
[35]
IEEE Transactions on Visualization and Computer Graphics (2009)
Yuan, X., Guo, P., Xiao, H., Zhou, H., Qu, H.: Scattering points in parallel coordinates. IEEE Transactions on Visualization and Computer Graphics (2009)
2009
-
[36]
Journal of Visualization (2021)
Zhou, F., Zhao, Y., Chen, W., Tan, Y., Xu, Y., Chen, Y., Liu, C., Zhao, Y.: Reverse-engineering bar charts using neural networks. Journal of Visualization (2021)
2021
-
[37]
In: Computer Graphics Forum (Proc
Zhou, H., Yuan, X., Qu, H., Cui, W., Chen, B.: Visual clustering in parallel coordinates. In: Computer Graphics Forum (Proc. EuroVis) (2008)
2008
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.