WHU-PCPR: A cross-platform heterogeneous point cloud dataset for place recognition in complex urban scenes

Jianping Li; Qiegen Liu; Weitong Wu; Xianghong Zou; Yandi Yang; Yuan Wang; Zhen Dong

REVIEW 4 major objections 5 minor 2 references

WHU-PCPR: A cross-platform heterogeneous point cloud dataset for place recognition in complex urban scenes

T0 review · 4 major / 5 minor · reviewed 2026-08-03 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read This paper argues that LiDAR place recognition is far less robust than current datasets suggest: when the platform, sensor, scene, or acquisition time changes, retrieval recall drops sharply, and WHU-PCPR makes those drops measurable.

desk verdict A genuinely useful cross-platform PCPR dataset whose central claim holds up, but the submap statistics contain a clear error and the ground-truth alignment protocol needs more transparency. read the letter →

arxiv 2601.06442 v2 pith:FIM333UE submitted 2026-01-10 cs.CV cs.RO

Xianghong Zou , Jianping Li , Yandi Yang , Weitong Wu , Yuan Wang , Qiegen Liu , Zhen Dong This is my paper · ORCID

classification cs.CVcs.RO

keywords pointcloudplacerecognitioncross-platformheterogeneousLiDARdatasetbenchmarkdomaingapretrievalrerankingurbanmapping

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

WHU-PCPR is a new public dataset for point-cloud place recognition built from vehicle-mounted mobile laser scanning (survey-grade, mechanical LiDAR) and helmet-mounted portable laser scanning (low-cost, solid-state LiDAR) in urban and campus scenes of Wuhan, spanning 82.3 km of trajectory and 60 months. The paper's central claim is that this cross-platform, heterogeneous design exposes a real and large domain-gap problem: trained on one phase, the best retrieval method reaches 80.7% recall at top-1 on same-domain data but falls to 36.3% when evaluated on a different LiDAR phase and to 18.9% on a different scene; rotating the query by 30 degrees drops every tested method below 20%. The benchmark also shows that geometry-based reranking can recover some of the loss—up to 12.2 points of recall at top-1—but cannot fix viewpoint sensitivity. If the dataset and its labels are accurate, it provides a stress test that existing methods clearly do not pass, and a concrete target for future domain-generalization research.

What carries the argument

The central object is the dataset itself, with the construction pipeline as the mechanism. Six sequences cover two regions—Hankou urban roads and a university campus—over three phases; circular submaps with 30-meter radius are generated every 2 meters along trajectories, then dynamic objects are removed via an octree-based occupancy filter, ground points via cloth-simulation filtering, and the remaining points are downsampled to 4096 and normalized to [-1,1]. Ground-truth correspondences come from manual alignment of PLS point-cloud blocks to MLS point clouds, with a reported average error of 0.28 m; retrieval success is defined as a retrieved submap center within 30 m of the query. The trai

What would settle it

Take a random sample of cross-phase query-map pairs from sequences such as Hankou 1&3 and WHU 1&3, re-align the PLS blocks to MLS with an independent method (e.g., ICP or NDT) or have a second human re-annotate the correspondences, and check whether the 30 m success labels change for a meaningful fraction of pairs. If a substantial proportion of labels flip, the benchmark numbers are not a reliable measure of place-recognition performance.

Watch

Extended reading notes

Core claim

On the paper's own terms: WHU-PCPR is a cross-platform heterogeneous point cloud dataset for place recognition, collected from survey-grade vehicle-mounted MLS systems and low-cost helmet-mounted PLS systems with distinct mechanical and solid-state LiDARs, across urban and campus roads in Wuhan. It comprises 38,616 submaps over 82.3 km of trajectory spanning 60 months. The benchmark conclusion is that state-of-the-art retrieval methods overfit to the acquisition domain: recall drops substantially across scenes, platforms, and LiDAR types (e.g., LoGG3D-Net R@1 from 80.70% on same-domain Hankou 1&2 to 36.25% on Hankou 1&3 and 18.85% on WHU 1&3), and viewpoint rotation of 30 degrees makes all m

Load-bearing premise

The load-bearing premise is that the manually aligned correspondences between PLS and MLS point clouds (average reported error 0.28 m) are accurate enough to label retrieval success in every scene, including the changing and vegetation-heavy ones; if those alignments are systematically biased, the reported recall drops would not truly measure place-recognition performance.

Editorial extensions

If this is right

Existing retrieval methods—point-based, voxel-based, and projection-based—cannot generalize across domains on WHU-PCPR; the reported numbers give concrete baselines that future methods must beat.
Reranking only helps when initial retrieval produces discriminative local features; geometric-consistency methods like SGV can add up to 12.17 points of R@1 on strong bases, so they are a complement, not a replacement, for better retrieval.
Viewpoint variation is the hardest unsolved problem in the benchmark: a 30-degree z-rotation collapses all tested retrieval methods below 20% R@1, and reranking does not recover it.
The gap between mechanical and solid-state LiDAR is larger than the gap between different solid-state LiDARs, according to the paper's comparisons of WHU 1&3 vs WHU 2&3—useful guidance for sensor-agnostic method design.
The dataset's 60-month span with real changes to buildings and trees provides a long-term test bed for continual learning and map-update research.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

The 30 m success threshold is coarse relative to typical localization needs; using a tighter threshold (5 or 10 m) would likely widen the differences between methods and clarify whether the reported recall drops reflect coarse scene-level matching or genuine localization failure.
Because the ground-truth alignments were made manually and not independently verified, a sample re-annotation or automatic verification (e.g., with ICP) would directly test whether the cross-phase recall drops are truly due to place-recognition failure or partly due to label error in changed or vegetation-heavy scenes.
The aligned sequences could also support point cloud registration evaluation or incremental map-update research, since the MLS phase provides a high-precision base map and the PLS phases provide later, lower-cost revisits.
The train/test setup does not currently explore domain adaptation (e.g., train on MLS only, evaluate on PLS, or few-shot fine-tune on PLS); adding such protocols would make the benchmark more actionable for adaptation research.

Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

Short version: the paper delivers what it promises — a cross-platform heterogeneous place-recognition dataset that current methods handle poorly, and the benchmark numbers support that conclusion. The submap count inconsistency flagged in the stress test is real, though it doesn't undermine the benchmark.

What's new: no existing dataset pairs survey-grade vehicle MLS with helmet-mounted PLS, mixes mechanical and solid-state LiDARs, and spans urban and campus scenes over 60 months. HeLiPR is multi-sensor but single-platform; Oxford is long-term but same vehicle. The statistics are mostly consistent: 30.81 + 51.49 = 82.3 km; the table rows sum to 38,616 submaps. The benchmark results — e.g., LoGG3D-Net R@1 dropping from 80.70% on Hankou 1&2 to 18.85% on WHU 1&3 — paint a coherent picture of large domain gaps, and the reranking results are informative.

Soft spots, in order.

First, the sentence claiming '31,466 from MLS and 7,150 from PLS' is simply wrong. Those are the Hankou and WHU totals, not platform totals. The actual numbers from Table 2 are about 14,887 MLS and 23,729 PLS submaps. This looks like a copy-paste error, but it sits in the core dataset description, so it must be fixed and the paper re-checked for similar mistakes.

Second, the cross-phase ground truth comes entirely from manual block alignment in CloudCompare. The paper reports an average error of 0.28 m but no per-sequence distribution, and the transforms aren't released. Given the 30 m success threshold, moderate errors won't change labels; the risk is localized gross misalignment in the vegetation-heavy WHU campus scenes. That is enough to ask for more evidence, not enough to distrust the conclusion.

Third, the benchmark reporting is thin: no training seeds, no variance, and the Oxford evaluation protocol is under-specified. Since some claims rest on small gaps, error bars would help.

Who should read it: anyone building or evaluating PCPR methods for long-term, cross-platform deployment. It deserves a serious referee. The dataset closes a real gap, the benchmark is useful, and the issues are addressable. Recommend: send to peer review, with a request for the corrected statistics, alignment-error details, and a reproducible benchmark protocol.

Referee Report

4 major / 5 minor

Summary. The paper introduces WHU-PCPR, a LiDAR point cloud dataset for place recognition acquired in Wuhan over a 60-month period. The data come from vehicle-mounted MLS systems and a portable helmet-mounted PLS system, with different mechanical and solid-state LiDARs, in urban and campus scenes totaling 82.3 km of trajectory. After manual block alignment in CloudCompare and submap construction, the authors benchmark five retrieval methods and three reranking methods, reporting R@N metrics on cross-scene and cross-phase pairs plus Oxford RobotCar. The central claims are that the dataset is heterogeneous across platforms, sensors, and scenes, that it exposes substantial domain gaps in current retrieval methods, and that reranking can partially recover the losses.

Significance. The dataset addresses a genuine gap: existing PCPR benchmarks rarely combine long-term (multi-year) scene change, two acquisition platforms, mechanical and solid-state LiDARs, and both urban and campus environments. The reported benchmark results, if reproducible, support the intended message: retrieval performance drops sharply across scenes/platforms (e.g., LoGG3D-Net R@1 from 80.70% on Hankou 1&2 to 40.13% on WHU 1&2 and 18.85% on WHU 1&3), and reranking methods such as SGV can partially compensate. Strengths of the paper include using standard methods, reporting inference times, and making dataset/code publicly available. The main limitations are reproducibility-related: an internal inconsistency in the platform submap counts, incomplete evaluation-protocol details, and reliance on manual alignments without sufficient error characterization.

major comments (4)

[Section 3.1, Table 2] The sentence '31,466 from MLS and 7,150 from PLS' is internally inconsistent with Table 2. The numbers 31,466 and 7,150 equal the Hankou and WHU region totals, respectively, while Table 2 implies platform totals of 14,887 MLS submaps and 23,729 PLS submaps. All counts must be reconciled; as written, a headline statistic about the platform composition of the dataset is wrong.
[Section 3.2, Fig. 2] The cross-phase retrieval labels used in Tables 3 and 4 depend entirely on manual CloudCompare alignment between PLS blocks and MLS point clouds. Only an average error of 0.28 m is reported. Since the 30 m success threshold absorbs small alignment errors, the average alone may be adequate, but the paper does not report per-sequence error distributions, number of aligned blocks or control points, or any independent check. Local gross errors in vegetation-heavy or strongly changed scenes would directly bias the benchmark conclusions. Please provide these statistics and release the alignment transforms.
[Section 4.1, Table 3] The evaluation protocol is underspecified. For the Oxford RobotCar results, the paper does not state which sequences are used, how submaps are generated, how queries and databases are split, or how the 15 m/60 m/30 m thresholds transfer to a different platform. For each 'Hankou 1&3' type column, it is not stated which phase provides queries and which provides the database; R@1% depends on database size, so direction matters. This must be clarified to make the benchmark reproducible.
[Section 4.1] All baseline results are reported as single numbers with no training seeds, runs, or variance. Claims such as 'LoGG3D-Net achieves the best performance' and the ranking of retrieval/reranking methods cannot be assessed for stability. For a dataset/benchmark paper, at least three seeds with mean and standard deviation (or fixed seeds plus published code) should be provided.

minor comments (5)

[Table 1] The dataset is named 'Wuhan-HPC' in Table 1 but 'WHU-PCPR' elsewhere; please unify the name.
[Section 4.1] The term 'Hankou 1&2' is used both for the training set and for an evaluation column in Table 3. Clarify that Table 3 reports the held-out test split of Hankou 1&2.
[Section 4.1] The statement 'we normalize the global features with reference to PatchAugNet' is vague. Specify the normalization and state whether it alters the official implementations' output features.
[General] Typos and wording: 'Specically' (Section 4), 'especically' (Section 4.1), 'efficency' (Section 4.2.2), and 'the another heterogeneous dataset' (Section 3.3) should be corrected.
[Fig. 2] The caption says 'Cloud to cloud distance' but the figure and text describe positional errors of manually selected corresponding points. Make the caption consistent with the content.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: WHU-PCPR's benchmark conclusions are empirical measurements, not derivations from fitted inputs or load-bearing self-citations.

full rationale

The paper's central claim is that WHU-PCPR is a large cross-platform heterogeneous dataset and that existing retrieval methods generalize poorly across its scenes, platforms, and LiDAR types. This claim is supported by direct measurement: submaps are generated from trajectories, ground-truth correspondences come from manual CloudCompare alignment (Sec. 3.2), and Table 3 reports R@1/R@1% for standard methods trained on Hankou 1&2 and tested on held-out splits plus Oxford. None of these benchmark numbers is obtained by fitting a parameter and then 'predicting' a closely related quantity; the 30 m success threshold is defined independently of the methods' outputs. The manual alignment is an external ground-truth construction step, and its reported 0.28 m average error is a property of the data, not an output of the evaluated retrieval pipelines. Self-citations are present—WHU-Helmet (Li et al., 2023) for the PLS hardware and PatchAugNet (Zou et al., 2023) for feature normalization—but they are used as tools and implementation references, not as premises that force the conclusion that methods drop across domains. No uniqueness theorem or ansatz is imported from prior work to forbid alternatives. A genuine correctness/verification concern exists: Sec. 3.1 says '31,466 from MLS and 7,150 from PLS,' while Table 2 implies platform totals of about 14,887 MLS and 23,729 PLS; the paper also gives no per-sequence distribution of manual alignment errors. These issues affect reliability but are not circularity, since the benchmark conclusions are not defined by the manual alignment values. Because the dataset and benchmark are self-contained measurements against external methods and Oxford data, the appropriate circularity score is 0.

Assumptions & free parameters 5 free parameters · 5 assumptions · 0 invented entities

No new physical entities are postulated. The paper's nontrivial choices are benchmark-protocol constants and domain assumptions about ground-truth validity; the central claim depends on these choices, especially manual alignment and the 30 m success radius.

free parameters (5)

Submap radius = 30 m
Circular submaps of 30 m radius generated at 2 m intervals (Section 3.2) define what counts as a place; benchmark results depend on this scale.
Submap spacing = 2 m
Submaps generated every 2 m along trajectories; affects submap count and redundancy (Section 3.2).
Max points per submap = 4096
Submaps downsampled to 4096 points and normalized to [-1,1] (Section 3.2); defines input resolution for all methods.
Positive/negative pair thresholds = 15 m / 60 m
Training pairs are positive within 15 m and negative beyond 60 m (Section 3.2); changes training difficulty.
Retrieval success threshold = 30 m
Test retrieval is successful if the retrieved submap center is within 30 m of the query (Section 3.2); reported R@N numbers depend directly on this choice.

assumptions (5)

domain assumption Manual alignment with CloudCompare yields valid cross-phase ground-truth correspondences.
Section 3.2: PLS blocks are manually aligned to MLS point clouds with average error 0.28 m. If alignment is biased in hard scenes, cross-phase retrieval labels are wrong.
domain assumption Retrieval success within 30 m is a meaningful proxy for place recognition performance.
Section 3.2 defines test success at 30 m; this tolerance is standard but is a hand-chosen protocol constant on which all headline numbers depend.
domain assumption Dynamic object removal from PLS but not MLS does not materially bias retrieval.
Section 3.2: dynamic objects are removed from PLS point clouds using Octomap; no symmetric cleanup is described for MLS, so query and map may have different dynamic-object content.
domain assumption Rectangular train/test splitting without a stated buffer does not introduce spatial leakage.
Section 3.2: submaps in specific rectangles form the test set. Without a buffer, test queries near rectangle boundaries could share 30 m positive matches with training submaps.
domain assumption The Oxford evaluation follows a standard benchmark that the reader can reproduce.
Section 4.1 says retrieval is performed on 'testing sets of WHU-PCPR and Oxford' but does not specify the Oxford query/map split or preprocessing, making the Oxford column hard to verify.

how reviews work

0 comments

Cite this review

Pith. "Pith review of WHU-PCPR: A cross-platform heterogeneous point cloud dataset for place recognition in complex urban scenes." pith.science (2026). https://pith.science/paper/FIM333UE

@misc{pith2026260106442,
  author       = {Pith},
  title        = {Pith review of: WHU-PCPR: A cross-platform heterogeneous point cloud dataset for place recognition in complex urban scenes},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/FIM333UE}},
  note         = {Machine review of arXiv:2601.06442}
}

read the original abstract

Point Cloud-based Place Recognition (PCPR) demonstrates considerable potential in applications such as autonomous driving, robot localization and navigation, and map update. In practical applications, point clouds used for place recognition are often acquired from different platforms and LiDARs across varying scene. However, existing PCPR datasets lack diversity in scenes, platforms, and sensors, which limits the effective development of related research. To address this gap, we establish WHU-PCPR, a cross-platform heterogeneous point cloud dataset designed for place recognition. The dataset differentiates itself from existing datasets through its distinctive characteristics: 1) cross-platform heterogeneous point clouds: collected from survey-grade vehicle-mounted Mobile Laser Scanning (MLS) systems and low-cost Portable helmet-mounted Laser Scanning (PLS) systems, each equipped with distinct mechanical and solid-state LiDAR sensors. 2) Complex localization scenes: encompassing real-time and long-term changes in both urban and campus road scenes. 3) Large-scale spatial coverage: featuring 82.3 km of trajectory over a 60-month period and an unrepeated route of approximately 30 km. Based on WHU-PCPR, we conduct extensive evaluation and in-depth analysis of several representative PCPR methods, and provide a concise discussion of key challenges and future research directions. The dataset and benchmark code are available at https://github.com/zouxianghong/WHU-PCPR.

Figures

Figures reproduced from arXiv: 2601.06442 by the authors.

**Figure 2.** Cloud to cloud distance in WHU-PCPR. (a) WHU 1&2 (CS College), (b) WHU 1&2 (Info Campus), (c) Hankou 1&2 (Zhongshan Park), (d) Hankou 1&2 (Jiefang Road 1), (e) WHU 1&3 (CS College), (f) WHU 1&3 (Info Campus), (g) Hankou 1&3 (Zhongshan Park), (h) Hankou 1&3 (Jiefang Road 1). A, B, C, and D are the positional errors of manually selected corresponding points (gray/blue/red: phase 1/2/3). is the first DL-based PCPR meth… view at source ↗

**Figure 3.** Characteristics of WHU-PCPR. 80.70% and 𝑅@1% of 97.05% on Hankou 1&2. However, its performance drops significantly on WHU 1&2, with 𝑅@1 and 𝑅@1% falling to 40.13% and 74.71%, respectively. This decline stems from substantial differences in the shape, quantity, and distribution of surface features across scenes. Hankou road scenes are typically more open, featuring numerous high-rise buildings, elevated structures, … view at source ↗

Figures from the paper (5 more)

**Figure 4.** Figure 4: Recall curves of retrieval baselines on WHU-PCPR. (a) Hankou 1&2, (b) Hankou 1&3, (c) Hankou 2&3, (d) WHU 1&2, (e) WHU 1&3, (f) WHU 2&3. results demonstrate that viewpoint variation poses a significant challeng to PCPR tasks, and this problem cannot be solved or allev…

**Figure 5.** Figure 5: Retrieval results of various baselines with different viewpoints. (a) 𝑅@1 on Hankou 1&2, (b) 𝑅@1% on Hankou 1&2, (c) 𝑅@1 on WHU 1&2, (d) 𝑅@1% on WHU 1&2. the effectiveness of reranking is highly dependent on initial retrieval methods. This is because methods like EgoNN…

**Figure 6.** Figure 6: Recall and precision curves of reranking baselines on WHU-PCPR. (a)/(d) Hankou 1&2, (b)/(e) Hankou 1&3, (c)/(f) Hankou 2&3, (g)/(j) WHU 1&2, (h)/(k) WHU 1&3, (i)/(l) WHU 2&3. domains and handling viewpoint variations. While reranking can effectively enhance initial ret…

**Figure 7.** Figure 7: Success PR cases when using LoGG3DNet for retrieval and SGV for reranking. (a) case 1 on Hankou, (b) case 2 on WHU, (c) case 3 on WHU. Purple represents query, red represents failure, and green represents success. and diverse urban environments, thereby enhancing the p…

**Figure 8.** Figure 8: Bad cases of place recognition (LoGG3DNet and SGV) on WHU-PCPR. (a) case 1, (b) case 2, (c) case 3. References Häne, C., Heng, L., Lee, G.H., Fraundorfer, F., Furgale, P., Sattler, T., Pollefeys, M., 2017. 3d visual perception for self-driving cars using a multi-camera…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

2 extracted references · 1 linked inside Pith

[2013]

Springer US

Octomap: an efficient probabilistic 3d mapping framework based on octrees. Springer US . Zhang,W.,Qi,J.,Wan,P.,Wang,H.,Yan,G.,2016.Aneasy-to-useairborne lidar data filtering method based on cloth simulation. Remote Sensing 8, 501. Kim,G.,Choi,S.,Kim,A.,2021. Scancontext++:Structuralplacerecog- nition robust to rotation and lateral variations in urban envi...

arXiv 2016
[2024]

ISPRS Journal of Photogrammetry and Remote Sensing 215, 15–30

Look at the whole scene: General point cloud place recognition by classification proxy. ISPRS Journal of Photogrammetry and Remote Sensing 215, 15–30. Radenović,F.,Tolias,G.,Chum,O.,2018. Fine-tuningcnnimageretrieval with no human annotation. IEEE transactions on pattern analysis and machine intelligence 41, 1655–1668. Komorowski,J.,Wysoczanska,M.,Trzcins...

arXiv 2018

Pith tools

Reviewed August 3, 2026 · model on record in the stance chip above.

[1] [2013]

Springer US

Octomap: an efficient probabilistic 3d mapping framework based on octrees. Springer US . Zhang,W.,Qi,J.,Wan,P.,Wang,H.,Yan,G.,2016.Aneasy-to-useairborne lidar data filtering method based on cloth simulation. Remote Sensing 8, 501. Kim,G.,Choi,S.,Kim,A.,2021. Scancontext++:Structuralplacerecog- nition robust to rotation and lateral variations in urban envi...

arXiv 2016

[2] [2024]

ISPRS Journal of Photogrammetry and Remote Sensing 215, 15–30

Look at the whole scene: General point cloud place recognition by classification proxy. ISPRS Journal of Photogrammetry and Remote Sensing 215, 15–30. Radenović,F.,Tolias,G.,Chum,O.,2018. Fine-tuningcnnimageretrieval with no human annotation. IEEE transactions on pattern analysis and machine intelligence 41, 1655–1668. Komorowski,J.,Wysoczanska,M.,Trzcins...

arXiv 2018