REVIEW 4 major objections 8 minor 81 references
SaliencyI2PLoc: saliency-guided image-point cloud localization using contrastive learning
T0 review · 4 major / 8 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read SaliencyI2PLoc claims image-to-point-cloud localization with 78.92% Recall@1 on urban KITTI-360, 37.35 points above a retrained AE-Spherical baseline.
desk verdict Sound architectural idea and honest ablations, but headline gains against an unreproduced retrained baseline means the exact margins are not robust; still worth a serious referee. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is the saliency-weighted NetVLAD layer, an otherwise standard VLAD descriptor in which the soft-assignment residual $\sum_i a_k(f_i)(f_i(j)-c_k(j))$ is multiplied by the attention vector $\mathbf{Attn}$ taken from the final transformer block, so highly attended local patches dominate the global descriptor. The second mechanism is the multi-manifold feature-relation consistency loss, which supervises that pairwise distances between image features match pairwise distances between the corresponding point-cloud features, measured with Euclidean distance and with the hyperbolic distance of the Poincaré ball model, and added to the InfoNCE loss. Together they let the same Transformer backbone process 2D image patches and 3D PointNet-tokenized patches while projecting both modalities into one embedding space.
What would settle it
Run the released code on the same KITTI-360 splits and retrain the AE-Spherical baseline until it reaches the recall values originally published in [10]; if a properly tuned baseline reaches or exceeds the 78.92% Recall@1 reported here, the claimed architecture advantage is disproven.
Extended reading notes
Core claim
The central claim is that cross-modal image-to-point-cloud localization reduces to learning a shared embedding in which a query image and its matching point-cloud submap are nearest neighbours, and that this embedding is best learned by a dual-transformer architecture trained with InfoNCE contrastive loss together with a pair-distance consistency penalty computed in both Euclidean and hyperbolic space. The saliency weight from the last transformer block is multiplied into the NetVLAD residual aggregation, so patches attending to buildings, signs, and other stationary objects contribute more to the global feature than sky, ground, or moving vehicles. On the urban KITTI-360 evaluation subset the method reaches 78.92% Recall@1 and 97.59% Recall@20 at a 20-meter tolerance, gains of 37.35 and 18.07 points over the retrained AE-Spherical baseline, and the authors report comparable parameter counts with slower inference (24.15 FPS versus 84.49 FPS for the baseline).
Load-bearing premise
The 37.35-point margin is measured against the authors' own retrained version of AE-Spherical, whose published results they say they could not reproduce; if that retrained baseline is weaker than the original, the gap is inflated.
Editorial extensions
If this is right
- Contrastive training removes the need to mine hard triplets or quadruplets, so adding new places to the map can be done by retraining on image-point-cloud pairs instead of rebuilding negative sets.
- A model trained on a quarter of the data still reaches 69.28% Recall@1 on urban KITTI-360, suggesting the approach scales with data volume without engineered pair construction.
- At a 20-meter tolerance, the dense urban scenario is effectively solved at 97.59% Recall@20, so the remaining research problem is the highway/open-road case where Recall@1 drops to 30.94%.
- On KITTI's sparse raw LiDAR frames and perspective images, Recall@20 improves to 72.59% versus 63.00% for VXP, indicating some robustness to point-cloud density and field-of-view differences.
- The higher inference cost (24.15 versus 84.49 FPS) means deployment on mobile robots will likely need the proposed flash-attention or distillation speedups.
Reading between the lines
- If the ablation table is the right lens, the single biggest internal jump comes from the contrastive framework replacing triplet mining (SCNN-Contrast at 60.24% versus AE-Spherical at 41.57% Recall@1), while adding saliency weighting and the two relation-consistency terms contributes a further 9.04 points; that ordering suggests the loss function, not the hyperbolic geometry, carries most of the i
- The hyperbolic-consistency term alone adds little in the ablation (65.96% with hyperbolic, 66.27% with Euclidean), so a testable extension is to replace it with a cheaper regularizer, such as distance-distribution alignment, and measure whether Recall@1 holds.
- Because the authors could not reproduce the original AE-Spherical numbers, the 37.35-point headline gap should be read as a comparison to a re-trained baseline; a community benchmark with a fixed public split and released model weights would settle whether the margin persists.
- The same saliency-weighted aggregation could be applied to radar or sonar place recognition, where stationary, reflective structures likewise dominate reliable localization, as a direct transfer of the mechanism beyond images and LiDAR.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper addresses cross-modal global localization from a 2D image to a 3D point-cloud map. The authors propose SaliencyI2PLoc, a dual-tower architecture in which a Vision Transformer (ViT) encodes the image and a PointNet-plus-Transformer tokenizer encodes the point cloud. The local patch features are aggregated by a NetVLAD layer that is weighted by self-attention-derived saliency scores. The network is trained end-to-end with an InfoNCE contrastive loss plus a multi-manifold feature relation consistency loss that enforces agreement between image-pair and point-cloud-pair relations in Euclidean (dot-product) and hyperbolic spaces. Experiments on KITTI-360 (urban and highway) and KITTI report Recall@N and F1 metrics, claiming a Recall@1 of 78.92% on the urban evaluation set, an improvement of 37.35 percentage points over a retrained AE-Spherical baseline. Ablation studies show that each proposed component contributes to performance on a quarter of the training data.
Significance. The paper proposes a clean, end-to-end contrastive framework that avoids explicit triplet mining, integrates saliency-aware aggregation into NetVLAD, and augments the loss with relation consistency in multiple manifolds. The ablations and qualitative visualizations provide initial evidence that each component helps. The reported gains on KITTI-360 are substantial if the comparison baseline is properly tuned. However, the headline improvement is measured against a retrained AE-Spherical baseline that the authors themselves could not reproduce from the original settings, so the exact magnitude of the improvement remains uncertain. The paper also promises to release code and the dataset generation pipeline, which would significantly enhance reproducibility. The method's applicability to highway scenes is weaker, but the open-scenario discussion is balanced.
major comments (4)
- [Section 4.3, Table 2] The central claim of a 37.35 pp Recall@1 improvement on urban scenes is calculated against the retrained AE-Spherical baseline (R1 41.57), but the authors' own estimate of the published AE-Spherical result is R1 46.23 (AE-Spherical*). The paper states that the original results "could not be reproduced following their training settings," yet it provides no analysis of this discrepancy, no variance over multiple training runs, and no release of baseline checkpoints. This makes the magnitude of the claimed improvement unsupported. Please report the comparison against the published numbers (or the AE-Spherical* estimates), provide training details for the retrained baseline (epochs, LR schedule, data splits, augmentations), and include error bars over at least three runs on the 332-query evaluation set.
- [Section 3.3, Eq. (16)] The text in Section 3.3 says that D_euc is the Euclidean distance between features, but the sentence after Eq. (16) states "D_euc represent the dot product." These are contradictory. The dot product is a similarity, not a distance, and the MSE between dot products and hyperbolic distances (which are metrics with different scales) is not a standard consistency measure. Please specify exactly which quantity is used in the implementation, and adjust the terminology accordingly (e.g., "cosine similarity consistency" instead of "Euclidean distance").
- [Section 4.5, Table 5] The ablation study is run on a 1/4 subset of the training pairs, while the main results are obtained on the full dataset. The contribution of the saliency and relation-consistency components may change with dataset scale (the full model gains ~10 pp R1 over the 1/4 model). To support the claim that the proposed components are effective, please run the ablation on the full dataset or explicitly justify the proxy.
- [Section 3.2] The saliency score Attn used in Eq. (8) is not uniquely defined. For images, ViT produces a multi-head attention matrix among N+1 tokens (including the class token), and for point clouds there is no class token. Please provide the exact formula for computing the per-token scalar saliency (e.g., CLS attention averaged over heads, or mean of attention rows), so that the method is reproducible.
minor comments (8)
- [Abstract and Section 4.4.1] "Improvement of 37.35%" should be rephrased as "37.35 percentage points" to avoid confusion with a relative improvement.
- [Table 2] For AE-Spherical*, the Max F1 column contains "***"; replace with "n/a" or a value, as the current notation is unexplained.
- [Section 4.1.1] The statement that "there are no publicly available datasets for cross-modality global localization tasks" is overstated. Consider citing existing cross-modal place recognition benchmarks or limiting the claim to the specific image-panorama-to-submap setting.
- [Section 4.4.1] The highway-scenario results show that LIP-Loc (an image-projection method) outperforms the proposed method. The paper discusses this as a limitation of feature-based methods in structureless areas, but the reader would benefit from a quantitative analysis (e.g., how the proposed method's point cloud branch fails in these scenes).
- [Section 4.6] The reported inference speed (24.15 FPS vs 84.49 FPS for AE-Spherical) is a substantial deployment concern. Please mention this trade-off in the abstract or conclusions.
- [Eq. (8)] The multiplication "Attn·a_k(f_i)" should be indexed as Attn_i to clarify that it is a per-local-feature scalar.
- [Section 3.1.1] The equations for the Transformer blocks (Eqs. (2)-(3)) do not explicitly handle the class token; add a sentence clarifying how the class token is processed and whether it is used in the saliency computation.
- [Section 4.2] The statement "we froze the Transformer blocks except for the last 4 blocks" refers to the image branch; clarify whether the point cloud Transformer is trained from scratch and whether any other components are frozen.
Circularity Check
No significant circularity: the method's recall gains are measured on held-out data against external and retrained baselines, and no prediction reduces by construction to a fitted input or self-citation chain.
full rationale
SaliencyI2PLoc's derivation chain is self-contained. The global features are produced by Eqs. (8)-(10) as a saliency-weighted NetVLAD aggregation, with the attention weights taken from the last Transformer block rather than from the evaluation labels; the saliency map is an internal, learned weighting, not a fitted copy of the Recall@N targets. The training objective in Eq. (17) combines InfoNCE (Eq. 11) with the relation-consistency loss (Eq. 16), and the evaluation metric Recall@N (Eq. 19) is computed on a held-out query set (Table 1) using a 20 m Euclidean threshold. None of these quantities is defined in terms of the Recall@N numbers reported in Section 4.4.1, so the central claim does not reduce to its own inputs. The paper's own limitation statements concern the retrained AE-Spherical baseline (Section 4.3: 'the results listed in the paper could not be reproduced following their training settings') and higher inference time (Section 4.6); these bear on the magnitude and cost of the reported improvement, not on circularity. Self-citations such as references [2] and [33] are contextual and are not used to justify the uniqueness or correctness of the proposed loss or architecture. The comparison also includes the independent LIP-Loc baseline and VXP numbers on KITTI, so the method is not validated solely against a baseline produced by the same authors.
Assumptions & free parameters
free parameters (6)
- lambda (λ) =
1
- beta (β) =
2.0
- InfoNCE temperature (τ) =
0.07
- Number of 3D tokens =
3072
- VLAD cluster count K =
64
- Global descriptor dimension D_g =
256
assumptions (5)
- domain assumption Self-attention weights from the last Transformer block are a valid saliency signal for localization-relevant scene content.
- domain assumption Relative distances between samples should be consistent across image and point cloud modalities in both Euclidean and Hyperbolic spaces.
- domain assumption Features can be mapped into the Poincaré ball via the exponential map without explicit norm clipping or curvature tuning.
- domain assumption The retrained AE-Spherical baseline is a fair and faithful implementation of Zhao et al. [10].
- domain assumption KITTI-360 fisheye stitching using FFMPEG produces panoramic images that are correctly aligned with the point cloud submaps.
Cite this review
Pith. "Pith review of SaliencyI2PLoc: saliency-guided image-point cloud localization using contrastive learning." pith.science (2026). https://pith.science/paper/UQ3J6AYB
@misc{pith2026241215577,
author = {Pith},
title = {Pith review of: SaliencyI2PLoc: saliency-guided image-point cloud localization using contrastive learning},
year = {2026},
howpublished = {\url{https://pith.science/paper/UQ3J6AYB}},
note = {Machine review of arXiv:2412.15577}
}
read the original abstract
Image to point cloud global localization is crucial for robot navigation in GNSS-denied environments and has become increasingly important for multi-robot map fusion and urban asset management. The modality gap between images and point clouds poses significant challenges for cross-modality fusion. Current cross-modality global localization solutions either require modality unification, which leads to information loss, or rely on engineered training schemes to encode multi-modality features, which often lack feature alignment and relation consistency. To address these limitations, we propose, SaliencyI2PLoc, a novel contrastive learning based architecture that fuses the saliency map into feature aggregation and maintains the feature relation consistency on multi-manifold spaces. To alleviate the pre-process of data mining, the contrastive learning framework is applied which efficiently achieves cross-modality feature mapping. The context saliency-guided local feature aggregation module is designed, which fully leverages the contribution of the stationary information in the scene generating a more representative global feature. Furthermore, to enhance the cross-modality feature alignment during contrastive learning, the consistency of relative relationships between samples in different manifold spaces is also taken into account. Experiments conducted on urban and highway scenario datasets demonstrate the effectiveness and robustness of our method. Specifically, our method achieves a Recall@1 of 78.92% and a Recall@20 of 97.59% on the urban scenario evaluation dataset, showing an improvement of 37.35% and 18.07%, compared to the baseline method. This demonstrates that our architecture efficiently fuses images and point clouds and represents a significant step forward in cross-modality global localization. The project page and code will be released.
Figures
Figures from the paper (12 more)
Reference graph
Works this paper leans on
-
[1]
Multi-gnss ppp/ins/vision/lidartightlyintegratedsystemforprecisenavigationin urban environments
Li, S., Li, X., Wang, H., Zhou, Y., Shen, Z., 2023a. Multi-gnss ppp/ins/vision/lidartightlyintegratedsystemforprecisenavigationin urban environments. Information Fusion 90, 218–232. doi:10.1016/ j.inffus.2022.09.018
2022
-
[2]
Li, Y., Zou, X., Li, T., Sun, S., Wang, Y., Liang, F., Li, J., Yang, B., Dong, Z., 2023b. Mucograph: A multi-scale constraint enhanced pose-graph framework for mls point cloud inconsistency correction. ISPRS Journal of Photogrammetry and Remote Sensing 204, 421–
-
[3]
Yuan,J.,Zhang,J.,Ding,S.,Dong,X.,2017.Cooperativelocalization for disconnected sensor networks and a mobile robot in friendly environments. Information Fusion 37, 22–36. doi:10.1016/j.inffus. 2017.01.001
doi:10.1016/j.inffus 2017
-
[4]
Fail-safe multi-modal localization frame- workusingheterogeneousmap-matchingsources
Lee, S., Seo, S.W., 2022. Fail-safe multi-modal localization frame- workusingheterogeneousmap-matchingsources. IEEETransactions on Intelligent Transportation Systems 23, 4008–4020. doi:10.1109/ TITS.2020.3038441
arXiv 2022
-
[5]
Automaticmap update using dashcam videos
Zhanabatyrova,A.,SouzaLeite,C.F.,Xiao,Y.,2023. Automaticmap update using dashcam videos. IEEE Internet of Things Journal 10, 11825–11843. doi:10.1109/JIOT.2023.3244693
-
[6]
A survey on monocular re-localization: From the perspective of scene map representation
Miao, J., Jiang, K., Wen, T., Wang, Y., Jia, P., Wijaya, B., Zhao, X., Cheng, Q., Xiao, Z., Huang, J., Zhong, Z., Yang, D., 2024. A survey on monocular re-localization: From the perspective of scene map representation. IEEE Transactions on Intelligent Vehicles , 1– 33doi:10.1109/TIV.2024.3378716
-
[7]
Brain-inspired multimodal hybrid neural network for robot place recognition
Yu, F., Wu, Y., Ma, S., Xu, M., Li, H., Qu, H., Song, C., Wang, T., Zhao, R., Shi, L., 2023. Brain-inspired multimodal hybrid neural network for robot place recognition. Science Robotics 8, eabm6996. doi:10.1126/scirobotics.abm6996
-
[8]
Huang,Z.,Sun,S.,Zhao,J.,Mao,L.,2023.Multi-modalpolicyfusion for end-to-end autonomous driving. Information Fusion 98, 101834. doi:10.1016/j.inffus.2023.101834
arXiv 2023
Show all 81 references
-
[9]
Hcto: Optimality-awarelidarinertialodometrywithhybridcontinuoustime optimization for compact wearable mapping system
Li,J.,Yuan,S.,Cao,M.,Nguyen,T.M.,Cao,K.,Xie,L.,2024. Hcto: Optimality-awarelidarinertialodometrywithhybridcontinuoustime optimization for compact wearable mapping system. ISPRS Journal of Photogrammetry and Remote Sensing 211, 228–243. doi:10.1016/ j.isprsjprs.2024.04.004
2024
-
[10]
Attention- Enhanced Cross-modal Localization Between Spherical Images and Point Clouds
Zhao, Z., Yu, H., Lyu, C., Yang, W., Scherer, S., 2023. Attention- Enhanced Cross-modal Localization Between Spherical Images and Point Clouds. IEEE Sensors Journal , 1–1doi: 10.1109/JSEN.2023. 3306377
2023 doi
-
[12]
Yin,P.,Xu,L.,Zhang,J.,Choset,H.,Scherer,S.,2021.i3dloc:Image- to-rangecross-domainlocalizationrobusttoinconsistentenvironmen- talconditions,in:ProceedingsofRobotics:ScienceandSystems(RSS ’21), Robotics: Science and Systems 2021
2021
-
[13]
Zheng, S., Li, Y., Yu, Z., Yu, B., Cao, S.Y., Wang, M., Xu, J., Ai, R., Gu, W., Luo, L., Shen, H.L., 2023. I2p-rec: Recognizing images on large-scale point cloud maps through bird’s eye view projections, in: 2023 IEEE/RSJ International Conference on Intelligent Robots and Syst...
2023
-
[14]
(lc)2: Lidar- camera loop constraints for cross-modal place recognition
Lee, A.J., Song, S., Lim, H., Lee, W., Myung, H., 2023. (lc)2: Lidar- camera loop constraints for cross-modal place recognition. IEEE Robotics and Automation Letters , 1–8doi:10.1109/LRA.2023.3268848
2023
-
[15]
Modalink: Unifying modalities for efficient image-to-pointcloud place recognition
Xie, W., Luo, L., Ye, N., Ren, Y., Du, S., Wang, M., Xu, J., Ai, R., Gu, W., Chen, X., 2024. Modalink: Unifying modalities for efficient image-to-pointcloud place recognition. doi:10.48550/arXiv. 2403.18762, arXiv:2403.18762
-
[16]
Cattaneo,D.,Vaghi,M.,Fontana,S.,Ballardini,A.L.,Sorrenti,D.G.,
- [17]
-
[18]
Allaboutvlad,in:2013IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp
Arandjelovic,R.,Zisserman,A.,2013. Allaboutvlad,in:2013IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1578–1585. doi:10.1109/CVPR.2013.207
2013 doi
-
[19]
Netvlad:Cnnarchitectureforweaklysupervisedplacerecognition,in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp
Arandjelovic, R., Gronat, P., Torii, A., Pajdla, T., Sivic, J., 2016. Netvlad:Cnnarchitectureforweaklysupervisedplacerecognition,in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5297–5307. doi:10.1109/CVPR.2016.572
2016 doi
-
[20]
Fine-tuning cnn image retrieval with no human annotation
Radenovic, F., Tolias, G., Chum, O., 2019. Fine-tuning cnn image retrieval with no human annotation. IEEE Transactions on Pattern Analysis and Machine Intelligence 41, 1655–1668. doi: 10.1109/ TPAMI.2018.2846566
2019
-
[21]
Hausler, S., Garg, S., Xu, M., Milford, M., Fischer, T., 2021. Patch- netvlad: Multi-scale fusion of locally-global descriptors for place recognition,in:2021IEEE/CVFConferenceonComputerVisionand PatternRecognition(CVPR),IEEE,Nashville,TN,USA.pp.14136– 14147. doi:10.1109/CVPR46...
2021
-
[23]
IEEE Transactions on Circuits and Systems for Video Technology 33, 1109–1122
Wang,Y.,Qiu,Y.,Cheng,P.,Zhang,J.,2023.Hybridcnn-transformer features for visual place recognition. IEEE Transactions on Circuits and Systems for Video Technology 33, 1109–1122. doi:10.1109/ TCSVT.2022.3212434
2023
-
[24]
Imagepatch-matchingwithgraph-based learninginstreetscenes
She, R., Kang, Q., Wang, S., Tay, W.P., Guan, Y.L., Navarro, D.N., Hartmannsgruber,A.,2023. Imagepatch-matchingwithgraph-based learninginstreetscenes. IEEETransactionsonImageProcessing32, 3465–3480. doi:10.1109/TIP.2023.3281171
2023
-
[26]
Information fusion in content based image retrieval: A comprehensive overview
Piras, L., Giacinto, G., 2017. Information fusion in content based image retrieval: A comprehensive overview. Information Fusion 37, 50–60. doi:10.1016/j.inffus.2017.01.003
2017 doi
-
[27]
19370–19380
Zhu,S.,Yang,L.,Chen,C.,Shah,M.,Shen,X.,Wang,H.,.R2former: Unified retrieval and reranking transformer for place recognition, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 19370–19380. doi:10.1109/CVPR52729.2023. 01856. : Preprint su...
-
[28]
Placeformer: Transformer-based visual place recognition using multi-scale patch selection and fusion
Kannan, S.S., Min, B.C., 2024. Placeformer: Transformer-based visual place recognition using multi-scale patch selection and fusion. IEEE Robotics and Automation Letters 9, 6552–6559. doi:10.1109/ LRA.2024.3408075
2024
-
[29]
Global features are all you need for image retrieval and reranking, in: 2023 IEEE/CVF International Conference on Computer Vision (ICCV), pp
Shao, S., Chen, K., Karpur, A., Cui, Q., Araujo, A., Cao, B., 2023. Global features are all you need for image retrieval and reranking, in: 2023 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 11002–11012. doi:10.1109/ICCV51070.2023.01013
2023
-
[30]
Optimal transport aggregation for visual place recognition, in: 2024 IEEE/CVF Conference on Com- puter Vision and Pattern Recognition (CVPR), pp
Izquierdo, S., Civera, J., 2024. Optimal transport aggregation for visual place recognition, in: 2024 IEEE/CVF Conference on Com- puter Vision and Pattern Recognition (CVPR), pp. 17658–17668. doi:10.1109/CVPR52733.2024.01672
2024
-
[31]
Towards seamless adaptation of pre-trained models for visual place recognition, in: The Twelfth International Conference on Learning Representations
Lu, F., Zhang, L., Lan, X., Dong, S., Wang, Y., Yuan, C., 2024. Towards seamless adaptation of pre-trained models for visual place recognition, in: The Twelfth International Conference on Learning Representations
2024
-
[32]
Anyloc: Towards universal visual place recognition
Keetha,N.,Mishra,A.,Karhade,J.,Jatavallabhula,K.M.,Scherer,S., Krishna, M., Garg, S., 2024. Anyloc: Towards universal visual place recognition. IEEE Robotics and Automation Letters 9, 1286–1293. doi:10.1109/LRA.2023.3343602
2024
-
[33]
Wang, H., Liu, Y., Wang, B., Sun, Y., Dong, Z., Wang, W., Yang, B., 2023. Freereg: Image-to-point cloud registration leveraging pretrained diffusion models and monocular depth estimators, in: The Twelfth International Conference on Learning Representations
2023
-
[34]
Kim, G., Kim, A., 2018. Scan context: Egocentric spatial descriptor for place recognition within 3d point cloud map, in: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, Madrid. pp. 4802–4809. doi:10.1109/IROS.2018.8593953
2018
-
[35]
Pointnetvlad: Deep point cloud based retrieval for large-scale place recognition, in: 2018 IEEE/CVF Con- ferenceonComputerVisionandPatternRecognition,pp.4470–4479
Uy, M.A., Lee, G.H., 2018. Pointnetvlad: Deep point cloud based retrieval for large-scale place recognition, in: 2018 IEEE/CVF Con- ferenceonComputerVisionandPatternRecognition,pp.4470–4479. doi:10.1109/CVPR.2018.00470
2018
-
[36]
PointNet: DeepLearningonPointSetsfor3DClassificationandSegmentation, in:2017IEEEConferenceonComputerVisionandPatternRecogni- tion (CVPR), pp
Charles, R.Q., Su, H., Kaichun, M., Guibas, L.J., 2017. PointNet: DeepLearningonPointSetsfor3DClassificationandSegmentation, in:2017IEEEConferenceonComputerVisionandPatternRecogni- tion (CVPR), pp. 77–85. doi:10.1109/CVPR.2017.16
2017 doi
-
[37]
Zhou, Z., Zhao, C., Adolfsson, D., Su, S., Gao, Y., Duckett, T., Sun, L., 2021. Ndt-transformer: Large-scale 3d point cloud localisation usingthenormaldistributiontransformrepresentation,in:2021IEEE International Conference on Robotics and Automation (ICRA), pp. 5654–5660. doi...
2021
-
[38]
Lpd-net: 3d point cloud learning for large-scale place recognition and environment analysis, in: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp
Liu, Z., Zhou, S., Suo, C., Yin, P., Chen, W., Wang, H., Li, H., Liu, Y., 2019. Lpd-net: 3d point cloud learning for large-scale place recognition and environment analysis, in: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 2831–
2019
-
[39]
Zhang, W., Xiao, C., 2019. Pcan: 3d attention map learning us- ing contextual information for point cloud based retrieval, in: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, Long Beach, CA, USA. pp. 12428–12437. doi:10. 1109/CVPR.2019.01272
2019
-
[40]
Hui, L., Yang, H., Cheng, M., Xie, J., Yang, J., 2021. Pyramid point cloud transformer for large-scale place recognition, in: 2021 IEEE/CVF International Conference on Computer Vision (ICCV), IEEE,Montreal,QC,Canada.pp.6078–6087.doi: 10.1109/ICCV48922. 2021.00604
2021
-
[41]
HiTPR:HierarchicalTrans- former for Place Recognition in Point Cloud, in: 2022 International Conference on Robotics and Automation (ICRA), pp
Hou,Z.,Yan,Y.,Xu,C.,Kong,H.,2022. HiTPR:HierarchicalTrans- former for Place Recognition in Point Cloud, in: 2022 International Conference on Robotics and Automation (ICRA), pp. 2612–2618. doi:10.1109/ICRA46639.2022.9811737
2022
-
[42]
Spectral Geometric Verification: Re-Ranking Point Cloud Retrieval for Metric Localization
Vidanapathirana, K., Moghadam, P.,Sridharan, S., Fookes, C., 2023. Spectral Geometric Verification: Re-Ranking Point Cloud Retrieval for Metric Localization. IEEE Robotics and Automation Letters 8, 2494–2501. doi:10.1109/LRA.2023.3255560
2023
-
[43]
Rank- pointretrieval: Reranking point cloud retrieval via a visually consis- tent registration evaluation
Zhang, W., Zhou, H., Dong, Z., Yan, Q., Xiao, C., 2023. Rank- pointretrieval: Reranking point cloud retrieval via a visually consis- tent registration evaluation. IEEE Transactions on Visualization and Computer Graphics 29, 3840–3854. doi:10.1109/TVCG.2022.3170695
2023
-
[44]
Minkloc3d: Point cloud based large-scale place recognition, in: 2021 IEEE Winter Conference on Applica- tions of Computer Vision (WACV), pp
Komorowski, J., 2021. Minkloc3d: Point cloud based large-scale place recognition, in: 2021 IEEE Winter Conference on Applica- tions of Computer Vision (WACV), pp. 1789–1798. doi:10.1109/ WACV48630.2021.00183
2021
-
[45]
CVTNet: A Cross- View Transformer Network for LiDAR-Based Place Recognition in AutonomousDrivingEnvironments
Ma, J., Xiong, G., Xu, J., Chen, X., 2023. CVTNet: A Cross- View Transformer Network for LiDAR-Based Place Recognition in AutonomousDrivingEnvironments. IEEETransactionsonIndustrial Informatics , 1–10doi:10.1109/TII.2023.3313635
2023
-
[46]
Spherevlad++:Attention- based and signal-enhanced viewpoint invariant descriptor
Zhao,S.,Yin,P.,Yi,G.,Scherer,S.,2023. Spherevlad++:Attention- based and signal-enhanced viewpoint invariant descriptor. IEEE Robotics and Automation Letters 8, 256–263. doi:10.1109/LRA.2022. 3223555
2023 doi
-
[47]
PIC-Net: Point cloud and imagecollaborationnetworkforlarge-scaleplacerecognition
Lu, Y., Yang, F., Chen, F., Xie, D., 2020. PIC-Net: Point cloud and imagecollaborationnetworkforlarge-scaleplacerecognition. CoRR abs/2008.00658. arXiv:2008.00658
2020 arXiv
-
[48]
DeepResidualLearningfor Image Recognition, in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp
He,K.,Zhang,X.,Ren,S.,Sun,J.,2016. DeepResidualLearningfor Image Recognition, in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778. doi:10.1109/CVPR. 2016.90, arXiv:1512.03385
2016 arXiv
-
[49]
Pan, Y., Xu, X., Li, W., Cui, Y., Wang, Y., Xiong, R., 2021. Coral: Colored structural representation for bi-modal place recognition, in: 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, Prague, Czech Republic. pp. 2084–2091. doi:10.1109/I...
2021
-
[50]
AdaFusion:Visual-LiDARFusion With Adaptive Weights for Place Recognition
Lai,H.,Yin,P.,Scherer,S.,2022. AdaFusion:Visual-LiDARFusion With Adaptive Weights for Place Recognition. IEEE Robotics and Automation Letters 7, 12038–12045. doi:10.1109/LRA.2022.3210880
2022
-
[51]
MMDF:Multi- Modal Deep Feature Based Place Recognition of Mobile Robots With Applications on Cross-Scene Navigation
Yu,X.,Zhou,B.,Chang,Z.,Qian,K.,Fang,F.,2022. MMDF:Multi- Modal Deep Feature Based Place Recognition of Mobile Robots With Applications on Cross-Scene Navigation. IEEE Robotics and Automation Letters 7, 6742–6749. doi:10.1109/LRA.2022.3176731
2022
-
[52]
Mff-pr: Point cloud and image multi- modal feature fusion for place recognition, in: 2022 IEEE Interna- tional Symposium on Mixed and Augmented Reality (ISMAR), pp
Liu, W., Fei, J., Zhu, Z., 2022. Mff-pr: Point cloud and image multi- modal feature fusion for place recognition, in: 2022 IEEE Interna- tional Symposium on Mixed and Augmented Reality (ISMAR), pp. 647–655. doi:10.1109/ISMAR55827.2022.00082
2022
-
[53]
LCPR: A Multi-Scale Attention-Based LiDAR-Camera Fusion Network for Place Recogni- tion
Zhou, Z., Xu, J., Xiong, G., Ma, J., 2023. LCPR: A Multi-Scale Attention-Based LiDAR-Camera Fusion Network for Place Recogni- tion. IEEE Robotics and Automation Letters 9, 1342–1349. doi:10. 1109/LRA.2023.3346753
2023
-
[54]
Camera-lidar fusion with la- tentcorrelationforcross-sceneplacerecognition
Pan, Y., Xie, J., Wu, J., Zhou, B., 2024. Camera-lidar fusion with la- tentcorrelationforcross-sceneplacerecognition. IEEETransactions on Industrial Electronics , 1–9doi:10.1109/TIE.2024.3440470
2024
-
[55]
Cross fusion of point cloud and learned image for loop closure detection
Yue, H., Cao, D., Liu, Z., Wang, T., Chen, W., 2024. Cross fusion of point cloud and learned image for loop closure detection. IEEE Robotics and Automation Letters 9, 2965–2972. doi:10.1109/LRA. 2024.3362681
2024
-
[56]
Distilvpr: Cross-modal knowledge distillation for visual placerecognition
Wang, S., She, R., Kang, Q., Jian, X., Zhao, K., Song, Y., Tay, W.P., 2024. Distilvpr: Cross-modal knowledge distillation for visual placerecognition. ProceedingsoftheAAAIConferenceonArtificial Intelligence 38, 10377–10385. doi:10.1609/aaai.v38i9.28905
2024 doi
- [57]
-
[58]
Learning Transferable Visual Models From Nat- ural Language Supervision, in: Proceedings of the 38th International Conference on Machine Learning, PMLR
Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agar- wal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., Krueger, G., Sutskever, I., 2021. Learning Transferable Visual Models From Nat- ural Language Supervision, in: Proceedings of the 38th International Confere...
2021
-
[59]
Ermolov,A.,Mirvakhabova,L.,Khrulkov,V.,Sebe,N.,Oseledets,I.,
-
[60]
Hyper- bolic deep neural networks: A survey
Peng, W., Varanka, T., Mostafa, A., Shi, H., Zhao, G., 2022. Hyper- bolic deep neural networks: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 10023–10044. doi:10.1109/ TPAMI.2021.3136921. : Preprint submitted to Elsevier Page 16 of 17
2022
-
[62]
Attention is all you need, in: Proceedings of the 31st International Conference on Neural Infor- mation Processing Systems, Curran Associates Inc
Vaswani,A.,Shazeer,N.,Parmar,N.,Uszkoreit,J.,Jones,L.,Gomez, A.N., Kaiser, Å., Polosukhin, I., . Attention is all you need, in: Proceedings of the 31st International Conference on Neural Infor- mation Processing Systems, Curran Associates Inc.. pp. 6000–6010. doi:10.5555/32952...
-
[63]
Self-supervised image denoising for real-world images with context-aware transformer
Zhang, D., Zhou, F., 2023. Self-supervised image denoising for real-world images with context-aware transformer. IEEE Access 11, 14340–14349. doi:10.1109/ACCESS.2023.3243829
2023
-
[64]
Highdynamic rangeimaging with context-aware transformer, in: 2023 International Joint Conference onNeuralNetworks(IJCNN),pp.1–8
Zhou, F.,Fu, Z.,Zhang, D.,2023. Highdynamic rangeimaging with context-aware transformer, in: 2023 International Joint Conference onNeuralNetworks(IJCNN),pp.1–8. doi: 10.1109/IJCNN54540.2023. 10191491
2023
-
[65]
Cross-modality attentive feature fusion for object detection in multispectral remote sensing imagery
Fang, Q., Wang, Z., 2022. Cross-modality attentive feature fusion for object detection in multispectral remote sensing imagery. Pattern Recognition , 108786doi:10.1016/j.patcog.2022.108786
2022
-
[66]
Hidformer: Hierarchical dual-tower transformer using multi-scale mergence for long-term time series forecasting
Liu, Z., Cao, Y., Xu, H., Huang, Y., He, Q., Chen, X., Tang, X., Liu, X., 2024. Hidformer: Hierarchical dual-tower transformer using multi-scale mergence for long-term time series forecasting. Expert Systems with Applications 239, 122412. doi:10.1016/j.eswa.2023. 122412
2024 doi
-
[68]
Multimodal Earth observation data fusion: Graph-based approach in shared latent space
Arun,P.,Sadeh,R.,Avneri,A.,Tubul,Y.,Camino,C.,Buddhiraju,K., Porwal, A., Lati, R., Zarco-Tejada, P., Peleg, Z., Herrmann, I., 2022. Multimodal Earth observation data fusion: Graph-based approach in shared latent space. Information Fusion 78, 20–39. doi:10.1016/j. inffus.2021.09.004
2022 doi
-
[69]
Facenet: A unified embedding for face recognition and clustering, in: 2015 IEEE Con- ference on Computer Vision and Pattern Recognition (CVPR), pp
Schroff, F., Kalenichenko, D., Philbin, J., 2015. Facenet: A unified embedding for face recognition and clustering, in: 2015 IEEE Con- ference on Computer Vision and Pattern Recognition (CVPR), pp. 815–823. doi:10.1109/CVPR.2015.7298682
2015
-
[70]
Kppr: Ex- ploiting momentum contrast for point cloud-based place recognition
Wiesmann, L., Nunes, L., Behley, J., Stachniss, C., 2023. Kppr: Ex- ploiting momentum contrast for point cloud-based place recognition. IEEERoboticsandAutomationLetters8,592–599. doi: 10.1109/LRA. 2022.3228174
2023
-
[71]
Deep visual geo-localization benchmark, in: 2022IEEE/CVFConferenceonComputerVisionandPatternRecog- nition (CVPR), pp
Berton, G., Mereu, R., Trivigno, G., Masone, C., Csurka, G., Sattler, T., Caputo, B., 2022. Deep visual geo-localization benchmark, in: 2022IEEE/CVFConferenceonComputerVisionandPatternRecog- nition (CVPR), pp. 5386–5397. doi:10.1109/CVPR52688.2022.00532
2022
-
[72]
Decoupled-and-coupled networks: Self-supervised hyperspectral im- age super-resolution with subpixel fusion
Hong, D., Yao, J., Li, C., Meng, D., Yokoya, N., Chanussot, J., 2023. Decoupled-and-coupled networks: Self-supervised hyperspectral im- age super-resolution with subpixel fusion. IEEE Transactions on Geoscience and Remote Sensing 61, 1–12. doi:10.1109/TGRS.2023. 3324497
2023 doi
-
[73]
Lip-loc: Lidar image pretraining for cross-modal localization, in: ProceedingsoftheIEEE/CVFWinterConferenceonApplicationsof Computer Vision (WACV) Workshops, pp
Shubodh,S.,Omama,M.,Zaidi,H.,Parihar,U.S.,Krishna,M.,2024. Lip-loc: Lidar image pretraining for cross-modal localization, in: ProceedingsoftheIEEE/CVFWinterConferenceonApplicationsof Computer Vision (WACV) Workshops, pp. 948–957
2024
-
[74]
An image is worth 16x16 words: Transformers for image recognition at scale, in: International Conference on Learning Representations
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., Uszkoreit, J., Houlsby, N., 2023. An image is worth 16x16 words: Transformers for image recognition at scale, in: International Conferenc...
2023
- [75]
-
[76]
Poincaréembeddingsforlearninghierar- chicalrepresentations,in:AdvancesinNeuralInformationProcessing Systems, Curran Associates, Inc
Nickel,M.,Kiela,D.,2017. Poincaréembeddingsforlearninghierar- chicalrepresentations,in:AdvancesinNeuralInformationProcessing Systems, Curran Associates, Inc
2017
-
[77]
Kitti-360: A novel dataset and benchmarks for urban scene understanding in 2d and 3d
Liao, Y., Xie, J., Geiger, A., 2023. Kitti-360: A novel dataset and benchmarks for urban scene understanding in 2d and 3d. IEEE TransactionsonPatternAnalysisandMachineIntelligence45,3292–
2023
-
[78]
Arewereadyforautonomous driving? the kitti vision benchmark suite, in: 2012 IEEE Conference onComputerVisionandPatternRecognition,pp.3354–3361
Geiger,A.,Lenz,P.,Urtasun,R.,2012. Arewereadyforautonomous driving? the kitti vision benchmark suite, in: 2012 IEEE Conference onComputerVisionandPatternRecognition,pp.3354–3361. doi: 10. 1109/CVPR.2012.6248074
2012
-
[79]
Mapillary street-level sequences: A dataset for lifelong place recognition, in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp
Warburg,F.,Hauberg,S.,Lopez-Antequera,M.,Gargallo,P.,Kuang, Y., Civera, J., 2020. Mapillary street-level sequences: A dataset for lifelong place recognition, in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2623–2632. doi:10.1109/CVPR42600.2020.00270
2020
-
[80]
Evaluation of object proposals and convnet features for landmark-based visual place recognition
Hou, Y., Zhang, H., Zhou, S., 2018. Evaluation of object proposals and convnet features for landmark-based visual place recognition. Journal of Intelligent & Robotic Systems 92, 505–520. doi:10.1007/ s10846-017-0735-y
2018
-
[81]
Visualizing data using t-sne
van der Maaten, L., Hinton, G., 2008. Visualizing data using t-sne. Journal of Machine Learning Research 9, 2579–2605
2008
-
[82]
Flashatten- tion:Fastandmemory-efficientexactattentionwithio-awareness,in: Koyejo,S.,Mohamed,S.,Agarwal,A.,Belgrave,D.,Cho,K.,Oh,A
Dao, T., Fu, D., Ermon, S., Rudra, A., Ré, C., 2022. Flashatten- tion:Fastandmemory-efficientexactattentionwithio-awareness,in: Koyejo,S.,Mohamed,S.,Agarwal,A.,Belgrave,D.,Cho,K.,Oh,A. (Eds.), Advances in Neural Information Processing Systems, Curran Associates, Inc.. pp. 1634...
2022
-
[441]
doi:10.1016/j.isprsjprs.2023.09.018
2023 doi
-
[2020]
4365–4371
Global visual localization in lidar-maps through shared 2d- 3d embedding space, in: 2020 IEEE International Conference on Robotics and Automation (ICRA), pp. 4365–4371. doi: 10.1109/ ICRA40945.2020.9196859
2020
-
[2840]
doi:10.1109/ICCV.2019.00292
2019
-
[3310]
doi:10.1109/TPAMI.2022.3179507
2022
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.