Using monocular normal maps together with RGB images in a dual-branch fusion network improves cross-view geo-localization to state-of-the-art levels on University-1652 and SUES-200.
Learning Cross-view Geo-localization Embeddings via Dynamic Weighted Decorrelation Regularization
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Cross-view geo-localization aims to spot images of the same location shot from two platforms, e.g., the drone platform and the satellite platform. Existing methods usually focus on optimizing the distance between one embedding with others in the feature space, while neglecting the redundancy of the embedding itself. In this paper, we argue that the low redundancy is also of importance, which motivates the model to mine more diverse patterns. To verify this point, we introduce a simple yet effective regularization, i.e., Dynamic Weighted Decorrelation Regularization (DWDR), to explicitly encourage networks to learn independent embedding channels. As the name implies, DWDR regresses the embedding correlation coefficient matrix to a sparse matrix, i.e., the identity matrix, with dynamic weights. The dynamic weights are applied to focus on still correlated channels during training. Besides, we propose a cross-view symmetric sampling strategy, which keeps the example balance between different platforms. Albeit simple, the proposed method has achieved competitive results on three large-scale benchmarks, i.e., University-1652, CVUSA and CVACT. Moreover, under the harsh circumstance, e.g., the extremely short feature of 64 dimensions, the proposed method surpasses the baseline model by a clear margin.
citation-role summary
citation-polarity summary
fields
cs.CV 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
JRN-Geo: A Joint Perception Network based on RGB and Normal images for Cross-view Geo-localization
Using monocular normal maps together with RGB images in a dual-branch fusion network improves cross-view geo-localization to state-of-the-art levels on University-1652 and SUES-200.