Pith. sign in

REVIEW 4 major objections 4 minor 30 references

Revisiting Feature Alignment for One-stage Object Detection

T0 review · 4 major / 4 minor · reviewed 2026-08-14 · deepseek-v4-flash

Pith's one-line read A one-stage detector's features and anchors can be aligned exactly by reinterpreting convolution as RoIAlign, yielding a plug-in operator that raises COCO mAP to 44.1.

desk verdict The im2col/RoIAlign observation and the RoIConv operator are genuinely neat and the controlled ablation supports them, but the motivating pilot experiment is confounded and the SOTA claim is overstated. read the letter →

arxiv 1908.01570 v1 pith:JKWRZZUY submitted 2019-08-05 cs.CV

classification cs.CV
keywords one-stageobjectdetectionfeaturealignmentRoIConvIAlignim2colanchorboxeslearnedanchorsCOCO
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper argues that one-stage detectors underperform because the features attached to each anchor are not tied to that anchor's actual box: a convolution samples a fixed region around each location, while anchors come in many sizes and shapes. The authors show that im2col—the standard implementation trick behind convolution—is a special case of RoIAlign, so a $h\times w$ convolution on a stride-$S$ feature map is equivalent to an $hS\times wS$ RoIAlign at every location followed by a fully connected layer. From that identity they build RoIConv, a convolution whose sampling offsets are computed in closed form from the anchor box, giving exact feature–anchor alignment with the same computation cost as a vanilla convolution. Wrapped into a fully convolutional detector called AlignDet, with a single learned anchor per location, the method reaches 44.1 mAP on COCO test-dev with a ResNeXt-101 backbone.

What carries the argument

The load-bearing object is the RoIConv operator together with the identity that generates it. The identity, derived by equating the sampling locations of convolution (Equation 1) with those of RoIAlign (Equation 2), says im2col is RoIAlign with a fixed rectangle and convolution is that RoIAlign followed by a fully connected layer. RoIConv then sets the rectangle to the actual anchor box, producing offset maps from Equation 4; the offsets are exact and are generated by a $1\times 1$ convolution and an element-wise addition, so the operator remains fully convolutional and costs the same as ordinary convolution. This machinery does the argument's work because it converts the paper's diagnosis—misalignment—into a directly implemented operation and gives a mathematically guaranteed alignment that learned-offset alternatives lack.

What would settle it

A reader could train the single-scale P4 RetinaNet with a plain $3\times 3$ convolution of the same parameter count in place of RoIConv; if that plain layer recovers most of the 5.0 mAP gain, the gain is capacity-driven, not alignment-driven. Alternatively, compute the IoU between each anchor and the implicit RoI rectangle that RoIConv actually samples on the trained AlignDet; if the mean IoU is not close to 1, the claimed exact alignment fails.

Watch

Extended reading notes

Core claim

The central claim is that the longstanding feature-anchor misalignment in one-stage detectors has a principled fix: define the sampling region of a convolution as the implicit RoIAlign it performs, then shift those sampling points by the difference between that implicit rectangle and the anchor box. Concretely, a $h\times w$ convolution on a feature map of stride $S$ samples positions equivalent to an RoIAlign with a box of size $hS\times wS$ centered at each output location (Equation 3). Since each location is shared by anchors of many scales and aspect ratios, no single implicit rectangle fits them all, and multi-scale pyramids only cover scale. RoIConv replaces the fixed rectangle with the anchor box: the offset for sampling point $(i,j)$ at output location $(X,Y)$ is the closed-form difference between the anchor-aligned sampling location and the convolution sampling location (Equation 4), obtained by a $1\times 1$ convolution plus element-wise addition. The paper then demonstrates the payoff with AlignDet, a fully convolutional detector whose dense proposal module learns a single anchor per location and whose aligned detection module applies RoIConv: it improves over the RetinaNet baseline by 2.2 mAP (ResNet-50) and 2.0 mAP (ResNet-101) on COCO minival, and the full ResNeXt-101 model reaches 44.1 mAP on COCO test-dev.

Load-bearing premise

The paper assumes the 12-point mAP collapse of the single-scale RetinaNet relative to its multi-scale version is caused by feature-anchor misalignment, not by the lost spatial resolution or representational capacity of using one feature level; if the collapse has another cause, RoIConv is still effective but the diagnosis and the principled motivation weaken.

Editorial extensions

If this is right

  • Single-scale one-stage detection is no longer inherently weak: one $3\times 3$ RoIConv layer recovers 5.0 mAP on the P4-only RetinaNet, so alignment is a substantial part of what multi-scale features buy.
  • Learned anchors can replace hand-tuned anchor grids: AlignDet with one learned anchor per location beats RetinaNet's nine anchors by 2.2 mAP (ResNet-50) and 2.0 mAP (ResNet-101) on COCO minival.
  • RoIConv is a cheap drop-in: it costs the same as vanilla convolution, and the $3\times 3$/1024 variant runs about 15% faster than RetinaNet while improving mAP by 1.0.
  • Aligned features improve precise localization: AlignDet reports higher AP@0.75 (46.5 for ResNet-101, 48.9 for ResNeXt-101) than comparable one-stage detectors on COCO test-dev.
  • The full system reaches 44.1 mAP on COCO test-dev with a ResNeXt-101 FPN backbone, improving the strong RetinaNet baseline by 3.3 mAP at comparable speed.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The identity implies every dense convolutional layer has an implicit region of support, so alignment quality for any one-stage detector can be measured by comparing implicit regions with assigned anchors; this could serve as a diagnostic tool for future detector designs.
  • Because RoIConv needs only a per-location box, anchor-free detectors that predict a box shape at each location could adopt the same closed-form offsets, turning their predicted boxes into exact alignment targets rather than heuristics.
  • The paper's failure analysis of learned-offset alignment (classification supervision pulls offsets toward discriminative parts) suggests an auxiliary loss that supervises offsets directly from anchor geometry could strengthen deformable-convolution detectors.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 4 minor

Summary. The paper revisits feature alignment for one-stage object detectors. It establishes a mathematical equivalence between the im2col operator used in convolution and the RoIAlign operator, showing that a h×w convolution on a stride-S feature map is a special case of RoIAlign with an hS×wS box per location (Section 4.1). Based on this, it proposes RoIConv, which computes sampling offsets directly from the anchor box coordinates so that convolutional features are aligned with the corresponding anchors, at no additional learnable parameters beyond a 1×1 offset generation. The proposed AlignDet architecture combines a dense proposal module (DPM) that predicts/refines anchors with an aligned detection module (ADM) that applies RoIConv and then predicts classification and regression. Experiments on COCO show that AlignDet improves over RetinaNet by 2.2/2.1 mAP for ResNet-50/101 and reports 44.1 mAP on test-dev with a ResNeXt-101 backbone. The paper also includes ablations comparing RoIConv with vanilla, deformable, and anchor-guided deformable convolutions at equal parameter count.

Significance. If the technical results hold, the paper makes a useful contribution: a principled, plug-and-play operator that explicitly aligns features with anchors in dense one-stage detectors, with a clean derivation connecting convolution and RoIAlign. The controlled ablation in Table 4 is a genuine strength, showing that RoIConv outperforms alternatives at equal parameter count (36.2 vs. 35.2–35.3 AP). The method is also efficient: the 3×3 RoIConv variant is faster than RetinaNet in Table 6. However, the paper's motivational narrative, based on the single-scale pilot experiment, is not supported by the evidence as presented, and the state-of-the-art claim in the abstract is contradicted by numbers in the paper's own comparison table. These issues require correction before the central claims can be taken at face value.

major comments (4)
  1. [Section 5.2, Table 2] The pilot experiment does not establish that the 12.0 mAP drop of single-scale RetinaNet (32.4 to 20.4) is caused by feature-anchor misalignment. The comparison with Faster R-CNN's C4 model is confounded by multiple factors: (i) the P4-only RetinaNet has no P3 stride-8 feature, which directly explains the AP_s collapse from 17.5 to 7.3; (ii) the FPN feature is 256 channels while Faster R-CNN's C4 is 1024 channels, so capacity also differs; and (iii) one-stage detection is dense over the full image, while Faster R-CNN uses a small number of proposals and RoIAlign, so the operating point is different. Any of these factors could cause a large drop without invoking misalignment. The repair experiment in Table 2 adds a single RoIConv and recovers only 5.0 mAP (20.4 to 25.4), leaving about 7 points of the gap unexplained. A controlled experiment that isolates misalignment—for example, adding an RoIAlign-like alignment to a single-scale one-stage detector while keeping resolution and channel count fixed—is needed to support the causal claim.
  2. [Abstract and Section 5.5, Table 7] The single-scale RoIConv experiment is ambiguous about which anchor is used for alignment. The P4-only RetinaNet as described in Section 3.1 yields anchors of scales {2,4,8,16,32} at stride 16, i.e., five anchors per spatial location, but a single RoIConv output per location can align to at most one anchor box. The paper says 'pre-defined anchors as RoIs' without specifying which of the five anchors is chosen for each location, or how the single aligned feature is shared across the five anchors during classification and regression. This omission makes the experiment difficult to reproduce and weakens the interpretation of the 5.0 mAP recovery as evidence for alignment.
  3. [Section 4.2 and Table 6] The abstract claims 'state-of-the-art mAP of 44.1 on COCO test-dev with ResNeXt-101 backbone,' but Table 7 itself lists CenterNet (Duan et al., 2019) with 44.9 AP using a Hourglass-104 backbone. Even though AlignDet does not use flip test or soft NMS while CenterNet does, the claim as written is factually incorrect. The state-of-the-art statement should be qualified to the specific backbone and experimental conditions, or the comparison table should be updated with contemporaneous methods that may achieve higher AP.
  4. [Section 4.2 and Table 6] The statement in Section 4.2 that RoIConv 'requires no addition computation compared with the vanilla convolution' is misleading. Offsets are generated via a 1×1 convolution and an element-wise addition, which themselves add parameters and FLOPs, and the actual sampling at non-integer locations incurs bilinear interpolation overhead similar to deformable convolution. Table 6 shows that the 7×7 RoIConv variant is markedly slower than RetinaNet (86 ms vs. 58 ms), so the complexity claim should be reformulated, e.g., as 'no additional learnable parameters beyond a 1×1 conv' or 'same asymptotic complexity as deformable convolution.'
minor comments (4)
  1. [Section 3 heading] The heading 'Pilot Experiement' contains a typo; it should read 'Pilot Experiment.'
  2. [Table 7] In the table, 'CornetNet' should be 'CornerNet.'
  3. [Section 4.1, Eq. (2)] The notation h and w in Eq. (2) is used both for the RoI output size and for the anchor height/width; please disambiguate these, e.g., by using h_a, w_a for the anchor dimensions.
  4. [Section 5.1] The implementation details state that the DPM only does bounding box regression during test, but the training procedure for the DPM is not fully described (e.g., whether it also predicts classification during training). Please clarify.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: RoIConv is an analytically constructed operator, and the reported gains are empirical ablations against independent baselines.

full rationale

The paper's core derivation (Sec. 4.1) starts from the independently defined sampling formulas for convolution (Eq. 1) and RoIAlign (Eq. 2), solves Loc_conv = Loc_RoI, and obtains Eq. 3. This is a mathematical equivalence between two pre-existing operations, not a result that assumes what it proves. The RoIConv offsets in Eq. 4 are then computed as the difference between the anchor box sampling locations and the vanilla convolution sampling locations; that is a construction, not a fitted parameter renamed as a prediction. The empirical claims (Tables 2-6) compare RoIConv against vanilla convolution, deformable convolution, and other variants on COCO; the improvements are measured, not forced by the definition of the operator. The pilot experiment in Sec. 3.1 supports motivation but is not the derivation of RoIConv; even if its causal interpretation is debatable, that is a correctness/experimental-design concern, not circularity. No load-bearing self-citation or imported uniqueness theorem is used: the related work and baselines are external. Therefore the derivation chain is self-contained and no circular step can be exhibited.

Assumptions & free parameters 3 free parameters · 3 assumptions · 0 invented entities

The method relies on standard deep learning definitions and hyperparameters. The main free parameters are the single initial anchor shape and the label assignment thresholds, which are hand-picked. No new physical or conceptual entities are introduced; RoIConv is a mathematical operator, not an entity.

free parameters (3)
  • initial anchor scale = 4
    Aligned with RetinaNet's scale factor of 4; hand-picked, not learned.
  • initial anchor aspect ratio = 1:1
    Single square anchor; hand-picked.
  • label assignment IoU thresholds = DPM 0.4/0.3, ADM 0.6/0.6 (or 0.7/0.7)
    Chosen based on design intuition; the paper explores a few values in Table 5.
assumptions (3)
  • standard math Definition of convolution sampling locations as in Eq. (1)
    Standard implementation of convolution with half-pixel offsets.
  • standard math Definition of RoIAlign sampling locations as in Eq. (2)
    Standard RoIAlign definition with bilinear interpolation.
  • domain assumption COCO annotations are reliable for training/evaluation
    Assumed ground truth quality; standard in the field.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Revisiting Feature Alignment for One-stage Object Detection." pith.science (2026). https://pith.science/paper/JKWRZZUY

@misc{pith2026190801570,
  author       = {Pith},
  title        = {Pith review of: Revisiting Feature Alignment for One-stage Object Detection},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/JKWRZZUY}},
  note         = {Machine review of arXiv:1908.01570}
}
read the original abstract

Recently, one-stage object detectors gain much attention due to their simplicity in practice. Its fully convolutional nature greatly reduces the difficulty of training and deployment compared with two-stage detectors which require NMS and sorting for the proposal stage. However, a fundamental issue lies in all one-stage detectors is the misalignment between anchor boxes and convolutional features, which significantly hinders the performance of one-stage detectors. In this work, we first reveal the deep connection between the widely used im2col operator and the RoIAlign operator. Guided by this illuminating observation, we propose a RoIConv operator which aligns the features and its corresponding anchors in one-stage detection in a principled way. We then design a fully convolutional AlignDet architecture which combines the flexibility of learned anchors and the preciseness of aligned features. Specifically, our AlignDet achieves a state-of-the-art mAP of 44.1 on the COCO test-dev with ResNeXt-101 backbone.

Figures

Figures reproduced from arXiv: 1908.01570 by the authors.

Figure 1
Figure 1. A demonstration of the resemblance between im2col and RoIAlign. [PITH_FULL_IMAGE:figures/full_fig_p004_1.png] view at source ↗
Figure 2
Figure 2. The architecture of the proposed Fully Convolutional AlignDet during inference. The DPM [PITH_FULL_IMAGE:figures/full_fig_p005_2.png] view at source ↗
Figure 3
Figure 3. A comparison between different feature align methods. (a) is the approach of RefineDet [PITH_FULL_IMAGE:figures/full_fig_p006_3.png] view at source ↗
Figures from the paper (1 more)
Figure 4
Figure 4. Figure 4: The distribution of IoUs between the implicit RoIs of convs and the refined anchors. The [PITH_FULL_IMAGE:figures/full_fig_p007_4.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

30 extracted references · 15 canonical work pages

  1. [1]

    Cascade R-CNN: Delving into high quality object detection

    Zhaowei Cai and Nuno Vasconcelos. Cascade R-CNN: Delving into high quality object detection. In CVPR, 2018

  2. [2]

    Flexible, high performance convolutional neural networks for image classification

    Kumar Chellapilla, Sidd Puri, and Patrice Simard. Flexible, high performance convolutional neural networks for image classification. In Workshop on Frontiers in Handwriting Recognition, 2006

  3. [3]

    R-FCN: Object detection via region-based fully convolutional networks

    Jifeng Dai, Yi Li, Kaiming He, and Jian Sun. R-FCN: Object detection via region-based fully convolutional networks. In NIPS, 2016

  4. [4]

    Deformable convolutional networks

    Jifeng Dai, Haozhi Qi, Yuwen Xiong, Yi Li, Guodong Zhang, Han Hu, and Yichen Wei. Deformable convolutional networks. In ICCV, 2017

  5. [5]

    CenterNet: Keypoint triplets for object detection

    Kaiwen Duan, Song Bai, Lingxi Xie, Honggang Qi, Qingming Huang, and Qi Tian. CenterNet: Keypoint triplets for object detection. arXiv:1904.08189, 2019

  6. [6]

    DSSD: Deconvolutional single shot detector

    Cheng-Yang Fu, Wei Liu, Ananth Ranga, Ambrish Tyagi, and Alexander C Berg. DSSD: Deconvolutional single shot detector. arXiv:1701.06659, 2017. 9

  7. [7]

    Fast R-CNN

    Ross Girshick. Fast R-CNN. In ICCV, 2015

  8. [8]

    Rich feature hierarchies for accurate object detection and semantic segmentation

    Ross Girshick, Jeff Donahue, Trevor Darrell, and Jitendra Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, 2014

Show all 30 references
  1. [9]

    Mask R-CNN

    Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. Mask R-CNN. In ICCV, 2017

  2. [10]

    Delving deep into rectifiers: Surpassing human-level performance on imagenet classification

    Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In ICCV, 2015

  3. [11]

    Spatial pyramid pooling in deep convolutional networks for visual recognition

    Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37(9):1904–1916, 2015

  4. [12]

    Densebox: Unifying landmark localization with end to end object detection

    Lichao Huang, Yi Yang, Yafeng Deng, and Yinan Yu. Densebox: Unifying landmark localization with end to end object detection. arXiv:1509.04874, 2015

  5. [13]

    FoveaBox: Beyond anchor-based object detector

    Tao Kong, Fuchun Sun, Huaping Liu, Yuning Jiang, and Jianbo Shi. FoveaBox: Beyond anchor-based object detector. arXiv:1904.03797Z, 2019

  6. [14]

    CornerNet: Detecting objects as paired keypoints

    Hei Law and Jia Deng. CornerNet: Detecting objects as paired keypoints. In ECCV, 2018

  7. [15]

    Feature pyramid networks for object detection

    Tsung-Yi Lin, Piotr Dollár, Ross B Girshick, Kaiming He, Bharath Hariharan, and Serge J Belongie. Feature pyramid networks for object detection. In CVPR, 2017

  8. [16]

    Focal loss for dense object detection

    Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, and Piotr Dollar. Focal loss for dense object detection. In ICCV, 2017

  9. [17]

    Microsoft COCO: Common objects in context

    Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C Lawrence Zitnick. Microsoft COCO: Common objects in context. In ECCV, 2014

  10. [18]

    SSD: Single shot multibox detector

    Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, and Alexander C Berg. SSD: Single shot multibox detector. In ECCV, 2016

  11. [19]

    You only look once: Unified, real-time object detection

    Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. You only look once: Unified, real-time object detection. In CVPR, 2016

  12. [20]

    YOLOv3: An incremental improvement

    Joseph Redmon and Ali Farhadi. YOLOv3: An incremental improvement. arXiv:1804.02767, 2018

  13. [21]

    Faster R-CNN: Towards real-time object detection with region proposal networks

    Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. Faster R-CNN: Towards real-time object detection with region proposal networks. In NIPS, 2015

  14. [22]

    Berg, and Li Fei-Fei

    Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg, and Li Fei-Fei. ImageNet large scale visual recognition challenge. International Journal of Computer Vision, 115...

  15. [23]

    FCOS: Fully convolutional one-stage object detection

    Zhi Tian, Chunhua Shen, Hao Chen, and Tong He. FCOS: Fully convolutional one-stage object detection. arXiv:1904.01355, 2019

  16. [24]

    Region proposal by guided anchoring

    Jiaqi Wang, Kai Chen, Shuo Yang, Chen Change Loy, and Dahua Lin. Region proposal by guided anchoring. In CVPR, 2019

  17. [25]

    MetaAnchor: Learning to detect objects with customized anchors

    Tong Yang, Xiangyu Zhang, Zeming Li, Wenqiang Zhang, and Jian Sun. MetaAnchor: Learning to detect objects with customized anchors. In NIPS, 2018

  18. [26]

    RepPoints: Point set representa- tion for object detection

    Ze Yang, Shaohui Liu, Han Hu, Liwei Wang, and Stephen Lin. RepPoints: Point set representa- tion for object detection. arXiv:1904.11490, 2019

  19. [27]

    Single-shot refinement neural network for object detection

    Shifeng Zhang, Longyin Wen, Xiao Bian, Zhen Lei, and Stan Z Li. Single-shot refinement neural network for object detection. In CVPR, 2018

  20. [28]

    Objects as points

    Xingyi Zhou, Dequan Wang, and Philipp Krähenbühl. Objects as points. arXiv:1904.07850, 2019. 10

  21. [29]

    Bottom-up object detection by grouping extreme and center points

    Xingyi Zhou, Jiacheng Zhuo, and Philipp Krähenbühl. Bottom-up object detection by grouping extreme and center points. In CVPR, 2019

  22. [30]

    Feature selective anchor-free module for single-shot object detection

    Chenchen Zhu, Yihui He, and Marios Savvides. Feature selective anchor-free module for single-shot object detection. In CVPR, 2019. 11

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.