REVIEW 7 cited by
Detect Everything with Few Examples
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Few-shot object detection aims at detecting novel categories given only a few example images. It is a basic skill for a robot to perform tasks in open environments. Recent methods focus on finetuning strategies, with complicated procedures that prohibit a wider application. In this paper, we introduce DE-ViT, a few-shot object detector without the need for finetuning. DE-ViT's novel architecture is based on a new region-propagation mechanism for localization. The propagated region masks are transformed into bounding boxes through a learnable spatial integral layer. Instead of training prototype classifiers, we propose to use prototypes to project ViT features into a subspace that is robust to overfitting on base classes. We evaluate DE-ViT on few-shot, and one-shot object detection benchmarks with Pascal VOC, COCO, and LVIS. DE-ViT establishes new state-of-the-art results on all benchmarks. Notably, for COCO, DE-ViT surpasses the few-shot SoTA by 15 mAP on 10-shot and 7.2 mAP on 30-shot and one-shot SoTA by 2.8 AP50. For LVIS, DE-ViT outperforms few-shot SoTA by 17 box APr. Further, we evaluate DE-ViT with a real robot by building a pick-and-place system for sorting novel objects based on example images. The videos of our robot demonstrations, the source code and the models of DE-ViT can be found at https://mlzxy.github.io/devit.
Forward citations
Cited by 7 Pith papers
-
Visual Textualization for Image Prompted Object Detection
Visual textualization projects support images into the text feature space and prompts an unmodified OVLM, achieving strong few-shot and open-set detection results.
-
Prompt-Driven Simulation with Feature Perturbation for Cross-Domain Few-Shot Object Detection
VLM-synthesized foreground and background images plus feature noise improve few-shot detection accuracy on six cross-domain benchmarks.
-
VFM-Guided Semi-Supervised Detection Transformer under Source-Free Constraints for Remote Sensing Object Detection
VG-DETR combines a mean-teacher detector with DINOv2-guided pseudo-label mining and dual-level feature alignment, reporting 77.5% mAP on xView to DOTA and 70.6% on HRRSD to SSDD.
-
Free-Lunch Augmentation by Revisiting Diffusion-Based Data Generation for Cross-Domain Few-Shot Object Detection
SITN improves cross-domain few-shot detection and segmentation by using weakened-noise diffusion and background inpainting to synthesize helpful training images, outperforming prior methods on all reported benchmarks.
-
MobQA: A Benchmark Dataset for Semantic Understanding of Human Mobility Data through Question Answering
LLMs handle factual lookups on mobility trajectories well but perform far worse on reasoning and explanation questions in the new 5,800-pair MobQA benchmark.
-
Few-Shot Object Detection via Spatial-Channel State Space Model
A Mamba-based channel sequence model combined with spatial attention improves few-shot object detection on VOC and COCO.
-
NexViTAD: Few-shot Unsupervised Cross-Domain Defect Detection via Vision Foundation Models and Multi-Task Learning
NexViTAD fuses Hiera and DINOv2 features with a multi-task decoder and Sinkhorn K-means memory bank to detect industrial defects across domains, reporting MVTec AD target AUC of 97.5%.
Discussion (0). Sign in to comment.