REVIEW 10 cited by
Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architectures
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architectures
read the original abstract
Transformers have revolutionized computer vision and natural language processing, but their high computational complexity limits their application in high-resolution image processing and long-context analysis. This paper introduces Vision-RWKV (VRWKV), a model adapted from the RWKV model used in the NLP field with necessary modifications for vision tasks. Similar to the Vision Transformer (ViT), our model is designed to efficiently handle sparse inputs and demonstrate robust global processing capabilities, while also scaling up effectively, accommodating both large-scale parameters and extensive datasets. Its distinctive advantage lies in its reduced spatial aggregation complexity, which renders it exceptionally adept at processing high-resolution images seamlessly, eliminating the necessity for windowing operations. Our evaluations demonstrate that VRWKV surpasses ViT's performance in image classification and has significantly faster speeds and lower memory usage processing high-resolution inputs. In dense prediction tasks, it outperforms window-based models, maintaining comparable speeds. These results highlight VRWKV's potential as a more efficient alternative for visual perception tasks. Code is released at https://github.com/OpenGVLab/Vision-RWKV.
Forward citations
Cited by 10 Pith papers
-
PaperFit: Vision-in-the-Loop Typesetting Optimization for Scientific Documents
PaperFit uses rendered page images in a closed loop to diagnose and repair typesetting defects in LaTeX documents, outperforming baselines on a new benchmark of 200 papers.
-
HAMSA: Scanning-Free Vision State Space Models via SpectralPulseNet
HAMSA achieves 85.7% ImageNet-1K top-1 accuracy as a spectral-domain SSM with 2.2x faster inference and lower memory than transformers or scanning-based SSMs.
-
LoCAtion: Long-time Collaborative Attention Framework for High Dynamic Range Video Reconstruction
Dual-stream HDR video can be reconstructed without fragile cross-exposure warping by backbone-guided collaborative attention plus sequence-level residual refinement.
-
AudioRWKV: Efficient and Stable Bidirectional RWKV for Audio Pattern Recognition
AudioRWKV, an RWKV7-based audio backbone with 2D convolution and bidirectional WKV, beats AST and AuM baselines on five benchmarks at linear complexity.
-
PointDGRWKV: Generalizing RWKV-like Architecture to Unseen Domains for Point Cloud Classification
PointDGRWKV applies RWKV-like attention to domain-generalized point cloud classification, adding a geometric token shift and key-distribution alignment, and reports state-of-the-art accuracy on PointDA-10 and PointDG-3to1.
-
SCRWKV: Ultra-Compact Structure-Calibrated Vision-RWKV for Topological Crack Segmentation
SCRWKV is a 1.22M-parameter Vision-RWKV model using Structure-Field Encoder with AMCM and SCIU modules plus CSHF decoder that reports F1 0.8428 and mIoU 0.8512 on TUT crack dataset while claiming to outperform prior SOTA.
-
PestVL-Net: Enabling Multimodal Pest Learning via Fine-grained Vision-Language Interaction
PestVL-Net combines an RWKV visual backbone with saliency-guided window partitioning and MLLM-derived linguistic priors via multimodal chain-of-thought to enable fine-grained multimodal pest recognition on dedicated datasets.
-
MFC-RFNet: A Multi-scale Guided Rectified Flow Network for Radar Sequence Prediction
MFC-RFNet integrates multi-scale bidirectional communication, condition-guided alignment, and rectified flow to produce clearer and more skillful radar precipitation forecasts than prior baselines on four public datasets.
-
EfficientIML: Efficient High-Resolution Image Manipulation Localization
EfficientIML combines a lightweight RWKV-based backbone with multi-scale supervision to accurately localize high-resolution diffusion-based image forgeries, while introducing the SIF dataset for training and evaluation.
-
Cross-Modal Iteration Distillation for Robust IHD Screening: The IDNet Framework and A New Benchmark
IDNet uses cross-modal distillation to integrate eye images and clinical variables, outperforming baselines on a new benchmark of 50,410 UK Biobank images for IHD screening.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.