Pith. sign in

REVIEW 5 cited by

Building Vision Models upon Heat Conduction

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2405.16555 v2 pith:FA6KF2BW submitted 2024-05-26 cs.CV

Zhaozhi Wang , Yue Liu , Yunjie Tian , Yunfan Liu , Yaowei Wang , Qixiang Ye This is my paper · ORCID
classification cs.CV
keywords heatmodelscomputationalconductionvheatvisualfieldsreceptive
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

Visual representation models leveraging attention mechanisms are challenged by significant computational overhead, particularly when pursuing large receptive fields. In this study, we aim to mitigate this challenge by introducing the Heat Conduction Operator (HCO) built upon the physical heat conduction principle. HCO conceptualizes image patches as heat sources and models their correlations through adaptive thermal energy diffusion, enabling robust visual representations. HCO enjoys a computational complexity of O(N^1.5), as it can be implemented using discrete cosine transformation (DCT) operations. HCO is plug-and-play, combining with deep learning backbones produces visual representation models (termed vHeat) with global receptive fields. Experiments across vision tasks demonstrate that, beyond the stronger performance, vHeat achieves up to a 3x throughput, 80% less GPU memory allocation, and 35% fewer computational FLOPs compared to the Swin-Transformer. Code is available at https://github.com/MzeroMiko/vHeat.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 5 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Norm$\times$Direction: Restoring the Missing Query Norm in Vision Linear Attention

    cs.LG 2025-06 conditional novelty 6.0 of 10

    NaLaFormer restores query-norm sensitivity in linear attention with a norm-aware power feature map and a cosine direction similarity that keeps attention scores non-negative.

  2. PolaFormer: Polarity-aware Linear Attention for Vision Transformers

    cs.CV 2025-01 conditional novelty 6.0 of 10

    A polarity-aware linear attention with a learnable channel-wise power function improves vision transformer accuracy by up to 4.6% while keeping linear complexity.

  3. Dynamic Graph Induced Contour-aware Heat Conduction Network for Event-based Object Detection

    cs.CV 2025-05 conditional novelty 5.0 of 10

    CvHeat-DET, a contour-aware heat conduction detector with dynamic graph features, reports state-of-the-art mAP of 53.6 on the EvDET200K event-based object detection benchmark.

  4. A Novel Frequency-Spatial Domain Aware Network for Fast Thermal Prediction in 2.5D ICs

    cs.LG 2025-04 conditional novelty 5.0 of 10

    FSA-Heat, a frequency-spatial dual-domain network, predicts 2.5D IC temperature and gradient maps with over 99% lower RMSE and 4.23x faster inference than a GCN-based baseline on HotSpot data.

  5. Object Detection using Event Camera: A MoE Heat Conduction based Detector and A New Benchmark Dataset

    cs.CV 2024-12 conditional novelty 5.0 of 10

    MvHeat-DET, a Mixture-of-Experts heat-conduction detector, outperforms 15 re-trained baselines on the new EvDET200K dataset and reaches 55.7 mAP on N-Caltech101.

Pith tools