Pith. sign in

REVIEW 4 cited by

Linear Attention Mechanism: An Efficient Attention for Semantic Segmentation

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2007.14902 v3 pith:BJ4Z5WGN submitted 2020-07-29 cs.CV

Rui Li , Jianlin Su , Chenxi Duan , Shunyi Zheng This is my paper · ORCID
classification cs.CV
keywords attentionlinearmechanismefficientsegmentationsemanticapproximateavailable
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

In this paper, to remedy this deficiency, we propose a Linear Attention Mechanism which is approximate to dot-product attention with much less memory and computational costs. The efficient design makes the incorporation between attention mechanisms and neural networks more flexible and versatile. Experiments conducted on semantic segmentation demonstrated the effectiveness of linear attention mechanism. Code is available at https://github.com/lironui/Linear-Attention-Mechanism.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. ESPFormer: Doubly-Stochastic Attention with Expected Sliced Transport Plans

    cs.LG 2025-02 conditional novelty 6.0 of 10

    A new Transformer attention mechanism that builds doubly-stochastic attention from sliced optimal transport plans with soft sorting, yielding modest gains over baselines.

  2. SEMA: a Scalable and Efficient Mamba like Attention via Token Localization and Averaging

    cs.CV 2025-06 conditional novelty 5.0 of 10

    SEMA combines window attention with global token averaging, motivated by a dispersion theorem for generalized attention, and reports 0.2 to 0.7 percent top-1 accuracy gains over comparable vision Mamba and MILA models.

  3. Attention-based Neural Network Emulators for Multi-Probe Data Vectors Part III: Modeling The Next Generation Surveys

    astro-ph.CO 2025-05 conditional novelty 5.0 of 10

    A transformer-based emulator reproduces CAMB CMB TT, TE, and EE power spectra within cosmic variance errors across a wide Lambda-CDM parameter space, with outlier fractions below 10% for future survey configurations.

  4. Position: Episodic Memory is the Missing Piece for Long-Term LLM Agents

    cs.AI 2025-02 conditional novelty 5.0 of 10

    The authors propose episodic memory, with five defining properties, as the unifying framework needed for LLM agents to learn and remember over long time horizons.

Pith tools