Pith. sign in

Title resolution pending

Ali Mohamed Nabil Allam, Mohamed Hassan Haggag · 2012

1 Pith paper cite this work. Polarity classification is still indexing.

1 Pith paper citing it
browse 1 citing papers

Title metadata for this work has not finished resolving. The hub is built from the citation graph; the title resolver retries DOI and OpenAlex on its next pass.

fields

cs.CL 1

years

2024 1

verdicts

REJECT 1

representative citing papers

Does Self-Attention Need Separate Weights in Transformers?

cs.CL · 2024-11-30 · reject · novelty 4.0

Shared-weight self-attention, using one matrix and three diagonal scalers for Q, K, and V, cuts BERT's attention parameters by two-thirds while giving roughly comparable GLUE accuracy, though claimed accuracy gains are not supported.

citing papers explorer

Showing 1 of 1 citing paper.

  • Does Self-Attention Need Separate Weights in Transformers? cs.CL · 2024-11-30 · reject · none · ref 1

    Shared-weight self-attention, using one matrix and three diagonal scalers for Q, K, and V, cuts BERT's attention parameters by two-thirds while giving roughly comparable GLUE accuracy, though claimed accuracy gains are not supported.