Pith. sign in

REVIEW 5 cited by

Quixer: A Quantum Transformer Model

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2406.04305 v1 pith:R7DY22JG submitted 2024-06-06 quant-ph

classification quant-ph
keywords quantummodelquixertransformerclassicalresultsadditionapplied
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Progress in the realisation of reliable large-scale quantum computers has motivated research into the design of quantum machine learning models. We present Quixer: a novel quantum transformer model which utilises the Linear Combination of Unitaries and Quantum Singular Value Transform primitives as building blocks. Quixer operates by preparing a superposition of tokens and applying a trainable non-linear transformation to this mix. We present the first results for a quantum transformer model applied to a practical language modelling task, obtaining results competitive with an equivalent classical baseline. In addition, we include resource estimates for evaluating the model on quantum hardware, and provide an open-source implementation for classical simulation. We conclude by highlighting the generality of Quixer, showing that its parameterised components can be substituted with fixed structures to yield new classes of quantum transformers.

Discussion (0). Sign in to comment.

Forward citations

Cited by 5 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Trainability of Parametrised Linear Combinations of Unitaries

    quant-ph 2025-06 conditional novelty 7.0 of 10

    Sums of trainable parametrised circuits remain trainable, with explicit variance formulas for LCU states under Haar-random assumptions.

  2. Stacking the Deck: Tunable Trainability in Stacked LCUs

    quant-ph 2026-07 conditional novelty 6.0 of 10

    Stacked LCUs of fermionic Gaussian unitaries give variance Ω(1/(n k^{3l})) against classical simulation O(k^{2l} n^3) and quantum gate count O(l k n^2), with layers l as the single dial.

  3. Universal Quantum Transformer

    cs.AI 2026-04 unverdicted novelty 5.0 of 10

    UQT on 5 qubits achieves exact deterministic learning of Z_11 modular arithmetic and S_4 non-Abelian algebra via quantum-native mechanisms, claiming to bypass classical attention limits and run on NISQ hardware.

  4. Quantum Phase Recognition via Quantum Attention Mechanism

    quant-ph 2026-01 conditional novelty 5.0 of 10

    Swap-test measurements of qubit-pair correlations plus a classical network classify cluster-Ising ground states into AFM, SPT, and paramagnetic phases with high accuracy from small training sets.

  5. Quantum Agents

    quant-ph 2025-06 conditional novelty 4.0 of 10

    A definition and maturity model for quantum agents are proposed, with three small quantum-circuit prototypes illustrating Grover search, variational bandits, and adaptive image encryption.

Pith tools