Pith. sign in

REVIEW 3 cited by

Logic and the 2-Simplicial Transformer

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1909.00668 v1 pith:ZBTZDYGO submitted 2019-09-02 cs.LG cs.LOstat.ML

Logic and the 2-Simplicial Transformer

classification cs.LG cs.LOstat.ML
keywords attentiontransformersimplicialarchitecturebiascontextdeepdot-product
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

We introduce the $2$-simplicial Transformer, an extension of the Transformer which includes a form of higher-dimensional attention generalising the dot-product attention, and uses this attention to update entity representations with tensor products of value vectors. We show that this architecture is a useful inductive bias for logical reasoning in the context of deep reinforcement learning.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Higher-Order Fourier Neural Operator: Explicit Mode Mixer for Nonlinear PDEs

    cs.CE 2026-06 unverdicted novelty 7.0

    HO-FNO extends standard FNO with n-linear spectral mixing and shows improved accuracy on nonlinear PDE benchmarks, sometimes with a single layer beating deeper FNO models.

  2. TLX: Hardware-Native, Evolvable MIMW GPU Compiler for Large-scale Production Environments

    cs.AR 2026-05 unverdicted novelty 6.0

    TLX is a Triton extension that exposes multi-warp, asynchronous, and cluster-level controls for modern GPUs, delivering competitive performance with low programmer effort and production deployment.

  3. TLX: Hardware-Native, Evolvable MIMW GPU Compiler for Large-scale Production Environments

    cs.AR 2026-05 unverdicted novelty 6.0

    TLX introduces MIMW-based extensions to Triton that let developers orchestrate warp-group execution and asynchronous hardware features while preserving blocked programming productivity, with kernels deployed in large-...