Pith. sign in

REVIEW 1 cited by

Low Latency Transformer Inference on FPGAs for Physics Applications with hls4ml

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2409.05207 v1 pith:GDCA2UNG submitted 2024-09-08 cs.LG

Low Latency Transformer Inference on FPGAs for Physics Applications with hls4ml

Zhixing Jiang , Dennis Yin , Yihui Chen , Elham E Khoda , Scott Hauck , Shih-Chieh Hsu , Ekaterina Govorkova , Philip Harris
show 2 more authors
Vladimir Loncar Eric A. Moreno
This is my paper
classification cs.LG
keywords fpgashls4mltransformerapplicationslatencyphysicsachievedapplicability
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

This study presents an efficient implementation of transformer architectures in Field-Programmable Gate Arrays(FPGAs) using hls4ml. We demonstrate the strategy for implementing the multi-head attention, softmax, and normalization layer and evaluate three distinct models. Their deployment on VU13P FPGA chip achieved latency less than 2us, demonstrating the potential for real-time applications. HLS4ML compatibility with any TensorFlow-built transformer model further enhances the scalability and applicability of this work. Index Terms: FPGAs, machine learning, transformers, high energy physics, LIGO

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. SparsePixels: Efficient Convolution for Sparse Data on FPGAs

    cs.AR 2025-12 conditional novelty 6.0

    A fixed-budget sparse-convolution FPGA framework runs CNNs on <=20 of ~4000 pixels, achieving 0.665 us inference for MicroBooNE with a 73x speedup and ~2% AUC loss.