LLM embeddings condition a generative transformer to enable faster convergence, better performance, and generalization to unseen LHC processes using a single model.
Bumblebee: Foundation Model for Particle Physics Discovery 2024
3 Pith papers cite this work. Polarity classification is still indexing.
representative citing papers
A single MoE-based foundation model with transformer backbone unifies simulation, PID, and noise filtering for the GlueX DIRC detector and matches or exceeds traditional geometrical and prior deep-learning methods across kinematics.
A pretrained GNN on 120M simulated LHC events improves downstream event-classification accuracy when training data are scarce, with benefits shrinking as data grow.
citing papers explorer
-
One Generator, Any Process: LLM-Conditioning for the LHC
LLM embeddings condition a generative transformer to enable faster convergence, better performance, and generalization to unseen LHC processes using a single model.
-
Application of a Mixture of Experts-based Foundation Model to the GlueX DIRC Detector
A single MoE-based foundation model with transformer backbone unifies simulation, PID, and noise filtering for the GlueX DIRC detector and matches or exceeds traditional geometrical and prior deep-learning methods across kinematics.
-
Pretrained Event Classification Model for High Energy Physics Analysis
A pretrained GNN on 120M simulated LHC events improves downstream event-classification accuracy when training data are scarce, with benefits shrinking as data grow.