A single calibration that marginalizes layer distortion over random quantized upstream contexts yields budget-agnostic bit allocations that beat FP16-scored adaptive baselines across Llama-3.2-3B, Llama-2-7B, and Mistral-7B.
Density-Based Semantics for Reactive Probabilistic Programming
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
Synchronous languages are now a standard industry tool for critical embedded systems. Designers write high-level specifications by composing streams of values using block diagrams. These languages have been extended with Bayesian reasoning to program state-space models which compute a stream of distributions given a stream of observations. However, the semantics of probabilistic models is only defined for scheduled equations -- a significant limitation compared to dataflow synchronous languages and block diagrams which do not require any ordering. In this paper we propose two schedule agnostic semantics for a probabilistic synchronous language. The key idea is to interpret probabilistic expressions as a stream of un-normalized density functions which maps random variable values to a result and positive score. The co-iterative semantics interprets programs as state machines and equations are computed using a fixpoint operator. The relational semantics directly manipulates streams and is thus a better fit to reason about program equivalence. We use the relational semantics to prove the correctness of a program transformation required to run an optimized inference algorithm for state-space models with constant parameters.
fields
cs.LG 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
MixQuant: Adaptive Mixed-Precision Quantization for Large Language Models
A single calibration that marginalizes layer distortion over random quantized upstream contexts yields budget-agnostic bit allocations that beat FP16-scored adaptive baselines across Llama-3.2-3B, Llama-2-7B, and Mistral-7B.