Analyzing constrained LLM through PDFA-learning
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:7AWPWBHMrecord.jsonopen to challenge →
read the original abstract
We define a congruence that copes with null next-symbol probabilities that arise when the output of a language model is constrained by some means during text generation. We develop an algorithm for efficiently learning the quotient with respect to this congruence and evaluate it on case studies for analyzing statistical properties of LLM.
This paper has not been read by Pith yet.
Forward citations
Cited by 1 Pith paper
-
Minimality of Random Moore Automata under Prefix-Dependent Congruences
Under independent uniform random transitions and labels with agreement probability strictly less than one and at least three admissible symbols each, the induced prefix-dependent congruence on random Moore automata is...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.