A new contour-based 'Eden score' compares 2D distributions by density level instead of datapoints and avoids the 'grade inflation' that inflates scores of poor generative model fits.
Scaling Monte-Carlo-Based Inference on Antibody and TCR Repertoires
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Previously, it has been shown that maximum-entropy models of immune-repertoire sequence can be used to determine a person's vaccination status. However, this approach has the drawback of requiring a computationally intensive method to compute each model's partition function ($Z$), the normalization constant required for calculating the probability that the model will generate a given sequence. Specifically, the method required generating approximately $10^{10}$ sequences via Monte-Carlo simulations for each model. This is impractical for large numbers of models. Here we propose an alternative method that requires estimating $Z$ this way for only a few models: it then uses these expensive estimates to estimate $Z$ more efficiently for the remaining models. We demonstrate that this new method enables the generation of accurate estimates for 27 models using only three expensive estimates, thereby reducing the computational cost by an order of magnitude. Importantly, this gain in efficiency is achieved with only minimal impact on classification accuracy. Thus, this new method enables larger-scale investigations in computational immunology and represents a useful contribution to energy-based modeling more generally.
citation-role summary
citation-polarity summary
fields
cs.AI 1years
2024 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
Grade Inflation in Generative Models
A new contour-based 'Eden score' compares 2D distributions by density level instead of datapoints and avoids the 'grade inflation' that inflates scores of poor generative model fits.