Pith. sign in

REVIEW 3 major objections 4 minor 27 references

Enclosing Prototypical Variational Autoencoder for Explainable Out-of-Distribution Detection

T0 review · 3 major / 4 minor · reviewed 2026-08-07 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read ProtoDistVAE detects out-of-distribution images by fusing prototype distance with perceptual reconstruction error while keeping the classifier explainable.

desk verdict A real but narrow ProtoVAE extension that beats its own baseline and MNIST-class benchmarks, but loses on CIFAR/ImageNet and has a below-chance reconstruction result that undercuts the core premise. read the letter →

arxiv 2506.14390 v1 pith:GCRA6ONM submitted 2025-06-17 cs.LG cs.CV

Conrad Orglmeister , Erik Bochinski , Volker Eiselein , Elvira Fleig This is my paper
classification cs.LGcs.CV
keywords out-of-distributiondetectionprototypicalvariationalautoencoderenclosingrestrictiongeneralizedGaussianLPIPSexplainableAIreconstruction-basedOODdistance-basedclassification
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper attempts to establish that out-of-distribution (OOD) detection can be built directly into a self-explainable classifier rather than bolted on after training. It introduces ProtoDistVAE, a prototypical variational autoencoder whose latent space is shaped by an 'enclosing restriction': each class is anchored to learned prototypes, and a generalized-Gaussian loss keeps in-distribution embeddings close to those prototypes without collapsing them to single points. Because the same model reconstructs images through the latent space, the prototypes and the in-distribution region are human-visible, and reconstruction error plus prototype distance together flag OOD inputs. The authors report that this beats previous methods on common OOD benchmarks and on a real-world railway dataset, which matters for safety-critical applications where an unknown input should be refused rather than misclassified.

What carries the argument

The central mechanism is the enclosing restriction, implemented through generalized Gaussian distributions centered at learned prototypes. For each input, distances to all prototypes are computed, and the logit for class $k$ is $-\left(\min_j d_{kj}/\alpha\right)^\beta$ with $\beta \ge 2$, so the loss gradient weakens as an embedding approaches a prototype. This traps embeddings inside a bounded region around the prototypes instead of collapsing them to points. The companion terms are a KL divergence to the nearest same-class prototype, an orthonormalization loss that keeps prototypes within a class distinct, and an LPIPS reconstruction loss that preserves perceptually meaningful image structure. At test time, a normalized distance score and the normalized LPIPS error are combined by an $L^2$ or $L^\infty$ norm into the OOD score.

What would settle it

One concrete check: in the reported far-OOD ImageNet setting, the fused score yields an AUROC of 37.5 percent, below the 50 percent random baseline, meaning the model ranks out-of-distribution images as more in-distribution-like than in-distribution images. If that measurement reproduces on a fresh split with the published settings, the two-condition premise fails for high-resolution diverse inputs.

Watch

Extended reading notes

Core claim

On its own terms, the paper's central discovery is that the antagonism between a compact in-distribution latent region and good reconstruction can be decoupled. ProtoDistVAE replaces the ProtoVAE's linear classifier and similarity scores with direct minimum distances to class prototypes, converts those distances into logits via generalized Gaussian distributions, and adds an orthonormalization term so prototypes spread within a class. The result is a training loss whose four terms—cross-entropy on prototype distances, KL divergence to the nearest prototype, LPIPS reconstruction, and prototype orthonormalization—produce a latent space where in-distribution embeddings are enclosed near prototypes but still carry enough information to reconstruct the input. OOD detection then fuses a normalized distance score with the normalized LPIPS reconstruction error using an L2 or L-infinity norm, so no explicit probability model for OOD data is needed. The paper claims this yields the best results on the MNIST-based benchmarks, competitive results on CIFAR-10, and top results on the railway dataset, while also rendering decisions transparent.

Load-bearing premise

The entire score rests on the unproven premise that out-of-distribution inputs will never both land inside the learned latent region and reconstruct as well as in-distribution inputs.

Editorial extensions

If this is right

  • OOD detection can be trained into the classifier from the start rather than applied post-hoc to pretrained features, so the learned representation is shaped by the OOD objective.
  • The enclosing restriction gives practitioners a direct control knob: adjusting the width and shape parameters of the generalized Gaussians makes the in-distribution region tighter or looser without necessarily hurting reconstruction.
  • Because prototypes and their reconstructions are inspectable, a deployed model can show why an input was refused: it is far from every class prototype, it reconstructs poorly, or both.
  • The fused score, using an L2 or L-infinity norm of normalized distance and reconstruction scores, requires no explicit probability model for unknown data and produces a gradual, threshold-free OOD signal.
  • In low-diversity operational domains such as railway monitoring, the approach can detect non-objects even when the classifier has only two in-distribution classes.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • An editor's inference: the reported far-OOD ImageNet result with an AUROC of 37.5 percent, below the 50 percent random baseline, suggests the two-condition premise fails at high resolution and high class diversity, so the method's practical envelope is narrower than 'any OOD input.'
  • A testable extension not studied in the paper: gate the distance score before the reconstruction score, rejecting any input outside all generalized Gaussians outright; this could recover the below-chance setting.
  • The enclosing restriction is a training-objective idea and could be transferred to other reconstruction-based OOD detectors, such as denoising diffusion or multi-scale autoencoders, where compactness and reconstruction are also in tension.
  • If prototype reconstructions are trustworthy, distance-to-prototype and reconstruction differences could explain not just whether an input is OOD but which attributes of the input are unfamiliar.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 4 minor

Summary. The paper proposes ProtoDistVAE, an extension of the Prototypical Variational Autoencoder (ProtoVAE) for explainable out-of-distribution (OOD) detection. The method integrates a VAE latent space with learned prototypes, a generalized-Gaussian "enclosing restriction" that maps ID embeddings into a compact region around class prototypes, and an LPIPS-based reconstruction loss and OOD score. The OOD decision combines a distance-based score with the LPIPS reconstruction error via L2 or L-infinity norm fusion. The method is evaluated on OpenOOD benchmarks and a non-public railway dataset, with claims that it outperforms previous methods and provides human-interpretable reconstructions of prototypes and samples.

Significance. The combination of prototype-based distance classification, density estimation, and reconstruction-based OOD detection is a plausible and interesting direction, and the paper's ablation against ProtoVAE (Table 2b) provides some evidence that the architectural changes help in many settings. The use of LPIPS as both a training loss and an OOD score is also worth investigating. If the claimed advantages held across benchmarks, the method would offer a useful explainable alternative for safety-critical OOD detection. The paper is transparent about its experimental setup and gives a clear description of the proposed losses and fusion scheme. However, the headline claim of outperforming previous methods is not supported by the reported numbers on the more diverse benchmarks, and the reconstruction branch shows a below-chance result on ImageNet far-OOD, which directly undermines a core premise of the method.

major comments (3)
  1. [Section 4.1, Table 1] The abstract's claim that the method is 'outperforming previous methods' is contradicted by the reported numbers. On C-6, C-50, and T-20, ProtoDistVAE achieves AUROC 76.6, 69.0, and 62.4, respectively, whereas KNN achieves 86.9, 83.4, and 74.1, and MaxLogit achieves 84.8, 82.7, and 75.5. The authors explicitly acknowledge that 'performance for highly diverse datasets with a large number of classes decreases.' The outperformance claim should be restricted to the MNIST-based and DBS settings, or the paper should be repositioned as a contribution that is competitive in low-diversity regimes rather than broadly superior. The abstract and conclusion should be revised accordingly.
  2. [Section 3, Table 2c] The central premise that OOD samples should never both be embedded into the latent ID region and reconstruct well is contradicted by the paper's own reconstruction-score results. With LPIPS loss and L=1/24, the LPIPS reconstruction score gives an AUROC of 37.5 on ImageNet far-OOD (Table 2c), which is below chance: far-OOD images are systematically assigned lower reconstruction error than ID images. This invalidates the reconstruction branch as a complement to the distance branch in the high-diversity regime that the paper identifies as difficult, and it weakens the claim that the method is 'reconstruction-, distance- and density-based' and that reconstruction 'further aids' OOD detection. The authors need to explain this failure, report fused-score results for these settings, or explicitly qualify the reconstruction component's role.
  3. [Section 3, Eq. (2), Table 2b] The claimed benefit of the 'enclosing restriction' is not isolated. ProtoDistVAE differs from ProtoVAE by both replacing the linear classifier's summed distances with minimum distances per class and by using generalized Gaussian logits. Since Table 2b compares the two complete architectures, the observed improvement cannot be attributed specifically to the enclosing restriction. An ablation that keeps the classifier fixed and varies only the restriction term is needed to support the novelty claim that the enclosing restriction, rather than the change in classifier, is responsible for the improved OOD detection.
minor comments (4)
  1. [Section 4.1] The sentence 'Ensembling shows a lower-than-usualperformance' contains a spacing typo; please fix 'usualperformance'.
  2. [Section 4.1] The exact hyperparameter configuration for the DBS baselines is described only as 'parameterized as in [24]'; providing the specific settings (network architecture, training epochs, score normalization) would improve reproducibility, especially since the dataset is non-public.
  3. [Table 1 and Section 4.1] The fusion setup used for ProtoDistVAE in Table 1 (DistRatio and LPIPS with L∞ norm, L=1/24) is described only in the text; the table caption should state this configuration to avoid ambiguity.
  4. [Section 3] The term 'T_ID' is used without a formal definition; a precise definition in terms of the prototype-centered Gaussian mixture would improve the exposition.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the paper reports empirical comparisons against external benchmarks, and its few assumptions are correctness risks rather than equations that reduce to their own inputs.

full rationale

The paper does not claim a formal derivation from first principles; its central evidence is an empirical evaluation against external baselines (OpenOOD and a separate railway dataset). The Section 3 premise inherited from [27] - that a well-reconstructing autoencoder with a precise latent ID region implies OOD samples cannot both embed into that region and reconstruct well - is an assumed condition, not a result derived from the paper's own equations. The paper's own Table 2c (ImageNet far-OOD AUROC 37.5 with LPIPS) empirically undermines that assumption, but an empirically false or unsupported assumption is a correctness limitation, not a circular step. Score normalization using validation-set percentiles is standard calibration rather than fitting a parameter that is then reported as a prediction. There is no self-citation chain that forces the choice of the enclosing restriction; the novelty is an architectural modification compared against external baselines. No equation in the paper reduces to an input by construction, and no fitted constant is renamed as a prediction. Therefore the derivation is self-contained in the sense relevant to circularity, even though the method's core assumption may be questionable.

Assumptions & free parameters 7 free parameters · 5 assumptions · 0 invented entities

The central claim rests on a chain of modeling assumptions: Gaussian latent posteriors, the Zhou [27] premise that a well-estimated ID region plus reconstruction error separates OOD, the adequacy of Euclidean distance to prototypes as a dissimilarity measure, and LPIPS as a perceptual reconstruction quality. Most parameters are set by hand or chosen after performance comparisons rather than derived.

free parameters (7)
  • alpha = 2
    Width parameter of the generalized Gaussian classification distribution; hand-set to 2 for all experiments (Section 4).
  • beta = 2
    Shape parameter controlling the 'enclosedness' of the ID region; hand-set to 2 for all experiments.
  • latent_dimension_L = 1/3, 1/24, or 1/96 of input dimension
    Chosen per benchmark by comparing performance; no fixed selection rule is given.
  • loss_weights = w_cls = 1, w_KL = 1, w_rec = 1 or 100
    Reconstruction weight is increased to 100 for the DBS dataset to improve OOD detection; other weights stay at 1.
  • number_of_prototypes_J = 1
    Set to 1 because higher numbers 'did not improve the performance'.
  • score_normalization_percentiles = unspecified
    Lower and upper percentiles of the validation score distribution are used to normalize scores, but the percentile values are not stated.
  • score_and_fusion_selection = DistRatio or MSP with L2 or L_infinity norm
    The paper states the choice was made after experimentation and different choices are best for different datasets.
assumptions (5)
  • domain assumption Gaussian latent posterior with identity-covariance prior around prototypes
    Equation (5) uses KL divergence to N(phi_kj, I), assuming unit variance and Gaussianity of the learned embedding distribution; this is a modeling choice rather than a derived property.
  • domain assumption Zhou [27] two-condition ID criterion
    The whole OOD score assumes ID samples embed in T_ID and reconstruct well, while OOD samples fail at least one condition; the paper does not prove this and reports a below-chance ImageNet far-OOD result.
  • domain assumption Euclidean distance in latent space separates ID from OOD
    Distance-based classification and the distance OOD score assume that closeness to prototypes in L2 space is a reliable dissimilarity signal; UMAP shows this is only partially true on CIFAR10.
  • domain assumption LPIPS is a valid perceptual reconstruction and OOD metric
    LPIPS is used as both loss and score based on its alignment with human perception; the paper does not analyze when LPIPS reconstruction error is a reliable OOD cue.
  • ad hoc to paper Enclosing restriction works as stated
    The claim that minimum-distance generalized-Gaussian logits produce a compact but non-collapsed ID region is intuitive but not derived; it is justified only by the empirical ablations.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Enclosing Prototypical Variational Autoencoder for Explainable Out-of-Distribution Detection." pith.science (2026). https://pith.science/paper/GCRA6ONM

@misc{pith2026250614390,
  author       = {Pith},
  title        = {Pith review of: Enclosing Prototypical Variational Autoencoder for Explainable Out-of-Distribution Detection},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/GCRA6ONM}},
  note         = {Machine review of arXiv:2506.14390}
}
read the original abstract

Understanding the decision-making and trusting the reliability of Deep Machine Learning Models is crucial for adopting such methods to safety-relevant applications. We extend self-explainable Prototypical Variational models with autoencoder-based out-of-distribution (OOD) detection: A Variational Autoencoder is applied to learn a meaningful latent space which can be used for distance-based classification, likelihood estimation for OOD detection, and reconstruction. The In-Distribution (ID) region is defined by a Gaussian mixture distribution with learned prototypes representing the center of each mode. Furthermore, a novel restriction loss is introduced that promotes a compact ID region in the latent space without collapsing it into single points. The reconstructive capabilities of the Autoencoder ensure the explainability of the prototypes and the ID region of the classifier, further aiding the discrimination of OOD samples. Extensive evaluations on common OOD detection benchmarks as well as a large-scale dataset from a real-world railway application demonstrate the usefulness of the approach, outperforming previous methods.

Figures

Figures reproduced from arXiv: 2506.14390 by the authors.

Figure 1
Figure 1. ProtoDistVAE architecture: The input x is encoded into a latent Gaussian distribution from which a sample z is drawn and reconstructed to obtain xˆ. Then, in the framework of generalized Gaussians, the SoftMax function returns the predicted probabilities and class estimate yˆ for the distances to all prototypes. 1. An ID sample is embedded into TID (by definition). 2. An ID sample exhibits a small reconstruction err… view at source ↗
Figure 2
Figure 2. UMAP visualization of the latent space embeddings of trained ProtoDist [PITH_FULL_IMAGE:figures/full_fig_p008_2.png] view at source ↗
Figure 3
Figure 3. Comparison of MSE and LPIPS loss: CIFAR10 (ID) and FashionMNIST [PITH_FULL_IMAGE:figures/full_fig_p010_3.png] view at source ↗
Figures from the paper (1 more)
Figure 4
Figure 4. Figure 4: DBS samples and reconstructions: ID and OOD ( [PITH_FULL_IMAGE:figures/full_fig_p011_4.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

27 extracted references · 23 canonical work pages

  1. [1]

    What do we learn? Debunking the Myth of Unsupervised Outlier Detection

    Bercea, C., Rueckert, D., Schnabel, J.: What do we learn? debunking the myth of unsupervised outlier detection. arXiv preprint arXiv:2206.03698 (2022)

    work page Pith review arXiv 2022

  2. [2]

    TPAMI pp

    Chen, G., Peng, P., Wang, X., Tian, Y.: Adversarial reciprocal points learning for open set recognition. TPAMI pp. 8065–8081 (2022)

    work page 2022

  3. [3]

    arXiv preprint arXiv:1812.02765 (2018)

    Denouden, T., Salay, R., Czarnecki, K., Abdelzad, V., Phan, B., Vernekar, S.: Im- proving reconstruction autoencoder out-of-distribution detection with mahalanobis distance. arXiv preprint arXiv:1812.02765 (2018)

    arXiv 2018

  4. [4]

    In: NeurIPS

    Du, X., Gozum, G., Ming, Y., Li, Y.: Siren: Shaping representations for detecting out-of-distribution objects. In: NeurIPS. vol. 35, pp. 20434–20449 (2022)

    work page 2022

  5. [5]

    In: ICML

    Gal, Y., Ghahramani, Z.: Dropout as a bayesian approximation: Representing model uncertainty in deep learning. In: ICML. pp. 1050–1059 (2016) 12 C. Orglmeister et al

    work page 2016

  6. [6]

    In: NeurIPS

    Gautam, S., Boubekki, A., Hansen, S., Salahuddin, S., Jenssen, R., Höhne, M., Kampffmeyer, M.: Protovae: A trustworthy self-explainable prototypical varia- tional model. In: NeurIPS. pp. 17940–17952 (2022)

    work page 2022

  7. [7]

    In: CVPR Work- shops

    Graham, M.S., Pinaya, W.H.L., Tudosiu, P.D., Nachev, P., Ourselin, S., Cardoso, M.J.: Denoising diffusion models for out-of-distribution detection. In: CVPR Work- shops. pp. 2948–2957 (2023)

    work page 2023

  8. [8]

    In: ICML

    Guo, C., Pleiss, G., Sun, Y., Weinberger, K.Q.: On calibration of modern neural networks. In: ICML. pp. 1321–1330 (2017)

    work page 2017

Show all 27 references
  1. [9]

    In: CVPR

    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: CVPR. pp. 770–778 (2016)

    2016

  2. [10]

    In: ICML

    Hendrycks, D., Basart, S., Mazeika, M., Zou, A., Kwon, J., Mostajabi, M., Stein- hardt, J., Song, D.: Scaling out-of-distribution detection for real-world settings. In: ICML. pp. 8759–8773 (2022)

    2022

  3. [11]

    In: ICLR (2017)

    Hendrycks, D., Gimpel, K.: A baseline for detecting misclassified and out-of- distribution examples in neural networks. In: ICLR (2017)

    2017

  4. [12]

    In: CVPR

    Hendrycks, D., Zou, A., Mazeika, M., Tang, L., Li, B., Song, D., Steinhardt, J.: Pixmix: Dreamlike pictures comprehensively improve safety measures. In: CVPR. pp. 16762–16771 (2022)

    2022

  5. [13]

    Lakshminarayanan, B., Pritzel, A., Blundell, C.: Simple and scalable predictive uncertainty estimation using deep ensembles. NIPS p. 6405–6416 (2017)

    2017

  6. [14]

    NeurIPS p

    Lee, K., Lee, K., Lee, H., Shin, J.: A simple unified framework for detecting out- of-distribution samples and adversarial attacks. NeurIPS p. 7167–7177 (2018)

    2018

  7. [15]

    Nalisnick, E., Matsukawa, A., Teh, Y.W., Gorur, D., Lakshminarayanan, B.: Do deep generative models know what they don’t know? In: ICLR (2019)

    2019

  8. [16]

    In: CVPR

    Oza, P., Patel, V.M.: C2ae: Class conditioned auto-encoder for open-set recogni- tion. In: CVPR. pp. 2307–2316 (2019)

    2019

  9. [17]

    In: ICML

    Ruff, L., Vandermeulen, R., Goernitz, N., Deecke, L., Siddiqui, S.A., Binder, A., Müller, E., Kloft, M.: Deep one-class classification. In: ICML. pp. 4393–4402 (2018)

    2018

  10. [18]

    In: CVPR

    Shi, W., Caballero, J., Huszár, F., Totz, J., Aitken, A.P., Bishop, R., Rueckert, D., Wang, Z.: Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: CVPR. pp. 1874–1883 (2016)

    2016

  11. [19]

    In: CVPR

    Sun, X., Yang, Z., Zhang, C., Ling, K.V., Peng, G.: Conditional gaussian distribu- tion learning for open set recognition. In: CVPR. pp. 13477–13486 (2020)

    2020

  12. [20]

    NeurIPS pp

    Sun, Y., Guo, C., Li, Y.: React: Out-of-distribution detection with rectified acti- vations. NeurIPS pp. 144–157 (2021)

    2021

  13. [21]

    In: ICML

    Sun, Y., Ming, Y., Zhu, X., Li, Y.: Out-of-distribution detection with deep nearest neighbors. In: ICML. pp. 20827–20840 (2022)

    2022

  14. [22]

    In: CVPR

    Wang, H., Li, Z., Feng, L., Zhang, W.: Vim: Out-of-distribution with virtual-logit matching. In: CVPR. pp. 4921–4930 (2022)

    2022

  15. [23]

    NeurIPS pp

    Xiao, Z., Yan, Q., Amit, Y.: Likelihood regret: An out-of-distribution detection score for variational auto-encoder. NeurIPS pp. 20685–20696 (2020)

    2020

  16. [24]

    NeurIPS pp

    Yang, J., Wang, P., Zou, D., Zhou, Z., Ding, K., Peng, W., Wang, H., Chen, G., Li, B., Sun, Y., et al.: Openood: Benchmarking generalized out-of-distribution detection. NeurIPS pp. 32598–32611 (2022)

    2022

  17. [25]

    arXiv preprint arXiv:2110.11334 (2021)

    Yang, J., Zhou, K., Li, Y., Liu, Z.: Generalized out-of-distribution detection: A survey. arXiv preprint arXiv:2110.11334 (2021)

    2021 arXiv

  18. [26]

    In: CVPR

    Zhang, R., Isola, P., Efros, A.A., Shechtman, E., Wang, O.: The unreasonable effectiveness of deep features as a perceptual metric. In: CVPR. pp. 586–595 (2018)

    2018

  19. [27]

    In: CVPR

    Zhou, Y.: Rethinking reconstruction autoencoder-based out-of-distribution detec- tion. In: CVPR. pp. 7369–7377 (2022)

    2022

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.