REVIEW 2 major objections 5 minor 24 references
Compression versus Accuracy: A Hierarchy of Lifted Models
T0 review · 2 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read This paper claims that a precomputed hierarchy of tolerance values makes approximate lifted model construction hyperparameter-free while preserving the sharp worst-case accuracy bounds of ε-ACP.
desk verdict Hierarchy construction is sound and useful, but the inherited accuracy bound is false on a simple two-factor example. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is 1DEED, the one-dimensional ε-equivalence distance $d_\infty(\phi_1,\phi_2)=\max_k |\phi_1(k)-\phi_2(k)|/\min(|\phi_1(k)|,|\phi_2(k)|)$, which condenses the pairwise ε-equivalence check into a single number: Theorem 2 states $\phi_1 =_\varepsilon \phi_2 \iff d_\infty(\phi_1,\phi_2)\le\varepsilon$. Algorithm 1 uses these scalar distances to perform complete-linkage agglomerative merging—each merge records the largest pairwise distance among all factors in the combined group, so the stored ε is the smallest value at which the whole group is pairwise ε-equivalent. Algorithm 2 then reads off the groups at any chosen level, assigns ACP colours, runs standard colour passing, and replaces each group's potentials by their mean. The error analysis is carried by the Chan-Darwiche distance $D_{\mathrm{CD}}(P_M,P_{M'})$, through which Theorem 3's sharp ε-ACP bound is transferred to HACP and Theorem 5 converts it into an absolute query-deviation bound $p_{\max\Delta}\le(\sqrt{e^d}-1)/(\sqrt{e^d}+1)$.
What would settle it
Compute $D_{\mathrm{CD}}(P_M,P_{M'})$ for the original factor graph and the HACP-compressed graph at a hierarchy level with tolerance ε, on the extremal example used to show Theorem 3 is sharp: if the distance exceeds the bound in Eq. (5), Proposition 4 is refuted; if the extremal grouping is unreachable under HACP's nesting constraint, the claim that the bound remains sharp for HACP has no witness.
Extended reading notes
Core claim
On its own terms, the paper's central claim is that approximate lifted model construction can be made hierarchical without sacrificing its accuracy guarantee. It introduces the one-dimensional ε-equivalence distance $d_\infty(\phi_1,\phi_2)=\max_k |\phi_1(k)-\phi_2(k)|/\min(|\phi_1(k)|,|\phi_2(k)|)$, proves that two potential vectors are ε-equivalent exactly when this distance is at most ε, and uses the pairwise distances to build an agglomerative hierarchy in which merging two groups records their maximal pairwise distance. The resulting HACP algorithm colours each group and runs standard ACP, then replaces potentials by their group mean; because merges are only ever refined at coarser levels, the induced models form a strict nesting. The paper further claims that the sharp Chan-Darwiche error bound proved for ε-ACP applies unchanged to every level of the HACP hierarchy (Proposition 4, using Theorem 3), and derives a closed-form expression for the largest ε that keeps any query's absolute deviation below a target $p^*_\Delta$. All of this is meant to let a practitioner choose a compression level by examining the precomputed hierarchy and its error bounds, without guessing or exploring ε values.
Load-bearing premise
The accuracy guarantee depends on transferring the sharp ε-ACP worst-case bound to HACP even though HACP searches a strictly smaller space of allowed groupings, and the transfer is justified by a proof sketch that defers to the earlier bound's proof rather than re-deriving it.
Editorial extensions
If this is right
- Running Algorithm 1 once on a factor graph yields every ε at which the grouping changes, so a user can pick a compression level after seeing the trade-off instead of running ε-ACP repeatedly.
- The models at different levels are nested: a factor group formed at a smaller ε remains a subset of a group at every larger ε, making the models directly interpretable with respect to one another.
- Every HACP level inherits the same sharp Chan-Darwiche deviation bound as ε-ACP, so the hierarchy does not weaken the formal accuracy guarantee.
- Given a target maximum query deviation $p^*_\Delta$, Theorem 7 returns the largest ε that still meets it, turning an accuracy requirement into a concrete hierarchy level.
- Increasing ε and increasing the number of factors $m$ affect the bound in similar ways (Note 2), giving a simple rule of thumb for how much compression can be bought at a given accuracy cost.
Reading between the lines
- Editorial inference: Because the hierarchy is a complete-linkage dendrogram with recorded merge levels, the same precomputed ε vector can also serve as a diagnostic of symmetry structure—large gaps between consecutive ε values indicate genuine asymmetries between factor populations, while tight clusters of ε values indicate near-duplicate factors.
- Editorial inference: A natural empirical extension is to measure actual query deviations of HACP against ε-ACP on standard relational factor graphs, since the paper proves only that the worst-case bound transfers and notes that HACP may show somewhat higher average deviations.
- Editorial inference: The hierarchy could be used to recommend a default level automatically—for example, the smallest ε whose additional compression is negligible under the bound, or the largest ε before the bound exceeds a target deviation—without additional inference runs.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes Hierarchical Advanced Colour Passing (HACP), a hyperparameter-free method for constructing a hierarchy of approximate lifted probabilistic graphical models. It introduces a one-dimensional ε-equivalence distance (1DEED) and proves in Theorem 2 that this distance exactly characterizes ε-equivalence. Algorithm 1 computes a nested hierarchy of factor groupings and an associated ordered vector of ε values using complete-linkage agglomerative clustering on the 1DEED matrix. Algorithm 2 converts any selected hierarchy level into a parametric factor graph by assigning group colors and replacing factor potentials by group means. The paper claims that HACP inherits the exact error bound of ε-ACP (Proposition 4) and derives further bounds on maximal query deviations (Theorem 5, Corollary 6, Theorem 7).
Significance. If the error-bound transfer is made rigorous, the paper fills a genuine need in approximate lifted inference: it removes the user-defined ε hyperparameter and yields nested, interpretable models. The 1DEED characterization (Theorem 2) and the probabilistic deviation bounds (Theorem 5) are proven in detail in the appendix. The main weaknesses are that Proposition 4 is only a proof sketch, and the practical claims about interpretability and efficiency are not validated empirically. The theoretical contribution is otherwise coherent and appears correct under a standard reading of the equations.
major comments (2)
- [4.1, Proposition 4] The proof of Proposition 4 is a two-sentence sketch that defers to the original proof in [14, App. A] without stating or verifying the hypotheses under which Theorem 3's bound applies to HACP. Because HACP restricts the space of possible groupings relative to ε-ACP, the transfer is not automatic; the paper should either provide a full proof in the appendix or explicitly list the conditions (e.g., every group consists of pairwise ε-equivalent factors and potentials are replaced by the group mean) and verify them. The optimality claim—that the same example as in [14] hits the bound—is also asserted without checking that the tightness configuration is reachable under the hierarchical constraint. I examined the specific counterexample proposed in the review: for m=2, Eq. (5) reads ln(((1+ε/2)(1+ε))/(1+ε/2))^2 = ln((1+ε)^2) = 2 ln(1+ε), not ln((1+ε)/(1+ε/2)), so that example does not falsify the bound. The substantive gap is therefore the missing proof, not the counterexample.
- [3.3, Algorithm 2, line 5] The condition `j < m` in the definition of GΦ(k) incorrectly excludes factor index m from any group. Since factor indices run from 1 to m, the condition should be `j ≤ m` (or equivalently `j < m+1`). As written, whenever factor m belongs to a non-singleton group at a given hierarchy level, it would be omitted from that group and later treated as a singleton, yielding an incorrect grouping. This is a concrete bug in a central algorithm and should be fixed in the pseudocode.
minor comments (5)
- [4.1, Eq. (5) and Eq. (10)] The exponent m is typeset in a way that makes it easy to misread as applying only to the denominator. The proof of Theorem 7 (taking the m-th root of e^d) shows that the exponent applies to the entire fraction. Please typeset as `\left( \frac{(1+\frac{m-1}{m}\varepsilon)(1+\varepsilon)}{1+\frac{1}{m}\varepsilon} \right)^m` to remove ambiguity.
- [3.2, Algorithm 1] When multiple entries of the distance matrix tie for the minimum, the resulting hierarchy and ε-vector are not unique. The paper does not discuss tie-breaking or its effect on the claimed nested structure and on the error bounds. A deterministic tie-breaking rule should be specified, or the non-uniqueness should be acknowledged.
- [4.2, Theorem 7] The displayed formula for ε1 appears garbled: the fractions and square root are distorted, and the expression as presented is hard to parse. The derivation in the proof gives a valid quadratic, but the main-text formula should be corrected for reproducibility.
- [5 (Discussion)] The paper makes practical claims about interpretability and efficiency gains (e.g., 'enables interpretability between the different models') but provides no experimental evaluation. A small case study on a standard benchmark would substantially strengthen these claims, even for a primarily theoretical paper.
- [3.2, opening paragraph] The input specification 'Φ ⊂ R^{n×m}_{>0}' is a misuse of notation: Φ is a set of m factors, each a vector in R^n_{>0}, not an n×m matrix. The wording 'with m = |Φ| and Φ ⊂ R^{n×m}_{>0}' should be corrected to 'Φ = {ϕ_1,...,ϕ_m} with ϕ_i ∈ R^n_{>0}'.
Circularity Check
Proposition 4's error-bound transfer is a load-bearing self-citation; the hierarchy construction itself is independent.
-
self citation load bearing
[Section 4.1, Proposition 4 (proof), relying on Theorem 3 from [14]; reinforced in Section 5]
"Theorem 3 (Luttermann et al. [14]) ... where the bound given in Eq. (5) is optimal (sharp). Proposition 4. Theorem 3 holds the same way for M′ being the output of the HACP algorithm (Alg. 2). Proof. The core components of the ε-ACP algorithm and its hierarchical counterpart HACP (Alg. 2) are identical, aside from enforcing predefined group structures to guarantee a hierarchical structure. Therefore, the proof can be conducted in the same manner as the original proof [14, App. A]. The same proposed example can be used to hit the bound of Eq. (5), showing its optimality."
Proposition 4 is the paper's accuracy guarantee, but it does not derive a HACP-specific bound. It transfers Theorem 3 from the authors' own prior work [14] by asserting the algorithms are identical 'aside from enforcing predefined group structures.' That aside is exactly the HACP difference: the forced complete-linkage hierarchy restricts reachable groupings, so the worst case and the 'same proposed example' used for sharpness must be re-verified in this restricted space. Instead, both the bound and its optimality are lifted from [14, App. A] via citation. The paper's later statement that both algorithms retain identical worst-case bounds 'by construction' thus rests on a self-citation rather than on a derivation, making the cited theorem load-bearing.
full rationale
The hierarchical construction itself is self-contained: Theorem 2 is an equivalent reformulation of Definition 3, Algorithm 1's nested merge rule guarantees the hierarchy property by construction, and Algorithm 2's mean-potential update is defined in-text. The single load-bearing circular dependency is the transfer of the sharp ε-ACP error bound to HACP in Proposition 4, whose proof defers entirely to the authors' own [14] and assumes the optimality example carries over without verifying that the HACP grouping restriction permits it. I do not score higher because the paper's main algorithmic contribution (the hierarchy of ε values and nested models) does not reduce to a fit or to a self-citation; the problem is localized to the inherited accuracy claim. The skeptic's two-factor counterexample, if correct, would make Proposition 4 false rather than merely cited; either way, it underscores that the bound's transfer is assumed, not derived.
Assumptions & free parameters
assumptions (5)
- domain assumption All potentials are strictly positive (Def. 1).
- domain assumption Permutation pi in epsilon-equivalence is the identity (Sec. 2).
- domain assumption Factors to be grouped share identical dimension and range structure (structural compatibility, Alg. 1 input).
- standard math Theorem 3 of [14] is accepted as true: the epsilon-ACP error bound holds as stated.
- standard math Chan-Darwiche distance bounds (Eq. 4 and Eq. 7) are valid.
Cite this review
Pith. "Pith review of Compression versus Accuracy: A Hierarchy of Lifted Models." pith.science (2026). https://pith.science/paper/M5XMO3SK
@misc{pith2026250522288,
author = {Pith},
title = {Pith review of: Compression versus Accuracy: A Hierarchy of Lifted Models},
year = {2026},
howpublished = {\url{https://pith.science/paper/M5XMO3SK}},
note = {Machine review of arXiv:2505.22288}
}
abstract
Probabilistic graphical models that encode indistinguishable objects and relations among them use first-order logic constructs to compress a propositional factorised model for more efficient (lifted) inference. To obtain a lifted representation, the state-of-the-art algorithm Advanced Colour Passing (ACP) groups factors that represent matching distributions. In an approximate version using $\varepsilon$ as a hyperparameter, factors are grouped that differ by a factor of at most $(1\pm \varepsilon)$. However, finding a suitable $\varepsilon$ is not obvious and may need a lot of exploration, possibly requiring many ACP runs with different $\varepsilon$ values. Additionally, varying $\varepsilon$ can yield wildly different models, leading to decreased interpretability. Therefore, this paper presents a hierarchical approach to lifted model construction that is hyperparameter-free. It efficiently computes a hierarchy of $\varepsilon$ values that ensures a hierarchy of models, meaning that once factors are grouped together given some $\varepsilon$, these factors will be grouped together for larger $\varepsilon$ as well. The hierarchy of $\varepsilon$ values also leads to a hierarchy of error bounds. This allows for explicitly weighing compression versus accuracy when choosing specific $\varepsilon$ values to run ACP with and enables interpretability between the different models.
Figures
Figures from the paper (4 more)
Reference graph
Works this paper leans on
-
[14]
F. R. Kschischang, B. J. Frey, and H.-A. Loeliger. Factor Graphs and the Sum-Product Algorithm . IEEE Transactions on Information Theory , 47: 0 498--519, 2001
work page 2001
-
[1]
H. Chan and A. Darwiche. A distance measure for bounding probabilistic belief change. International Journal of Approximate Reasoning , 38:149--174, 2005
work page 2005
- [3]
-
[4]
T. Braun and R. M \"o ller. Lifted Junction Tree Algorithm . In Proceedings of the Thirty-Ninth German Conference on Artificial Intelligence (KI-2016), pages 30--42. Springer, 2016
work page 2016
-
[5]
T. Braun and R. M \"o ller. Parameterised Queries and Lifted Query Answering . In Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence (IJCAI-2018), pages 4980--4986. IJCAI Organization, 2018
work page 2018
-
[6]
H. Chan and A. Darwiche. A Distance Measure for Bounding Probabilistic Belief Change . International Journal of Approximate Reasoning, 38: 0 149--174, 2005
work page 2005
-
[7]
R. De Salvo Braz , E. Amir, and D. Roth. Lifted First-Order Probabilistic Inference . In Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence (IJCAI-2005), pages 1319--1325. Morgan Kaufmann Publishers Inc., 2005
work page 2005
-
[8]
R. De Salvo Braz , E. Amir, and D. Roth. MPE and Partial Inversion in Lifted Probabilistic Variable Elimination . In Proceedings of the Twenty-First National Conference on Artificial Intelligence (AAAI-2006), pages 1123--1130. AAAI Press, 2006
work page 2006
Show all 24 references
-
[9]
B. J. Frey, F. R. Kschischang, H.-A. Loeliger, and N. Wiberg. Factor Graphs and Algorithms . In Proceedings of the Thirty-Fifth Annual Allerton Conference on Communication, Control, and Computing, pages 666--680. Allerton House, 1997
1997
-
[10]
Gogate and P
V. Gogate and P. Domingos. Probabilistic Theorem Proving . In Proceedings of the Twenty-Seventh Conference on Uncertainty in Artificial Intelligence (UAI-2011), pages 256--265. AUAI Press, 2011
2011
-
[11]
Hartwig, R
M. Hartwig, R. M \"o ller, and T. Braun. An Extended View on Lifting Gaussian Bayesian Networks . Artificial Intelligence, 330: 0 104082, 2024
2024
-
[12]
Kersting, B
K. Kersting, B. Ahmadi, and S. Natarajan. Counting Belief Propagation . In Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence (UAI-2009), pages 277--284. AUAI Press, 2009
2009
-
[13]
Kisy\' n ski and D
J. Kisy\' n ski and D. Poole. Constraint Processing in Lifted Probabilistic Inference . In Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence (UAI-2009), pages 293--302. AUAI Press, 2009
2009
-
[15]
Luttermann, T
M. Luttermann, T. Braun, R. Möller, and M. Gehrke. Colour Passing Revisited: Lifted Model Construction with Commutative Factors . In Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence (AAAI-2024), pages 20500--20507. AAAI Press, 2024
2024
-
[16]
Luttermann, J
M. Luttermann, J. Speller, M. Gehrke, T. Braun, R. Möller, and M. Hartwig. Approximate Lifted Model Construction . In Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence (IJCAI-2025), 2025. https://arxiv.org/abs/2504.20784
2025 arXiv
-
[17]
Milch, L
B. Milch, L. S. Zettlemoyer, K. Kersting, M. Haimes, and L. P. Kaelbling. Lifted Probabilistic Inference with Counting Formulas . In Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence (AAAI-2008), pages 1062--1068. AAAI Press, 2008
2008
-
[18]
Niepert and G
M. Niepert and G. Van den Broeck. Tractability through Exchangeability: A New Perspective on Efficient Probabilistic Inference . In Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence (AAAI-2014), pages 2467--2475. AAAI Press, 2014
2014
-
[19]
D. Poole. First-order Probabilistic Inference . In Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence (IJCAI-2003), pages 985--991. IJCAI Organization, 2003
2003
-
[20]
Richardson and P
M. Richardson and P. Domingos. Markov Logic Networks . Machine Learning, 62 0 (1--2): 0 107--136, 2006
2006
-
[21]
Taghipour, D
N. Taghipour, D. Fierens, J. Davis, and H. Blockeel. Lifted Variable Elimination: Decoupling the Operators from the Constraint Language . Journal of Artificial Intelligence Research, 47 0 (1): 0 393--439, 2013
2013
-
[22]
Van den Broeck
G. Van den Broeck. Lifted Inference and Learning in Statistical Relational Models . PhD thesis, KU Leuven, 2013
2013
-
[23]
Van den Broeck and J
G. Van den Broeck and J. Davis. Conditioning in First-Order Knowledge Compilation and Lifted Probabilistic Inference . In Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence (AAAI-2012), pages 1961--1967. AAAI Press, 2012
2012
-
[24]
Van den Broeck, N
G. Van den Broeck, N. Taghipour, W. Meert, J. Davis, and L. De Raedt. Lifted Probabilistic Inference by First-order Knowledge Compilation . In Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence (IJCAI-2011), pages 2178--2185. IJCAI Organ...
2011
-
[25]
Weisfeiler and A
B. Weisfeiler and A. A. Leman. The Reduction of a Graph to Canonical Form and the Algebra which Appears Therein . NTI , Series , 2: 0 12--16, 1968. English translation by Grigory Ryabov available at https://www.iti.zcu.cz/wl2018/pdf/wl_paper_translation.pdf
1968
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.