Structural Preservation and the Logical Expressiveness of Graph Neural Networks
Pith reviewed 2026-07-01 07:18 UTC · model grok-4.3
The pith
Graph neural networks preserved under embeddings, injective homomorphisms, or homomorphisms match the expressiveness of specific fragments of graded modal logic.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Preservation under embeddings, injective homomorphisms, and homomorphisms corresponds to existential graded modal logic, its existential-positive fragment, and existential-positive modal logic, respectively. These results characterise the expressiveness of broad classes of GNNs independently of specific architectural choices, but each of these classes admits a GNN architecture of the same expressiveness.
What carries the argument
Preservation under embeddings, injective homomorphisms, and homomorphisms, which correspond to fragments of graded modal logic via unravelling-invariant classes given finite representations by a well-quasi-order on trees of bounded height.
If this is right
- GNNs preserved under embeddings express exactly the properties definable in existential graded modal logic.
- GNNs preserved under injective homomorphisms express exactly the properties definable in the existential-positive fragment of graded modal logic.
- GNNs preserved under homomorphisms express exactly the properties definable in existential-positive modal logic.
- For each of these logical fragments there exists a GNN architecture with precisely the same expressiveness.
Where Pith is reading between the lines
- Structural preservation properties could be checked directly on trained GNNs to determine which logical fragment they match.
- The finite-representation technique might transfer to other graph classes or modal fragments beyond those treated here.
- Results on the logical side could be used to construct GNNs guaranteed to respect particular structural invariances.
Load-bearing premise
The new well-quasi-order result for trees of bounded height applies to the unravelling-invariant classes and yields finite representations.
What would settle it
Existence of a GNN preserved under embeddings whose classification decisions cannot be matched by any formula of existential graded modal logic, or failure of the well-quasi-order to produce the required finite representations for the relevant classes.
Figures
read the original abstract
Bridges between graph neural networks (GNNs) and logical formalisms have been established by fixing architectural choices, such as the types of aggregation, combination, and activation functions. These choices define restricted classes of GNNs for which tight correspondences with logical formalisms can be obtained, by showing that logical formulae can be translated into equivalent GNNs and, conversely, that GNNs can be translated into equivalent formulae. In this paper we take a semantic perspective by establishing the logical expressiveness of classes of GNN classifiers that are preserved under structural properties: embeddings (extensions), injective homomorphisms, and homomorphisms. We show that, for each such property, there exists a fragment of graded modal logic characterising the class of GNNs. In particular, preservation under embeddings, injective homomorphisms, and homomorphisms corresponds to existential graded modal logic, its existential-positive fragment, and existential-positive modal logic, respectively. These results characterise the expressiveness of broad classes of GNNs independently of specific architectural choices, but we also show that each of these classes admits a GNN architecture of the same expressiveness. Technically, our approach uses a new well-quasi-order result for trees of bounded height, yielding finite representations of unravelling-invariant classes.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper claims that classes of GNN classifiers preserved under embeddings, injective homomorphisms, and homomorphisms are characterized by existential graded modal logic, its existential-positive fragment, and existential-positive modal logic, respectively. These results are architecture-independent, each such class admits a matching GNN architecture, and the characterizations are obtained via a new well-quasi-order on trees of bounded height that yields finite representations of unravelling-invariant classes.
Significance. If the results hold, the semantic approach yields architecture-independent expressiveness characterizations for broad GNN classes via structural preservation, complementing prior work that fixes aggregation/combination functions. The existence of matching GNN architectures for each fragment and the new WQO result (if verified) are notable strengths that could enable broader applications in logic and graph learning.
major comments (2)
- [Abstract] Abstract and technical approach: the claimed exact correspondences and finite characterizations rest on a new well-quasi-order result for trees of bounded height that produces finite representations of unravelling-invariant classes. This result is load-bearing; without a complete, self-contained proof that the ordering is a WQO and applies to the relevant fragments, the semantic characterizations and architecture-existence claims do not follow.
- [Abstract] Abstract: the assertion that each preservation class admits a GNN architecture of identical expressiveness depends on the WQO yielding the required finite bases for the unravelling-invariant classes; the manuscript must exhibit or reference the explicit construction or translation that realizes this for each of the three fragments.
minor comments (1)
- Ensure consistent notation for the GNN classes and the three logic fragments throughout; define all preservation properties (embeddings, injective homomorphisms, homomorphisms) explicitly before the main theorems.
Simulated Author's Rebuttal
We thank the referee for the thoughtful and detailed report. The comments correctly identify the central technical pillar of the paper—the new well-quasi-order on bounded-height trees—and we address each point below with references to the existing proofs and planned clarifications.
read point-by-point responses
-
Referee: [Abstract] Abstract and technical approach: the claimed exact correspondences and finite characterizations rest on a new well-quasi-order result for trees of bounded height that produces finite representations of unravelling-invariant classes. This result is load-bearing; without a complete, self-contained proof that the ordering is a WQO and applies to the relevant fragments, the semantic characterizations and architecture-existence claims do not follow.
Authors: Section 4 of the manuscript contains a self-contained proof that the proposed ordering on trees of bounded height is a well-quasi-order (including the verification of the WQO property via Dickson’s lemma and the height bound) and that it induces finite bases for the unravelling-invariant classes corresponding to existential graded modal logic, its existential-positive fragment, and existential-positive modal logic. The proof directly supports both the preservation characterizations and the existence of finite representations. To improve readability and address the concern about prominence, we will insert a short dedicated subsection in the main text that summarizes the key lemmas and cross-references the full appendix proof. revision: partial
-
Referee: [Abstract] Abstract: the assertion that each preservation class admits a GNN architecture of identical expressiveness depends on the WQO yielding the required finite bases for the unravelling-invariant classes; the manuscript must exhibit or reference the explicit construction or translation that realizes this for each of the three fragments.
Authors: The finite bases obtained from the WQO are used to construct the matching GNNs via a uniform translation: each minimal tree in the basis is encoded as a fixed-depth GNN layer that computes the corresponding graded modal formula, with the overall classifier obtained by disjunction over the finite basis. This construction is sketched in Section 5 for all three fragments and is fully detailed in the appendix. We will add an explicit reference and a brief worked example for each fragment in the revised main text to make the translation steps immediately visible. revision: yes
Circularity Check
No significant circularity; derivation relies on new well-quasi-order theorem
full rationale
The paper derives logical characterizations of GNN classes from structural preservation properties (embeddings, injective homomorphisms, homomorphisms) mapping to fragments of graded modal logic. These correspondences are obtained via a new well-quasi-order result on trees of bounded height that provides finite representations of unravelling-invariant classes. No equations reduce to inputs by construction, no parameters are fitted and renamed as predictions, and no load-bearing steps depend on self-citations or prior ansatzes from the same authors. The central claims are independent of specific GNN architectures and rest on the (presumably proven) new ordering result rather than redefinition or external self-reference. This is a standard self-contained mathematical derivation.
Axiom & Free-Parameter Ledger
axioms (1)
- ad hoc to paper New well-quasi-order result for trees of bounded height yielding finite representations of unravelling-invariant classes
Reference graph
Works this paper leans on
-
[1]
Abramsky and L
S. Abramsky and L. Reggio. Arboreal categories and equi-resource homomorphism preservation theorems.Ann. Pure Appl. Log., 175(6):103423, 2024
2024
-
[2]
Andréka, I
H. Andréka, I. Németi, and J. van Benthem. Modal languages and bounded fragments of predicate logic.J. Philos. Log., 27(3):217–274, 1998
1998
-
[3]
Baader, D
F. Baader, D. Calvanese, D. L. McGuinness, D. Nardi, and P. F. Patel-Schneider, editors.The Description Logic Handbook: Theory, Implementation, and Applications. Cambridge University Press, 2003
2003
-
[4]
Barceló, E
P. Barceló, E. V . Kostylev, M. Monet, J. Pérez, J. L. Reutter, and J. P. Silva. The logical expressiveness of graph neural networks. InProc. of ICLR, 2020
2020
-
[5]
Benedikt, C.-H
M. Benedikt, C.-H. Lu, B. Motik, and T. Tan. Decidability of Graph Neural Networks via Logical Characterizations. InProc. of ICALP, volume 297, pages 127:1–127:20. Schloss Dagstuhl, 2024
2024
-
[6]
Cuenca Grau, E
B. Cuenca Grau, E. Feng, and P. Walega. The correspondence between bounded graph neural networks and fragments of first-order logic. InProc. of AAAI, 2026
2026
-
[7]
de Rijke
M. de Rijke. A note on graded modal logic.Stud Logica, 64(2):271–283, 2000
2000
-
[8]
Gilmer, S
J. Gilmer, S. S. Schoenholz, P. F. Riley, O. Vinyals, and G. E. Dahl. Neural message passing for quantum chemistry. InProc. of ICML, volume 70, pages 1263–1272, 2017
2017
-
[9]
Grädel, P
E. Grädel, P. G. Kolaitis, L. Libkin, M. Marx, J. Spencer, M. Y . Vardi, Y . Venema, and S. Weinstein.Finite Model Theory and Its Applications. Texts in Theoretical Computer Science. An EATCS Series. Springer, 2007
2007
-
[10]
M. Grohe. The descriptive complexity of graph neural networks.TheoretiCS, 3, 2024
2024
-
[11]
S. P. Hauke and P. A. Wał˛ ega. Aggregate-combine-readout GNNs are more expressive than logic C2. InProc. of AAAI, 2026
2026
-
[12]
Hodges.A Shorter Model Theory
W. Hodges.A Shorter Model Theory. Cambridge University Press, 1997
1997
-
[13]
Libkin.Elements of Finite Model Theory
L. Libkin.Elements of Finite Model Theory. Texts in Theoretical Computer Science. An EATCS Series. Springer, 2004
2004
-
[14]
Lopez.First Order Preservation Theorems in Finite Model Theory : Locality, Topology, and Limit Constructions
A. Lopez.First Order Preservation Theorems in Finite Model Theory : Locality, Topology, and Limit Constructions. (Théorèmes de préservation pour la logique au premier ordre: localité, topologie et constructions limites). PhD thesis, University of Paris-Saclay, France, 2023
2023
-
[15]
Ło ´s and R
J. Ło ´s and R. Suszko. On the extending of models (ii).Fundamenta Mathematicae, 42(2):343– 347, 1955
1955
-
[16]
R. C. Lyndon. Properties preserved under homomorphism. 1959
1959
-
[17]
Morris, M
C. Morris, M. Ritzert, M. Fey, W. L. Hamilton, J. E. Lenssen, G. Rattan, and M. Grohe. Weisfeiler and leman go neural: Higher-order graph neural networks. InProc. of AAAI, pages 4602–4609. AAAI Press, 2019
2019
-
[18]
Morris, M
C. Morris, M. Ritzert, M. Fey, W. L. Hamilton, J. E. Lenssen, G. Rattan, and M. Grohe. Weisfeiler and leman go neural: Higher-order graph neural networks. InProc. of AAAI, volume 33, pages 4602–4609, 2019
2019
-
[19]
Morris, D
M. Morris, D. J. T. Cucala, B. C. Grau, and I. Horrocks. Relational graph convolutional networks do not learn sound rules. In P. Marquis, M. Ortiz, and M. Pagnucco, editors,Proceedings of the 21st International Conference on Principles of Knowledge Representation and Reasoning, KR 2024, Hanoi, Vietnam. November 2-8, 2024, 2024
2024
-
[20]
Morris and I
M. Morris and I. Horrocks. Sound logical explanations for mean aggregation graph neural networks. InThe Thirty-ninth Annual Conference on Neural Information Processing Systems, 2025. 10
2025
-
[21]
P. Nunn, M. Sälzer, F. Schwarzentruber, and N. Troquard. A logic for reasoning about aggregate- combine graph neural networks. InProc. of IJCAI, pages 3532–3540. ijcai.org, 2024
2024
- [22]
-
[23]
E. Rosen. Modal logic over finite structures.J. Log. Lang. Inf., 6(4):427–439, 1997
1997
-
[24]
E. Rosen. Some aspects of model theory and finite structures.Bull. Symb. Log., 8(3):380–403, 2002
2002
-
[25]
B. Rossman. Homomorphism preservation theorems.J. ACM, 55(3):15:1–15:53, 2008
2008
-
[26]
Tena Cucala, B
D. Tena Cucala, B. Cuenca Grau, B. Motik, and E. V . Kostylev. On the correspondence between monotonic max-sum gnns and datalog. In P. Marquis, T. C. Son, and G. Kern-Isberner, editors, Proc. of KR, pages 658–667, 2023
2023
-
[27]
D. J. Tena Cucala and B. Cuenca Grau. Bridging max graph neural networks and datalog with negation. In P. Marquis, M. Ortiz, and M. Pagnucco, editors,Proc. of KR, 2024
2024
-
[28]
D. J. Tena Cucala, B. Cuenca Grau, B. Motik, and E. V . Kostylev. Expressive power of monotonic graph neural networks via datalog. InHandbook on Neurosymbolic AI and Knowledge Graphs, pages 780–807. IOS Press, 2025
2025
-
[29]
S. Tobies. PSPACE reasoning for graded modal logics.J. Log. Comput., 11(1):85–106, 2001
2001
-
[30]
Wang and M
X. Wang and M. Zhang. How powerful are spectral graph neural networks. InProc. of ICML, 2022
2022
-
[31]
K. Xu, W. Hu, J. Leskovec, and S. Jegelka. How powerful are graph neural networks? InProc. of ICLR, 2019. Technical Appendix A Proofs for Section 4.4 Theorem 4.The embedding relation on any class of rooted trees, whose heights are uniformly bounded by a fixed constant, is a well-quasi-order. Proof. Let L be the uniform bound on the height of the trees und...
2019
-
[32]
ifφ ℓ is a proposition or the negation of a proposition, thenC ℓℓ = 1
-
[33]
ifφ ℓ =φ j ∧φ k, thenC jℓ =C kℓ = 1andb ℓ =−1
-
[34]
ifφ ℓ =φ j ∨φ k, thenC jℓ =C kℓ = 1andb ℓ = 0
-
[35]
All other entries are set to0
ifφ ℓ =♢ ≥cφk, thenA kℓ = 1andb ℓ =−c+ 1. All other entries are set to0. Observe that all entries of A and C are non-negative, so Nφ is a positive-weight GNN with additional augmented layer. Hence, by Proposition 13,N φ is an augmented MGNN, as required. We now show correctness of the construction. Consider the application of Nφ to a graph G= (V, E, λ). W...
-
[36]
It remains to consider the case when N is an augmented MAX-MGNN, and show that it is equivalent to some ∃ML formula
there exists a formulaφin the required fragment of modal logic. It remains to consider the case when N is an augmented MAX-MGNN, and show that it is equivalent to some ∃ML formula. We observe that every MAX-MGNN can be seen as a bounded AC-GNN with set-based aggregation, denoted as GNNAC s , as defined in [6]. It has been shown that GNNAC s s have the sam...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.