Pith. sign in

REVIEW 4 major objections 6 minor 24 references

Unsupervised Hierarchical Grouping of Knowledge Graph Entities

T0 review · 4 major / 6 minor · reviewed 2026-08-14 · deepseek-v4-flash

Pith's one-line read This paper claims that knowledge-graph entities can be grouped into named hierarchies with no labeled data, by turning each fact into a group and stacking groups by overlap.

desk verdict A simple, label-free way to build entity group hierarchies from KG triples, but the paper needs real evaluation and a spelled-out hierarchy algorithm before its 'effectively learn' claim can be believed. read the letter →

arxiv 1908.07281 v1 pith:NYCJBNSG submitted 2019-08-20 cs.IR cs.AIcs.CL

classification cs.IRcs.AIcs.CL
keywords knowledgegraphsentitytypeinferencehierarchicalclusteringunsupervisedlearninghubpromotedindexJaccardsimilaritynamedgroups
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper sets out to solve a specific gap: knowledge graphs are missing entity type assertions, and existing type-inference methods need labeled samples, ontologies, or schema. Its proposal is to derive a hierarchy of named entity groups directly from the graph's own facts. Every subject that shares a predicate-object pair, such as 'LiveIn_Dublin', is treated as a group, and groups are stacked into a hierarchy when one is almost fully contained in another (default threshold 0.9). The paper argues this produces meaningful hierarchies on six standard benchmark datasets, runs in a parallelized way, and tolerates noise and sparsity. If the claim holds, any knowledge graph can get a fresh, ontology-free type layer at essentially the cost of counting co-occurrences.

What carries the argument

The load-bearing mechanism is the predicate-object (PO) group together with the hub-promoted-index (HPI) similarity. A PO group is the set of subjects that appear in a triple with a given predicate and object; HPI between two groups is $|\Gamma(g_1)\cap\Gamma(g_2)|/\min(|g_1|,|g_2|)$, equal to 1 exactly when one group is a subset of the other. The construction's threshold $\theta=0.9$ converts near-containment into parent links, producing the hierarchy, while the Jaccard score provides a secondary overall-similarity view.

What would settle it

Take a knowledge graph in which most predicate-object pairs are uninformative, such as a 'birthDate' attribute with many entities sharing the same date or identifiers with shared prefixes, run the method, and compare the top-level groups against a manually curated type taxonomy. If precision or coverage is near chance, or if obvious groups like all entities with the same birth year dominate the hierarchy, the premise fails; equally, a random graph with planted subset structure should not yield spurious containment edges beyond the threshold.

Watch

Extended reading notes

Core claim

On the paper's own terms, the central claim is that a purely unsupervised, deterministic procedure over triples reconstructs a type hierarchy: create the set of all entities connected to an object by a predicate, call that set 'predicate_object', delete groups smaller than a minimum size, then compare groups with Jaccard and hub-promoted-index (HPI) similarity. HPI between two groups is $|\Gamma(g_1)\cap\Gamma(g_2)|/\min(|g_1|,|g_2|)$, so a value near 1 means one group is nearly a subset of the other; the paper treats HPI at or above 0.9 as a containment edge and builds a hierarchy of groups. Experiments on subsets of WordNet, Freebase, YAGO3, and NELL yield hierarchies whose named groups, such as 'LiveIn_Dublin' under 'LiveIn_Ireland' under 'LiveIn_Europe', match intuitive semantics.

Load-bearing premise

That every sizable set of entities sharing a predicate-object pair is a semantically meaningful type, for example that all entities linked to 'Dublin' by 'LiveIn' should form a class; if accidental co-occurrences dominate, the hierarchy is structurally valid but semantically empty.

Editorial extensions

If this is right

  • Knowledge graphs without any schema or labeled types can receive a named, hierarchical type layer directly from their own triples.
  • Because group construction is a parallelizable dictionary aggregation and similarity computation is pairwise over groups, the procedure can scale to large graphs by splitting triples across jobs.
  • The 0.9 containment threshold explicitly tolerates missing members, so incomplete or noisy type information does not prevent hierarchy construction.
  • New groups are named by the predicate-object pair that created them, so every node in the hierarchy carries a human-readable label rather than a latent cluster.
  • The produced hierarchies could be examined as features for downstream tasks such as link prediction or fact checking.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the hierarchies are semantically reliable, they could be written back into the graph as type assertions, effectively extending the type layer of any knowledge graph at low cost; the author names this as future work rather than a demonstrated result.
  • A testable extension would be to measure hierarchy quality against held-out human-curated types; the paper currently evaluates with illustrative examples rather than quantitative agreement.
  • The same PO-group construction could be applied per relation to suppress one-to-one predicates before the minimum-size filter, potentially reducing noise in datasets dominated by unique relation-object pairs.
  • Where two distinct predicate-object groups have identical members, the method will treat them as parallel nodes; merging groups by exact member equality would give a cleaner hierarchy and is a natural extension.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 6 minor

Summary. The paper proposes an unsupervised method for grouping knowledge graph entities into a hierarchy of named groups. For every predicate-object pair, the set of subjects sharing that pair is defined as a group; groups smaller than a threshold α are discarded. Group similarity is measured with Jaccard and hub-promoted-index (HPI) similarities, and a threshold θ on HPI is used to build a hierarchy. The method is applied to six KG benchmark datasets, and sample hierarchies are shown in Figures 2–3 and on a public gallery website. The paper claims that the approach effectively learns entity groups in a scalable way on noisy and sparse data, but the evidence is qualitative.

Significance. If the central claim is established, the method would offer a simple, unsupervised, and scalable alternative to supervised entity-type inference, with the additional benefit of proposing new named types not present in the ontology. The paper's strengths include a clear and elementary formalization, a parallel implementation described in Algorithm 1, and the public release of output hierarchies. The free parameters α and θ are explicitly user-set and not tuned to a benchmark, which is a point in favor of the method's transparency. However, the significance is currently limited by the absence of any quantitative evaluation of the hierarchical groups and by an underspecified hierarchy-construction step.

major comments (4)
  1. [Section 2.4] The hierarchy construction is underspecified. Equation (1) defines the symmetric HPI similarity, but the paper does not state how a parent–child relation is derived from it, nor does it present the algorithm that turns the similarity matrix into a hierarchy. In particular, HPI=1 holds for any pair of groups in which one is a subset of the other, regardless of which group is the subset, so HPI alone cannot determine the direction of subsumption. The authors must specify the direction rule (e.g., by size or by a separate containment measure) and provide the full construction procedure to make the method reproducible.
  2. [Section 3.2] The central claim that the approach 'effectively learn[s] entity groups' is not supported by quantitative evidence. The evaluation consists of two hand-picked example hierarchies (Figures 2 and 3) and a gallery website, with no comparison against known type hierarchies, no precision/recall or clustering quality measures, no baselines, and no statistical significance tests. Without such evaluation, the claim remains anecdotal.
  3. [Section 2.1] The assumption that every predicate-object group is a semantically meaningful type is questionable. As Figure 1 itself shows, the group 'PlayRugby' is a subset of 'LiveInEurope' for the sampled entities, so HPI=1 would place it under 'LiveInEurope,' yet playing rugby does not entail living in Europe. The hierarchy therefore reflects dataset co-occurrence, not type implication. The authors need to address this limitation explicitly or provide evidence that such misleading subsumptions are rare in the output hierarchies.
  4. [Sections 3.2 and 3.3] The scalability claim is not demonstrated. Although Algorithm 1 is parallelized and the paper states that experiments were run, no runtime, memory usage, or scaling measurements are reported. The reader cannot assess whether the method is scalable to large knowledge graphs as claimed.
minor comments (6)
  1. [Keywords] The keyword 'Heirarical' should be 'Hierarchical'.
  2. [Section 3.3] 'Python3.5' should be 'Python 3.5' and 'i70.4790K' should be 'i7-4790K'.
  3. [Section 5] 'operates on noisy data data' contains a duplicated word; it should be 'noisy data'.
  4. [Section 3.1] 'subset of of YAGO3' contains a duplicated 'of'; it should be 'subset of YAGO3'.
  5. [References] Reference [19] appears to be a duplicate of reference [11]; please merge or cite a distinct source.
  6. [Figures 2 and 3] The figures lack detailed captions that explain node types, hierarchy direction, and the datasets; consider adding this information for readability.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the method's groups and hierarchy are computed directly from graph triples via explicit set-overlap definitions, with no fitted parameter renamed as a prediction and no load-bearing self-citation.

full rationale

The paper's derivation chain is self-contained: entity groups are defined in Section 2.1 as sets of subjects sharing a predicate-object pair, Algorithm 1 constructs these groups directly from the input triples, Section 2.3 defines Jaccard and HPI similarities as explicit set-overlap formulas, and Section 2.4 builds the hierarchy by applying a user-set containment threshold theta to those computed similarity values. The thresholds alpha and theta are stated constants with stated motivations (minimum group size to avoid one-to-one predicates; theta=0.9 to tolerate 10% information loss), not parameters fitted to a benchmark or to any target outcome. No quantity is fitted to a subset of data and then predicted on a closely related quantity, and no claim is derived from a self-citation: the two references to the author's prior work (refs 21 and 24) concern other knowledge-graph tasks and are not used to justify the grouping method or its hierarchy construction. The paper makes no quantitative evaluation against external benchmarks, so there is no benchmark-fitting loop to inspect; the lack of semantic evaluation is a validity or correctness risk rather than circularity. The hierarchy is indeed only an overlap-based containment structure, not a proven semantic type hierarchy, but that is a limitation of the method's semantics, not a circular reduction of the output to the input. Accordingly, no circular step can be exhibited with the required quote-and-reduction evidence, and the honest finding is a score of 0.

Assumptions & free parameters 2 free parameters · 3 assumptions · 1 invented entities

The method's core assumption is that shared predicate-object connections reveal type semantics, and the hierarchy relies on a fixed overlap threshold. Two hand-set constants (alpha and theta) control the output but are not fitted or validated.

free parameters (2)
  • minimum group size alpha = 10
    Used in Section 2.2 to filter out small groups. The value 10 is chosen to avoid one-to-one predicates but is arbitrary and not validated.
  • HPI containment threshold theta = 0.9
    Used in Section 2.4 to decide when one group is a subset of another. The 10% tolerance for noise is a hand-set assumption with no sensitivity analysis.
assumptions (3)
  • domain assumption Entities that share the same predicate and object value form a cohesive, semantically meaningful group.
    The entire method relies on this assumption to turn graph triples into group labels; stated in Section 2.1.
  • domain assumption The HPI similarity with threshold theta (default 0.9) reliably indicates that one group is a sub-group of another when close to 1.
    Used to build the hierarchy in Section 2.4; in noisy data the HPI may deviate from 1, so a threshold is needed, but its adequacy is not validated.
  • domain assumption Group size filtering with threshold alpha removes spurious one-to-one relation groups without removing meaningful small groups.
    Section 2.2; the choice alpha=10 is arbitrary and may discard legitimate small types.
invented entities (1)
  • Named group entities (e.g., 'LiveIn_Europe') independent evidence
    purpose: Serve as new type labels in the hierarchy
    These groups are directly derived from existing graph triples, so each has empirical support within the data; but their semantic validity is assumed.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Unsupervised Hierarchical Grouping of Knowledge Graph Entities." pith.science (2026). https://pith.science/paper/NYCJBNSG

@misc{pith2026190807281,
  author       = {Pith},
  title        = {Pith review of: Unsupervised Hierarchical Grouping of Knowledge Graph Entities},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/NYCJBNSG}},
  note         = {Machine review of arXiv:1908.07281}
}
read the original abstract

Knowledge graphs have attracted lots of attention in academic and industrial environments. Despite their usefulness, popular knowledge graphs suffer from incompleteness of information, especially in their type assertions. This has encouraged research in the automatic discovery of entity types. In this context, multiple works were developed to utilize logical inference on ontologies and statistical machine learning methods to learn type assertion in knowledge graphs. However, these approaches suffer from limited performance on noisy data, limited scalability and the dependence on labeled training samples. In this work, we propose a new unsupervised approach that learns to categorize entities into a hierarchy of named groups. We show that our approach is able to effectively learn entity groups using a scalable procedure in noisy and sparse datasets. We experiment our approach on a set of popular knowledge graph benchmarking datasets, and we publish a collection of the outcome group hierarchies.

Figures

Figures reproduced from arXiv: 1908.07281 by the authors.

Figure 1
Figure 1. Venn diagram of groups of people from a sample of facts about people living in Europe 2 Methods In this section, we present our approach for learning hierarchical groups of entities in knowledge graphs. We divide the pipeline of our method into three segments: (1) entity grouping, (2) computing group similarities and (3) building group hierarchy. In the following subsection, we discuss the motivation for our approac… view at source ↗
Figure 2
Figure 2. An example of extracted location-based group hierarchy of a set of entities from the NELL239 dataset. – YAGO10: a subset of of YAGO3 dataset [15] which contains information mostly about people and their citizenship, gender, and profession knowl￾edge [16]. – NELL239: a subset of NELL dataset [17,18] which contains general knowledge about people, places, sports teams, universities, etc. The above mentioned datasets ar… view at source ↗
Figure 3
Figure 3. An example of extracted gender-based group hierarchy of a set of entities for females from the FB13 dataset [PITH_FULL_IMAGE:figures/full_fig_p007_3.png] view at source ↗

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

24 extracted references · 23 canonical work pages

  1. [1]

    Discovering meta-paths in large heterogeneous information networks

    Changping Meng, Reynold Cheng, Silviu Maniu, Pierre Senellart, and Wangda Zhang. Discovering meta-paths in large heterogeneous information networks. In WWW, pages 754–764. ACM, 2015

  2. [2]

    Type-constrained representation learning in knowledge graphs

    Denis Krompaß, Stephan Baier, and Volker Tresp. Type-constrained representation learning in knowledge graphs. In International Semantic Web Conference (1) , volume 9366 ofLecture Notes in Computer Science , pages 640–655. Springer, 2015

  3. [3]

    Discriminative predicate path mining for fact checking in knowledge graphs.Knowl.-Based Syst., 104:123–133, 2016

    Baoxu Shi and Tim Weninger. Discriminative predicate path mining for fact checking in knowledge graphs.Knowl.-Based Syst., 104:123–133, 2016

  4. [4]

    Representation learning of knowledge graphs with hierarchical types

    Ruobing Xie, Zhiyuan Liu, and Maosong Sun. Representation learning of knowledge graphs with hierarchical types. InIJCAI, pages 2965–2971. IJCAI/AAAI Press, 2016

  5. [5]

    Type prediction in RDF knowledge bases using hierarchical multilabel classification

    André Melo, Heiko Paulheim, and Johanna Völker. Type prediction in RDF knowledge bases using hierarchical multilabel classification. InWIMS, pages 14:1– 14:10. ACM, 2016

  6. [6]

    Improving the quality of linked data using statistical distributions

    Heiko Paulheim and Christian Bizer. Improving the quality of linked data using statistical distributions. Int. J. Semantic Web Inf. Syst. , 10(2):63–86, 2014

  7. [7]

    RDFS and OWL reasoning for linked data

    Axel Polleres, Aidan Hogan, Renaud Delbru, and Jürgen Umbrich. RDFS and OWL reasoning for linked data. InReasoning Web, volume 8067 ofLecture Notes in Computer Science , pages 91–149. Springer, 2013

  8. [8]

    Type inference on noisy RDF data

    Heiko Paulheim and Christian Bizer. Type inference on noisy RDF data. In International Semantic Web Conference (1) , volume 8218 of Lecture Notes in Computer Science, pages 510–525. Springer, 2013

Show all 24 references
  1. [9]

    Link prediction in complex networks: A survey.CoRR, abs/1010.0725, 2010

    Linyuan Lu and Tao Zhou. Link prediction in complex networks: A survey.CoRR, abs/1010.0725, 2010

  2. [10]

    George A. Miller. WordNet: A lexical database for english. Commun. ACM , 38(11):39–41, 1995

  3. [11]

    Translating embeddings for modeling multi-relational data

    Antoine Bordes, Nicolas Usunier, Alberto García-Durán, Jason Weston, and Oksana Yakhnenko. Translating embeddings for modeling multi-relational data. InNIPS, pages 2787–2795, 2013

  4. [12]

    Con- volutional 2d knowledge graph embeddings

    Tim Dettmers, Pasquale Minervini, Pontus Stenetorp, and Sebastian Riedel. Con- volutional 2d knowledge graph embeddings. InAAAI. AAAI Press, 2018

  5. [13]

    Bollacker, Colin Evans, Praveen Paritosh, Tim Sturge, and Jamie Taylor

    Kurt D. Bollacker, Colin Evans, Praveen Paritosh, Tim Sturge, and Jamie Taylor. Freebase: a collaboratively created graph database for structuring human knowledge. In SIGMOD Conference, pages 1247–1250. ACM, 2008

  6. [14]

    Representing text for joint embedding of text and knowledge bases

    Kristina Toutanova, Danqi Chen, Patrick Pantel, Hoifung Poon, Pallavi Choudhury, and Michael Gamon. Representing text for joint embedding of text and knowledge bases. In EMNLP, pages 1499–1509. The Association for Computational Linguistics, 2015

  7. [15]

    Suchanek

    Farzaneh Mahdisoltani, Joanna Biega, and Fabian M. Suchanek. YAGO3: A knowledge base from multilingual wikipedias. InCIDR. www.cidrdb.org, 2015. 10 S.K. Mohamed

  8. [16]

    On approximate reasoning capabilities of low-rank vector spaces

    Guillaume Bouchard, Sameer Singh, and Théo Trouillon. On approximate reasoning capabilities of low-rank vector spaces. InAAAI Spring Syposium on Knowledge Representation and Reasoning (KRR): Integrating Symbolic and Neural Approaches . AAAI Press, 2015

  9. [17]

    Mitchell, William W

    Tom M. Mitchell, William W. Cohen, Estevam R. Hruschka Jr., Partha P. Talukdar, Bo Yang, Justin Betteridge, Andrew Carlson, Bhavana Dalvi Mishra, Matt Gardner, Bryan Kisiel, Jayant Krishnamurthy, Ni Lao, Kathryn Mazaitis, Thahir Mohamed, Ndapandula Nakashole, Emmanouil A. Plat...

  10. [18]

    Mitchell

    Matt Gardner and Tom M. Mitchell. Efficient and expressive knowledge base completion using subgraph feature extraction. InProceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, EMNLP 2015, Lisbon, Portugal, September 17-21, 2015 , pages 1488–1498, 2015

  11. [19]

    Translating embeddings for modeling multi-relational data

    Antoine Bordes, Nicolas Usunier, Alberto García-Durán, Jason Weston, and Oksana Yakhnenko. Translating embeddings for modeling multi-relational data. InAdvances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems 2013. P...

  12. [20]

    A review of relational machine learning for knowledge graphs.Proceedings of the IEEE, 104(1):11–33, 2016

    Maximilian Nickel, Kevin Murphy, Volker Tresp, and Evgeniy Gabrilovich. A review of relational machine learning for knowledge graphs.Proceedings of the IEEE, 104(1):11–33, 2016

  13. [21]

    Mohamed, Vít Novácek, and Pierre-Yves Vandenbussche

    Sameh K. Mohamed, Vít Novácek, and Pierre-Yves Vandenbussche. Knowledge base completion using distinct subgraph paths. InSAC, 2018

  14. [22]

    Knowledgegraph embedding: A survey of approaches and applications.IEEE Trans

    Quan Wang, Zhendong Mao, Bin Wang, and Li Guo. Knowledgegraph embedding: A survey of approaches and applications.IEEE Trans. Knowl. Data Eng. , 29(12):2724– 2743, 2017

  15. [23]

    Suchanek

    Luis Galárraga, Christina Teflioudi, Katja Hose, and Fabian M. Suchanek. Amie: association rule mining under incomplete evidence in ontological knowledge bases. In WWW, 2013

  16. [24]

    Mohamed, Emir Muñoz, Vít Novácek, and Pierre-Yves Vandenbussche

    Sameh K. Mohamed, Emir Muñoz, Vít Novácek, and Pierre-Yves Vandenbussche. Identifying equivalent relation paths in knowledge graphs. InLDK, 2017

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.