Pith. sign in

Paper Citation Record · LEDGER

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs

As of 16 August 2026, this Paper Citation Record lists 30 of 30 outbound references and 0 inbound Pith citation observations for arXiv:2505.13098.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.13098 v1

Coverage vector

measured 30 of 30 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-15T20:22:29.970276Z

measured 30 of 30 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-16T06:30:59.297886+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

30 of 30 outbound references displayed

  • verified exact2
  • verified fuzzy10
  • unresolved17
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 54305ba0-7847-4d94-a5a5-b2b35c4ec08e · outbound

This paper cites Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-15T20:22:29.864101Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T20:22:29.864101Z digest=sha256:19137e775919f1b4ce4671dd04072e2832079c7b300cdf896d61ccb4d1946147

Observation 8c370968-4fb9-4d64-920f-9dfbf5e7d9ee · outbound

This paper cites In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-15T20:22:29.868975Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T20:22:29.868975Z digest=sha256:f06738e5c3ee32de01c5a3810a7c268d695b4c8eb7e444bf6f31535f9ba2e1a0

Observation 2cdc5709-859a-4700-be37-404460362226 · outbound

This paper cites In: Holze, J., Tramp, S., Martin, M., Auer, S., Usbeck, R., Krdzavac, N.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs In: Holze, J., Tramp, S., Martin, M., Auer, S., Usbeck, R., Krdzavac, N

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T20:22:30.247299Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-15T20:22:29.872592Z digest=sha256:2bb96896c81c5cfab06b46c712724154578d1d07ed9b7ba4bea244e88869cd62

Observation 37144ce1-282b-4e26-b82a-08949fd0c45d · outbound

This paper cites it - Information Technology (Mar 2025).https://doi.org/10.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs it - Information Technology (Mar 2025).https://doi.org/10

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T20:22:30.237880Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-15T20:22:29.876294Z digest=sha256:b09277872adbae79f33ffd184c8bb9b902ab96ad55bac0a1ee45c005fc55d383

Observation 1a7e14aa-fda9-40e9-87ff-fcc51d19bb1c · outbound

This paper cites In: Salakhutdinov, R., Kolter, Z., Heller, K., Weller, A., Oliver, N., Scarlett, J., Berkenkamp, F.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs In: Salakhutdinov, R., Kolter, Z., Heller, K., Weller, A., Oliver, N., Scarlett, J., Berkenkamp, F

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T20:22:30.228682Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-15T20:22:29.880458Z digest=sha256:a739ca944a5d08d6472bb85c2f223a6cd0e1ed033fe6219424c39c26fc112296

Observation d158c2ea-bad1-42b2-9851-69af15326bbd · outbound

This paper cites In: Proceedings of the 18th International Semantic Web Conference (ISWC).

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs In: Proceedings of the 18th International Semantic Web Conference (ISWC)

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-15T20:22:29.884549Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T20:22:29.884549Z digest=sha256:59001d17281279740502e5302625a8436dd29420b1ae259e8eaeaac7b3955c5d

Observation 7f286be0-5fe1-44bf-9a69-cd3bb679dd23 · outbound

This paper cites https://huggingface.co/spaces/open-llm-leaderboard/open_llm_ leaderboard (2024).

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs https://huggingface.co/spaces/open-llm-leaderboard/open_llm_ leaderboard (2024)

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T20:22:30.219278Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-15T20:22:29.888680Z digest=sha256:b1177adcf7354f46db3b451bd8d9c751e2646f3d4a51192861ba60b4e2b566b6

Observation b0781629-f8f8-4263-bd73-f875691e54a9 · outbound

This paper cites an unresolved cited work.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-15T20:22:30.209407Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-15T20:22:29.892417Z digest=sha256:e37b2948cfcd4a9245a0a32e032e8e9327ddc0ca458364d08494f45bca851803

Observation 2d5cc780-d6df-4496-a2bb-bc7a2f6ed228 · outbound

This paper cites In: The Semantic Web: ESWC 2024 Satellite Events.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs In: The Semantic Web: ESWC 2024 Satellite Events

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-15T20:22:29.895733Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T20:22:29.895733Z digest=sha256:512d48c8a065c07296f6e954971505878533bb1140a94cce7839f61e29199368

Observation f582dba1-3d80-40da-bcd9-e7b2236a82b8 · outbound

This paper cites The Llama 3 Herd of Models.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs The Llama 3 Herd of Models

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-15T20:22:29.899384Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T20:22:29.899384Z digest=sha256:99752d21a3b1de90be4f018a31a317f069a0b1fd366be05de03970b5b54b273a

Observation cd7265fc-aaff-473a-ae44-24fd47807fc4 · outbound

This paper cites DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-15T20:22:29.903984Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T20:22:29.903984Z digest=sha256:6ac35b564817afce8cf87a0c7eaa517aa3b126e75165c61eaf9d9eb7b25e26b8

Observation 718ca8b3-4fca-420c-92e0-fa5bf159af4c · outbound

This paper cites an unresolved cited work.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs Unresolved cited work

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-15T20:22:29.907882Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T20:22:29.907882Z digest=sha256:2611f563560ee6c0f4dfe6491772085d4f7bd23e08df6b41c64d40cdd00db87b

Observation 79f98832-ef47-43bc-9152-f9ccf2a958b7 · outbound

This paper cites In: Fifth International Workshop on Knowledge Graph Construction @ ESWC2024.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs In: Fifth International Workshop on Knowledge Graph Construction @ ESWC2024

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T20:22:30.194407Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-15T20:22:29.911980Z digest=sha256:91a8f17c0b5621b2759afdec6fffb7ed244335d7ba8972f5fb8e6668c8b87072

Observation 14abc1a7-6c1e-45f7-a9a1-fa59cdf6b926 · outbound

This paper cites OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-15T20:22:29.915425Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T20:22:29.915425Z digest=sha256:ed2d6af20954d2f4d82c5c3cf946c734b6a256383d00e1ad6e29c2c6c4697d72

Observation 7b9f6380-2c53-4092-ae6e-93a60fbe89ea · outbound

This paper cites Qwen2.5-Coder Technical Report.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs Qwen2.5-Coder Technical Report

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-15T20:22:29.919276Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T20:22:29.919276Z digest=sha256:e30ca59f71f1e3c49d446994ba05f05f8110cdeab3963d830bb94b2444f366ca

Observation f597875a-4a67-490a-ae5d-1182679ac450 · outbound

This paper cites In: International Conference on Semantic Systems.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs In: International Conference on Semantic Systems

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T20:22:30.184896Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-15T20:22:29.923217Z digest=sha256:cf0d266ef585b843759447175b18244607d03838df8f627f8d6bddbf1d46cda3

Observation 827c0478-003e-44ca-afc9-15d06a61df1f · outbound

This paper cites In: Proceedings of the ACM SIGOPS 29th Symposium on Operating Systems Principles (2023).

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs In: Proceedings of the ACM SIGOPS 29th Symposium on Operating Systems Principles (2023)

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T20:22:30.175504Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-15T20:22:29.926621Z digest=sha256:90c5a74d257c365293014991abc1d77d4839213299affc7989ac0d0ba225650b

Observation 3950c820-dd66-486e-bf5e-b65e403992db · outbound

This paper cites Holistic Evaluation of Language Models.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs Holistic Evaluation of Language Models

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-15T20:22:29.929741Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T20:22:29.929741Z digest=sha256:d3f3438c9c46ae0062932ed4ca19b160387fa8edf2d7807d58b4caba3645a378

Observation fd07341d-1e92-4634-b13a-1c31e9995c21 · outbound

This paper cites Advances in Neural Information Processing Systems36 (2024).

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs Advances in Neural Information Processing Systems36 (2024)

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-15T20:22:29.933258Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T20:22:29.933258Z digest=sha256:a6775c9eda1c198aa1de52588efbfe8b02a2ef6065f84a0be4822e9660086bfe

Observation 3bb83624-bae6-40c7-ae96-843ca3fb9a5c · outbound

This paper cites In: Vakaj, E., Iranmanesh, S., Stamartina, R., Mihindukula- sooriya, N., Tiwari, S., Ortiz-Rodríguez, F., Mcgranaghan, R.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs In: Vakaj, E., Iranmanesh, S., Stamartina, R., Mihindukula- sooriya, N., Tiwari, S., Ortiz-Rodríguez, F., Mcgranaghan, R

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T20:22:30.159674Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-15T20:22:29.936838Z digest=sha256:1cb94861b46c14ae114cb9291239f45eb2ffd01c42150f43ee67f61738b35535

Observation 485f0e73-18f2-4d3a-a26c-031b4135f2d6 · outbound

This paper cites In: Keshan, N., Neumaier, S., Gentile, A.L., Vahdati, S.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs In: Keshan, N., Neumaier, S., Gentile, A.L., Vahdati, S

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T20:22:30.148644Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-15T20:22:29.940357Z digest=sha256:42bb6e274be47d7199d1bee3195398f3f348875a3a860ebb7f09da2461005215

Observation b39dde60-a780-4812-8cea-b25b77592a1e · outbound

This paper cites In: Zinke-Wehlmann, C., Friedrich, J.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs In: Zinke-Wehlmann, C., Friedrich, J

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-15T20:22:29.943775Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T20:22:29.943775Z digest=sha256:3b05c294a0c81b0801a7d3005c33742e04fa27ef06c9e6bc50e5f5358128a374

Observation 913fee12-cf3a-47cf-b56d-df492129a9b8 · outbound

This paper cites In: Payne, T.R., Presutti, V., Qi, G., Poveda-Villalón, M., Stoilos, G., Hollink, L., Kaoudi, Z., Cheng, G., Li, J.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs In: Payne, T.R., Presutti, V., Qi, G., Poveda-Villalón, M., Stoilos, G., Hollink, L., Kaoudi, Z., Cheng, G., Li, J

Reference 23

Resolution
verified exact
doi, observed 2026-08-15T20:22:30.015415Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-15T20:22:29.947145Z digest=sha256:e80a97cb8e833134c63b08137e9eefd8cbedb122f84b9eb3cfbda684d3c4301f

Observation f5494c7e-9f43-4cfe-850f-395dda5ed21b · outbound

This paper cites IEEE Transactions on Knowledge and Data Engineering (TKDE) (2024).

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs IEEE Transactions on Knowledge and Data Engineering (TKDE) (2024)

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-15T20:22:29.950641Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T20:22:29.950641Z digest=sha256:9ed78f2baea3d8283db2de8b0b7809d6193aabba95adc968bbd2b763758fdc81

Observation 8a82ec51-4a75-4049-9785-8ca355850fbe · outbound

This paper cites StructuredRAG: JSON Response Formatting with Large Language Models.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs StructuredRAG: JSON Response Formatting with Large Language Models

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-15T20:22:29.954377Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T20:22:29.954377Z digest=sha256:c0d88f54a859fbdffed48872902446a92088c0beff1925f1d7c916e890114986

Observation 2f561616-46be-4b82-821a-28e185f7cbb9 · outbound

This paper cites Transactions on Machine Learning Research (2023).

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs Transactions on Machine Learning Research (2023)

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T20:22:30.139233Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-15T20:22:29.957753Z digest=sha256:cf7d00789c674af3b6d3f0e6b26fb1acc1f3c9418583afd39414dd3e19e7c188

Observation 120507c2-998c-4481-bafd-f5cca9e48de1 · outbound

This paper cites Seman- tic Web10(2), 293–304 (Jan 2019).https://doi.org/10.3233/sw-180312.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs Seman- tic Web10(2), 293–304 (Jan 2019).https://doi.org/10.3233/sw-180312

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-15T20:22:29.960838Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T20:22:29.960838Z digest=sha256:7aea5cb715765f3f0de9912fd54ea90b6c6d2b1ec9ffa4bd5a9101710a31f35b

Observation 20f5158b-dd30-4674-9dc0-266c90482c9b · outbound

This paper cites an unresolved cited work.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs Unresolved cited work

Reference 28

Resolution
unresolved
raw_fallback, observed 2026-08-15T20:22:30.129104Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-15T20:22:29.964046Z digest=sha256:2f346f563d23cbee8438c99b76d11a177b1b22ccd2888f8c0713606d44c59cf1

Observation baf45f32-0933-4cfb-916a-9a9815d22d3d · outbound

This paper cites In: SEMANTiCS 2024: Knowledge Graphs in the Age of Language Models and Neuro-Symbolic AI.

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs In: SEMANTiCS 2024: Knowledge Graphs in the Age of Language Models and Neuro-Symbolic AI

Reference 29

Resolution
malformed identifier
raw_fallback, observed 2026-08-15T20:22:30.118771Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-15T20:22:29.967342Z digest=sha256:7d8ac98b29aa0119b3bf92c4e75d89f97633d0cc02f8bd7f62c8edb06f244762

Observation aff39ffb-53c2-49b6-8ee7-d0a53674f942 · outbound

This paper cites World Wide Web27(5) (Aug 2024).

LLM-KG-Bench 3.0: A Compass for SemanticTechnology Capabilities in the Ocean of LLMs World Wide Web27(5) (Aug 2024)

Reference 30

Resolution
verified exact
doi, observed 2026-08-15T20:22:30.108966Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-15T20:22:29.970276Z digest=sha256:3edd3bb255de1c47b959ca9c0fb9467cd009a5458f11469574111c96f5e49c75

Pith citing papers

No inbound Pith citation observations are available.