Pith. sign in

Paper Citation Record · LEDGER

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems

As of 8 August 2026, this Paper Citation Record lists 24 of 24 outbound references and 0 inbound Pith citation observations for arXiv:2507.13190.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.13190 v1

Coverage vector

measured 24 of 24 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T16:32:46.738028Z

measured 24 of 24 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

24 of 24 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved24
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 58d6ab0e-0c90-4790-b4b3-ceeb014d5590 · outbound

This paper cites GPT-4 Technical Report.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems GPT-4 Technical Report

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:45.283390Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:45.283390Z digest=sha256:c774db2de47aa623ddbce40c330bd398cd584f9f2daa054193479c39185c081c

Observation 07449451-32c7-488c-a017-59e43ca001d9 · outbound

This paper cites Qwen Technical Report.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Qwen Technical Report

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:45.338160Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:45.338160Z digest=sha256:65c59ad544f6b2af5c84e4ad13e9f4a7efeefe6805048f39e484ced71826fc69

Observation 5c9a6b5e-8d3c-485b-a556-63da74bd110b · outbound

This paper cites AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:45.475210Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:45.475210Z digest=sha256:dfec1ad3c77855471e7ad1ce1dd4c46c8e2c76d36e54122dca689bd2aad4dad3

Observation 4d11d178-5f5d-4b4d-bdc3-d211244ca9ab · outbound

This paper cites Training Verifiers to Solve Math Word Problems.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Training Verifiers to Solve Math Word Problems

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:45.546141Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:45.546141Z digest=sha256:57095e60aceaa4a410d87f7e7140a6aec15927c740597393d71b251fa322bd04

Observation 8bc62629-9426-4f48-96c3-c16794dacb28 · outbound

This paper cites an unresolved cited work.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Unresolved cited work

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:45.643734Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:45.643734Z digest=sha256:4024ef63f7591c83c4b61439000a0bd90cc2b7ff0218d7d55fee244c6fababbc

Observation 81d3c6a1-761c-4d88-bad6-77e9022d741e · outbound

This paper cites an unresolved cited work.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Unresolved cited work

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:45.729759Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:45.729759Z digest=sha256:3c359f9bf113ddb1645925fd5b8a1ce92edfc1172e2c9902f9f648621508583f

Observation 83afe228-ee6d-4c49-b5ff-7565bf8a5ccf · outbound

This paper cites The Llama 3 Herd of Models.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems The Llama 3 Herd of Models

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:45.816466Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:45.816466Z digest=sha256:580e41835bfb0ebcbaea59b59c005fea91c2b8fb4be889db1a9cd1dd157266bc

Observation 0eecd898-7752-4d60-8ff6-31a7eb44ee93 · outbound

This paper cites an unresolved cited work.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Unresolved cited work

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:45.925496Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:45.925496Z digest=sha256:a6d36db7ab3d0b2da8c93c9ab6bb1e9b7fa91e67fe972708eab9fa41f3a95a9d

Observation e192a4f0-075f-40db-8531-88ad272a7453 · outbound

This paper cites A Diversity-Promoting Objective Function for Neural Conversation Models.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems A Diversity-Promoting Objective Function for Neural Conversation Models

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:45.993247Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:45.993247Z digest=sha256:ca80d8126960414c42e7dc4d8d7b216a730e126cac243017dbfa2711b60f74b4

Observation 074ee321-72cb-43ee-8d37-8ae80fd88cf0 · outbound

This paper cites an unresolved cited work.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Unresolved cited work

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.054573Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.054573Z digest=sha256:61d570eb537614717678e2ee1f8968bdea2cdecbbb12b8ce543c1a746ada8bfd

Observation 8fd73add-634f-4902-b74d-52e9b3f0d8cb · outbound

This paper cites AgentBench: Evaluating LLMs as Agents.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems AgentBench: Evaluating LLMs as Agents

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.103936Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.103936Z digest=sha256:71256f9f7a32c9f76256bb5a1579000fa1c6f9c37c6e4485cd6f000bf385afcc

Observation e72261ed-8f67-4ffe-93ac-33156ce75bb4 · outbound

This paper cites Ensembling Large Language Models with Process Reward-Guided Tree Search for Better Complex Reasoning.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Ensembling Large Language Models with Process Reward-Guided Tree Search for Better Complex Reasoning

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.143917Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.143917Z digest=sha256:9df535e5303b170cfb8e8d9419439a5ca33ddd8aa87385e85811838a7c2aafad

Observation 893baf41-7972-4e8e-909e-2388a8d46366 · outbound

This paper cites an unresolved cited work.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Unresolved cited work

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.205789Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.205789Z digest=sha256:500960c77e678aef6ec6db3a972704d0ef146b0126b7aaa0adea79abdd6af8d8

Observation 9b28ae04-2316-4f0d-b974-c685b09b41c1 · outbound

This paper cites an unresolved cited work.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Unresolved cited work

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.266733Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.266733Z digest=sha256:58e94142460401ed403825282032cdb46438bdc9a8bb1b1779105db37b02abba

Observation fd6e25a2-9f51-4b9f-87e2-dac3aaf22a78 · outbound

This paper cites an unresolved cited work.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Unresolved cited work

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.282362Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.282362Z digest=sha256:5ec3a7245a134c1a587e957ce8821057546bd911cc5efa5ad979aa0085463829

Observation 0f523a21-9b4f-44bd-8a1a-b89adbe70bbc · outbound

This paper cites an unresolved cited work.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Unresolved cited work

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.341320Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.341320Z digest=sha256:3cc7e0bd295428e74f7ea0fa92a2d67984c85d4d1ede6d11923958fc86c76748

Observation 36654da7-4944-44ec-87eb-dca38f12e7aa · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems LLaMA: Open and Efficient Foundation Language Models

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.406606Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.406606Z digest=sha256:cc71cb7f17f60c2d49319b3ada676a82a6a07a19f9a41e1509612e959fae9a85

Observation d5556b73-0d1a-451d-b9f4-09c04befa02e · outbound

This paper cites AgentDropout: Dynamic Agent Elimination for Token-Efficient and High-Performance LLM-Based Multi-Agent Collaboration.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems AgentDropout: Dynamic Agent Elimination for Token-Efficient and High-Performance LLM-Based Multi-Agent Collaboration

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.438272Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.438272Z digest=sha256:b406148d8ed394444eba863bb2a5f01ba92625b9766eb4599acb641c139a60bc

Observation a4154ee9-0e04-4976-b907-674121c03cae · outbound

This paper cites Qwen3 Technical Report.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Qwen3 Technical Report

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.499381Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.499381Z digest=sha256:edcb934aa29516d6a9d19081f51705940893a881f00ff36c7f13027f763cc4c5

Observation a7e4301c-0efb-4db5-8d2b-41717004db85 · outbound

This paper cites Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.559716Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.559716Z digest=sha256:3a9292f625a6a42f0f4167df8f80722eb5bf863ee84be9bedec9ec34b611915f

Observation a87486a9-6178-49a6-a886-216b62f48280 · outbound

This paper cites G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.583795Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.583795Z digest=sha256:c68a3c6af8bde0fab67a78409e5202dd731f397d217a40a262f3ee9e806f5d6a

Observation bf227277-b30b-4217-8e9d-ec0e940627db · outbound

This paper cites an unresolved cited work.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems Unresolved cited work

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.644031Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.644031Z digest=sha256:eaba16de2291392a0e02b45e52432bd314bf0ab3916dd82f5a6914d3305b2f64

Observation cd993823-0b3f-44c6-9ae6-006e5e06ebff · outbound

This paper cites online" 'onlinestring :=.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems online" 'onlinestring :=

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.704892Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.704892Z digest=sha256:0a4fb88b10d25848512f8b09d977b95b3de47cde5dc55ad380052983ea781261

Observation 9bcfec94-560f-4a08-a2db-dc03f78c66e0 · outbound

This paper cites write newline.

GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems write newline

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-06T16:32:46.738028Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:32:46.738028Z digest=sha256:624af3127adbeb81794a934653fb79eb6056227a083aef80195205f3178a1e7e

Pith citing papers

No inbound Pith citation observations are available.