Paper Citation Record · LEDGER

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison

As of 7 August 2026, this Paper Citation Record lists 21 of 21 outbound references and 0 inbound Pith citation observations for arXiv:2507.03013.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.03013 v1

Coverage vector

measured 21 of 21 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T20:50:01.451559Z

measured 21 of 21 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-06T06:34:29.942622+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

21 of 21 outbound references displayed

verified exact0
verified fuzzy14
unresolved7
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 238ac2ce-8006-4483-9c2b-232e387a1e9f · outbound

This paper cites Calculus I.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison Calculus I

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T20:50:04.901093Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation dac3033c-454b-44d6-8297-ecc0a9605c52 · outbound

This paper cites SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Models.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Models

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-06T20:49:59.628786Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c33cabee-cfda-4fee-adef-ec1a8fd2ea2d · outbound

This paper cites an unresolved cited work.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison Unresolved cited work

Reference 3

Resolution: unresolved; raw_fallback, observed 2026-08-06T20:50:04.437614Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 95e7b403-83b5-41df-bffb-e670fbc97e41 · outbound

This paper cites an unresolved cited work.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison Unresolved cited work

Reference 4

Resolution: unresolved; raw_fallback, observed 2026-08-06T20:50:04.671956Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation a17cef9d-53a5-45f8-8834-70a8de363a0c · outbound

This paper cites MCQ" (Multiple Choice Question) –.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison MCQ" (Multiple Choice Question) –

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T20:50:04.030657Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 84c8aef2-3ff4-4d84-9d8f-fa23d0506e8b · outbound

This paper cites an unresolved cited work.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison Unresolved cited work

Reference 6

Resolution: unresolved; raw_fallback, observed 2026-08-06T20:50:04.207784Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation f44f7ea2-a59c-42ba-acfa-3db8024985f7 · outbound

This paper cites Crucial" (Essential for solving the question) –.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison Crucial" (Essential for solving the question) –

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T20:50:03.631322Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation fb8ab03f-f0af-4568-b332-0fa4abb1383d · outbound

This paper cites line plot.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison line plot

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T20:50:03.815793Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 2140bce1-cdbd-4e7a-8064-3797e378da49 · outbound

This paper cites an unresolved cited work.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison Unresolved cited work

Reference 9

Resolution: unresolved; raw_fallback, observed 2026-08-06T20:50:03.245872Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 0ca099ce-84ae-4a76-a0e2-c53108788f51 · outbound

This paper cites Complex" doesn’t necessarily mean that the problem is difficult. It simply means that many conditions are in play. • Possible Labels: –.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison Complex" doesn’t necessarily mean that the problem is difficult. It simply means that many conditions are in play. • Possible Labels: –

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T20:50:03.441249Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation fec44437-c7ca-457f-8210-bc46055e20a7 · outbound

This paper cites • Example: 1, 2.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison • Example: 1, 2

Reference 11

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T20:50:02.941985Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation dda06bea-bbf8-4d51-9e6e-125649b083cd · outbound

This paper cites an unresolved cited work.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison Unresolved cited work

Reference 12

Resolution: unresolved; raw_fallback, observed 2026-08-06T20:50:03.116008Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 0221bf65-abfb-4c5d-aa0f-d1d6a1172a3a · outbound

This paper cites • Example: "French".

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison • Example: "French"

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T20:50:02.610321Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 6433a6ee-1bce-4edc-b389-c1139969166b · outbound

This paper cites • Always in "English" because we trans- lated the French ones.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison • Always in "English" because we trans- lated the French ones

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T20:50:02.802617Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation ab94721f-fdba-4279-a43c-f44ec4284b0e · outbound

This paper cites PNG", "JPEG.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison PNG", "JPEG

Reference 15

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T20:50:02.326397Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation cbf8fee2-53db-4f25-bba6-26da03d274d0 · outbound

This paper cites • Possible Values: true or false.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison • Possible Values: true or false

Reference 16

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T20:50:02.468144Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 5df4fa65-02cf-431a-a070-604ec84f7586 · outbound

This paper cites Unique answer.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison Unique answer

Reference 17

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T20:50:01.965268Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 6a7f5942-cc94-4d2d-b2b0-aefc081ddbb9 · outbound

This paper cites Only MCQ Letter.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison Only MCQ Letter

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T20:50:02.120723Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 91b4dc3e-53fa-4b68-8e50-6d6488c33d4f · outbound

This paper cites All Independent.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison All Independent

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T20:50:01.663292Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 553f49a6-9365-45a4-a310-ff928dce3960 · outbound

This paper cites LaTeX",.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison LaTeX",

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T20:50:01.826461Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 9b814922-26e9-4818-86b5-745efd6faec7 · outbound

This paper cites Have LLMs Advanced Enough? A Challenging Problem Solving Benchmark For Large Language Models.

Challenges for AI in Multimodal STEM Assessments: a Human-AI Comparison Have LLMs Advanced Enough? A Challenging Problem Solving Benchmark For Large Language Models

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-06T20:49:59.497562Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.