Pith. sign in

Paper Citation Record · LEDGER

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis

As of 8 August 2026, this Paper Citation Record lists 100 of 142 outbound references and 4 inbound Pith citation observations for arXiv:2505.18223.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.18223 v2

Coverage vector

measured 100 of 142 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T14:46:56.334492Z

measured 104 of 104 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 4 of 4 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-04T02:02:25.908482Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

100 of 142 outbound references displayed

  • verified exact0
  • verified fuzzy15
  • unresolved84
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

0
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

Observation ecc08bef-6e53-407b-90a6-bd6714fc6d3b · outbound

This paper cites https://openai.com/chatgpt/overview/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://openai.com/chatgpt/overview/

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:47.375570Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:47.375570Z digest=sha256:ae13cb61f7da48db680017b0aa45f80f2ffbbbf330c7373dc316106bae0cefbd

Observation a41767eb-7ca6-4088-954c-269d6eab8387 · outbound

This paper cites https://kdigo.org/guidelines/ ckd-evaluation-and-management/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://kdigo.org/guidelines/ ckd-evaluation-and-management/

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:47.422036Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:47.422036Z digest=sha256:fe09194bc494bea93b3d38e8566bf79f1b53aff14151c72500edfeb9cf5778b5

Observation 0ec5e043-740e-41ab-8cc8-d2b9a2160b9a · outbound

This paper cites https://claude.ai/login?returnTo=%2F%3F.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://claude.ai/login?returnTo=%2F%3F

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:47.538518Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:47.538518Z digest=sha256:6e27fb02915553a309e719f616c281b6d3d7583f59f24e093f0c9fc3086a2dad

Observation ed4e1285-fefe-4e8d-b6e1-3edd4299a2fd · outbound

This paper cites https://www.deepseek.com/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://www.deepseek.com/

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:47.644511Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:47.644511Z digest=sha256:ba82de7215e17bb29ee887439a867adad5cbbf1c60244246a44f4e86bef4c14e

Observation 17dcf292-639c-4df1-92b5-313b86dbeed5 · outbound

This paper cites https:// playwright.dev/python/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https:// playwright.dev/python/

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:47.751152Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:47.751152Z digest=sha256:e0d7f706db1d7618782c07f0d7219e0ba87d35a524b0ebc7ecaff6c1c398b9d5

Observation 12090ef0-2de9-4b51-96f1-f07cf0f1200c · outbound

This paper cites https://gemini.google.com/app.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://gemini.google.com/app

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:47.835901Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:47.835901Z digest=sha256:52e610e18fb17538f9af7b3aeb1fbaf0491f3f0b7422018ce50d813e223c0fdb

Observation 77e27f61-5a20-4d86-9a52-6596c68fba6f · outbound

This paper cites https://grok.com/?ref=findaitools.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://grok.com/?ref=findaitools

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:47.906553Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:47.906553Z digest=sha256:4717f229b110b1b2e4244988c903078b78205a924a5a6d53ffed0b6fa80983a7

Observation fd3e7bcf-80ca-424c-b9ed-081d2689aa73 · outbound

This paper cites https://openai.com/index/ improvements-to-data-analysis-in-chatgpt/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://openai.com/index/ improvements-to-data-analysis-in-chatgpt/

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.019029Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.019029Z digest=sha256:67da5a6c207d0fbfd6c22dd64455acb3dcafd1d7aca20eae433d524da4d9a19c

Observation fcae7a13-e180-435e-b35e-8df02835c009 · outbound

This paper cites https://www.anthropic.com/news/ analysis-tool.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://www.anthropic.com/news/ analysis-tool

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.103552Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.103552Z digest=sha256:4d9dac3f3fdec795854a643a5c1805d8644dedd9d9194a5a241f811f25f91e34

Observation 8e32d172-f5d9-4b65-9f9e-b1af06aa87a9 · outbound

This paper cites https://github.com/ jupyterlab/jupyter-ai.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://github.com/ jupyterlab/jupyter-ai

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.197118Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.197118Z digest=sha256:9b7c6ce182e589b05d3a5b47c7ebdb196578b1e1426038725425b377ef30ae9b

Observation 17cef869-52e8-44ac-818f-818f24ec8b60 · outbound

This paper cites https://www.kaggle.com/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://www.kaggle.com/

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.280980Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.280980Z digest=sha256:a9b2402a273e998e9425b31fa635019c3baaa8eaafd406a817a8fa12aa906ffc

Observation 220e6105-e3d3-44f4-a087-ef6266520e49 · outbound

This paper cites https://docs.litellm.ai/docs/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://docs.litellm.ai/docs/

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.354070Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.354070Z digest=sha256:c7c77ee3e5e69e0489e24ff76c6fa7264983f434576915f900e63cc8e1e20dbb

Observation b327b415-f453-4565-a74a-c816d7cf279e · outbound

This paper cites https://www.llama.com/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://www.llama.com/

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.461121Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.461121Z digest=sha256:3eb81faf1287be216364842b17dc93000823720eac0c2d634a90b401de77a1f9

Observation e1af57cb-18b0-401e-bcf5-60318fa7072a · outbound

This paper cites https://corporatefinanceinstitute.com/ resources/financial-modeling/modeloff-guide/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://corporatefinanceinstitute.com/ resources/financial-modeling/modeloff-guide/

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.539289Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.539289Z digest=sha256:92340a38c2f9674493490cec15c6c78c8394067c32c1d563bce76c9c32839013

Observation f29a29f3-9504-43be-b4fe-f2acdad40c95 · outbound

This paper cites https://openai.com/index/ o3-o4-mini-system-card/.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://openai.com/index/ o3-o4-mini-system-card/

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.624374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.624374Z digest=sha256:44c1af5a73c846cda8abf1ba8295ecb4c9753a75ffd098b18dc76a3b11cf4222

Observation 55ecbb75-05d9-4bc2-a787-3e58880c994e · outbound

This paper cites https://kaggle.com/code/alexisbcook/titanic-tutorial.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://kaggle.com/code/alexisbcook/titanic-tutorial

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.716807Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.716807Z digest=sha256:47fbc11fc5d3ba90b71b52551c1dc786ea23e1ce2d65bcfc1957845af515ff51

Observation 4687eb9c-b3e6-4030-8e45-1afd5713a692 · outbound

This paper cites https://www.vectara.com/blog/ deepseek-r1-hallucinates-more-than-deepseek-v3 , January 2025.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis https://www.vectara.com/blog/ deepseek-r1-hallucinates-more-than-deepseek-v3 , January 2025

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.823526Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.823526Z digest=sha256:c8729012f136fe4c27d83b8879b5b04d58e1ab5c8967588575ca86f2c83e17cb

Observation a698d4cf-d334-407d-af67-bf19a9a02aef · outbound

This paper cites Open Interpreter, May 2025.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Open Interpreter, May 2025

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:48.901910Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:48.901910Z digest=sha256:91b298fd362d4ad582207eedfe4430e082f35f77fe95604272e974fa5c685bc8

Observation 07a9dd83-13f9-4c37-9576-b59a4c52162f · outbound

This paper cites Wang, Ruoxi Sun, Pengcheng Yin, Caiming Xiong, Ansong Ni, Qian Liu, et al.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Wang, Ruoxi Sun, Pengcheng Yin, Caiming Xiong, Ansong Ni, Qian Liu, et al

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:49.002506Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:49.002506Z digest=sha256:38d60ff32f3812090da998ee6a396c6b990d132484e99ec7a49c1a2efa96c105

Observation 8ad22ae2-09e4-42c1-aab4-d0d2f5cb6386 · outbound

This paper cites Beyond Prompts: Dynamic Conversational Benchmarking of Large Language Models.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Beyond Prompts: Dynamic Conversational Benchmarking of Large Language Models

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:49.146885Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:49.146885Z digest=sha256:e63844fb8a7e9fbf2a946b63df854c447bfc0eda2d2830f3526f123c50702442

Observation 2e918e4a-0b65-44f3-9b62-c41910c0a583 · outbound

This paper cites MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:49.237419Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:49.237419Z digest=sha256:a6f5304f8b7b8995cb00d55a4a969e1e132a5362ecb1e72920b459caf19d6c74

Observation df06d733-c902-43df-9227-a54d2731aed1 · outbound

This paper cites Early Childhood Behavioral Inhibition and Social and School Adjustment in Chinese Children: A 5-Year Longitudinal Study.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Early Childhood Behavioral Inhibition and Social and School Adjustment in Chinese Children: A 5-Year Longitudinal Study

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:49.345478Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:49.345478Z digest=sha256:83f045097d4c8a534cec392aee397671c5890242817f5358365178e1e3c4eb5d

Observation eca5cf31-f3d9-4976-a35d-880601388019 · outbound

This paper cites Behavioral Inhibition in Early Childhood and Adjustment in Late Adolescence in China.Child Development, 92(3):994–1010, 2021.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Behavioral Inhibition in Early Childhood and Adjustment in Late Adolescence in China.Child Development, 92(3):994–1010, 2021

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:49.442113Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:49.442113Z digest=sha256:ca7ca136b58bab408acf9527f2aeabb103db21b2f466f3d9e32084cef14eb377

Observation 5c903be9-bd00-43ea-b1e0-4fbf847208b4 · outbound

This paper cites Baker, Benjamin Burns, Daniel Adu-Ampratwum, Xuhui Huang, Xia Ning, Song Gao, Yu Su, and Huan Sun.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Baker, Benjamin Burns, Daniel Adu-Ampratwum, Xuhui Huang, Xia Ning, Song Gao, Yu Su, and Huan Sun

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:49.506686Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:49.506686Z digest=sha256:5e25c8353ef39044c15949d80eb46c2c7e791e7a96c6830e549cf5f44d5c67a5

Observation 87564adc-cdd4-4ac4-bdad-8f60b51a973e · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:49.644779Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:49.644779Z digest=sha256:b6199c6fefd9917be493f65b3dcdc3cac67bc35843f02e79b617fbad85024aa5

Observation 1e3b15ee-293c-4733-b6e3-4af49fde5232 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:49.774028Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:49.774028Z digest=sha256:2a842a677ae2f9e31e77e006e8bfd5b75127a377efa03b7f6ce5dbff631aeeb2

Observation 9ead89f3-e925-4acf-8c66-4ffe2717f0da · outbound

This paper cites MIND2WEB: Towards a generalist agent for the web.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis MIND2WEB: Towards a generalist agent for the web

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:49.890873Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:49.890873Z digest=sha256:b31094798c61ccdf223e43f9bdccb97f02b06302636c4e7b79b4149a16e350ca

Observation 2fe20fad-f943-4737-bda9-c6edd4795ac7 · outbound

This paper cites Zhang, Lanyi Zhu, Mike A Merrill, Jeffrey Heer, and Tim Althoff.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Zhang, Lanyi Zhu, Mike A Merrill, Jeffrey Heer, and Tim Althoff

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.005144Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.005144Z digest=sha256:8fdb3710afabf70be88ee3e552374911e318dbc23398528374aac3b6d1d344d6

Observation 067149e5-a82c-4071-bb41-2f4c2f1f42f7 · outbound

This paper cites ConvCodeWorld: Bench- marking Conversational Code Generation in Reproducible Feedback Environments.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis ConvCodeWorld: Bench- marking Conversational Code Generation in Reproducible Feedback Environments

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.104495Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.104495Z digest=sha256:b20a16e167e0425422f8d9e56e264619741b7eddc4d24af0f57eb0217dc83312

Observation 60934f52-c90c-4d92-92cc-cf81c547b73b · outbound

This paper cites InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.185494Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.185494Z digest=sha256:8dfde18511d2d53f6f2054f5518904a55d3a825533b718883fad676b2526f1ca

Observation d5ed60d4-38f9-460b-b43b-87f2e4bb42fa · outbound

This paper cites MLAgentBench: Evaluating language agents on machine learning experimentation.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis MLAgentBench: Evaluating language agents on machine learning experimentation

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.278411Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.278411Z digest=sha256:721771f1e1f536c492f1c7349a13c2ba9715c30a0acd7ed8d8b70ab9781c4caf

Observation 00c6d552-a65e-4b11-b0d8-dd904dcedb00 · outbound

This paper cites SimulBench: Evaluating Language Models with Creative Simulation Tasks.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis SimulBench: Evaluating Language Models with Creative Simulation Tasks

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.397300Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.397300Z digest=sha256:ab010dd722d1b3b6143011873ac2adc919d3669fa51ee10d4e6cc6731c78bb5d

Observation 73a77602-0ddb-4a60-8045-dc76370cd9e9 · outbound

This paper cites Taylor, and Dan Roth.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Taylor, and Dan Roth

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.501633Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.501633Z digest=sha256:0b391bca1ab2c5f9b776fc42706a0a3cc56091d243658bbcad430389036e68fa

Observation df4daca1-9a70-4436-ba7a-c4b4b2c4e9f8 · outbound

This paper cites AIDE: AI-Driven Exploration in the Space of Code, February 2025.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis AIDE: AI-Driven Exploration in the Space of Code, February 2025

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.600200Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.600200Z digest=sha256:bd255da44ef6db1522131c421e07a0308336df0b33bac71915a5266066897a92

Observation 55507d96-4c19-4e77-9c5e-00ed4191bdb0 · outbound

This paper cites Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik R.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik R

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.674757Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.674757Z digest=sha256:3605a456c02b94be48d100bebf9a9d8f1ebc070547eafa90a0a74b6670edab7d

Observation 85873741-2204-46ab-8cf8-1ba307bdc009 · outbound

This paper cites DSBench: How Far Are Data Science Agents from Becoming Data Science Experts? In The Thirteenth International Conference on Learning Representations, October 2024.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis DSBench: How Far Are Data Science Agents from Becoming Data Science Experts? In The Thirteenth International Conference on Learning Representations, October 2024

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.748889Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.748889Z digest=sha256:606f4a61a58c93a3058ad8dd57ea6465c4ef1ab07fcd1e24f82b68f14dee6b81

Observation 9b0cbea0-f729-4ed9-b56d-f03645362316 · outbound

This paper cites LLMs Get Lost In Multi-Turn Conversation, May 2025.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis LLMs Get Lost In Multi-Turn Conversation, May 2025

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.824763Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.824763Z digest=sha256:36fd1c06baceeb5c8b6ac5b94752cae6f5d456c377d5c0b4945805638efa2664

Observation a1199356-618e-42fd-bdfc-e50642333817 · outbound

This paper cites DS-1000: A natural and reliable benchmark for data science code generation.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis DS-1000: A natural and reliable benchmark for data science code generation

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:50.906565Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:50.906565Z digest=sha256:10b0b9fde1c98ab9a66543615892467a86f71ecf8183d7f3ee63e119933a8b1e

Observation 5f43f6a3-b435-41d4-8e79-db623e2813f6 · outbound

This paper cites Leonard, Nathan Kuppermann, Cody Olsen, Lynn Babcock-Cimpello, Kathleen Brown, Prashant Mahajan, Kathleen M.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Leonard, Nathan Kuppermann, Cody Olsen, Lynn Babcock-Cimpello, Kathleen Brown, Prashant Mahajan, Kathleen M

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.006372Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.006372Z digest=sha256:b10298e5978a1921ff04bb83c4d64bb2b450b4bcdb63b6e5fdcd788d2aaae245

Observation ed27d3d4-fbaa-41c4-be84-3ad53b669655 · outbound

This paper cites Tapilot-Crossing: Benchmarking and Evolving LLMs Towards Interactive Data Analysis Agents, March 2024.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Tapilot-Crossing: Benchmarking and Evolving LLMs Towards Interactive Data Analysis Agents, March 2024

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.093050Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.093050Z digest=sha256:27a445cac39dde9690be7bd2df0e92912a0c3f28ae238a5f19fae5b281eb2804

Observation 2c76353b-32fe-49dc-a1f9-af89600519a1 · outbound

This paper cites ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilities.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilities

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.229090Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.229090Z digest=sha256:07bb193d5770069811eebdb7cab2f3d6f8d085cad7b4774dfddf4837aa1328c4

Observation 1c0c93ff-7d7d-4af5-9ab0-2ac602e76c00 · outbound

This paper cites Nigrovic, Alexander J.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Nigrovic, Alexander J

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.348204Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.348204Z digest=sha256:6938210e8955c52e85dddb8d6ab7e0751ea6f3f34ad0413a7f47fec356e62eb2

Observation 4b1a4f80-c4f0-4818-84fc-50219cf352ac · outbound

This paper cites Missing Women and the Price of Tea in China: The Effect of Sex-Specific Earnings on Sex Imbalance.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Missing Women and the Price of Tea in China: The Effect of Sex-Specific Earnings on Sex Imbalance

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.447780Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.447780Z digest=sha256:ebb818255dea2dc9ec7027705351205ede9a22d03a6e4a55baa6fe3093d616f4

Observation bcdc709e-79db-4d47-9f3f-95d223eb86eb · outbound

This paper cites Bishop, Wei Li, Folawiyo Campbell-Ajala, Daniel Kenji Toyama, Robert James Berry, Divya Tyamagundlu, Timothy P.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Bishop, Wei Li, Folawiyo Campbell-Ajala, Daniel Kenji Toyama, Robert James Berry, Divya Tyamagundlu, Timothy P

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.529329Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.529329Z digest=sha256:bc51a6dfd39fd1e683fca29f6099f88131828b84dd8ccb80893195144f8be6d9

Observation 73ec0527-2e98-4d3a-97f3-eaa7ef0d0496 · outbound

This paper cites AutoGPT, May 2025.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis AutoGPT, May 2025

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.643489Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.643489Z digest=sha256:281178d463998c7888b245e5e80f735ba5a6c520ea06a6bfe88e70db81822f63

Observation ef18b500-757c-4525-931c-0ac560ad1db1 · outbound

This paper cites Increasing Trans- parency Through a Multiverse Analysis.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Increasing Trans- parency Through a Multiverse Analysis

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.738296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.738296Z digest=sha256:6e5421e19e2c8dddac8e96a973950c5eaf7f9b1b9fef8a8982619159dacd678d

Observation 198f234e-32b0-4d2d-ab5b-39686a365605 · outbound

This paper cites Sullivan, Wanze Xie, Stefania Conte, John E.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Sullivan, Wanze Xie, Stefania Conte, John E

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.858250Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.858250Z digest=sha256:e0a5097bf4359d9e8ee2eade33197db0184600efdf403555073cf7cd4f07ece8

Observation 3e7f517e-40f4-49a4-ae03-559ae0e85d12 · outbound

This paper cites A macroscope in the redwoods.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis A macroscope in the redwoods

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:51.942137Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:51.942137Z digest=sha256:3daf90c53dc0edfd1d402c506ecc2c47de6e4dd7f6faabb417e29b9c5c2ff575

Observation b0f11a23-7418-481d-91f1-20ccdb91cd60 · outbound

This paper cites Meeseeks: An Iterative Benchmark Evaluating LLMs Multi-Turn Instruction- Following Ability, April 2025.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Meeseeks: An Iterative Benchmark Evaluating LLMs Multi-Turn Instruction- Following Ability, April 2025

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.023348Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.023348Z digest=sha256:0dcc259ff27c5b79514cca28b19e568da0f4d908210930c8bd9fdb4e7bd64adf

Observation 30c605ce-766a-424f-80b7-25f95ad3fa4b · outbound

This paper cites CodeFlowBench: A Multi-turn, Iterative Benchmark for Complex Code Generation, April 2025.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis CodeFlowBench: A Multi-turn, Iterative Benchmark for Complex Code Generation, April 2025

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.114734Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.114734Z digest=sha256:1fb7fc158b059e455fcc267facdeeeafb8ac196b857ec062186b4c1424a6924a

Observation 8a4f9766-4b2d-4c38-b962-8fed31bcdae1 · outbound

This paper cites White, Doug Burger, and Chi Wang.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis White, Doug Burger, and Chi Wang

Reference 51

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.198472Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.198472Z digest=sha256:ce32c110a59b0c4cc5bd21fd04313f2e8de7d72bf86a9e13ba75978dea16d5c4

Observation 5987d22d-b5c8-4ae0-ad9c-57b282e34dbf · outbound

This paper cites OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

Reference 52

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.286596Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.286596Z digest=sha256:67ada479317398a218338b3b1d6bc80b7d36ab809d9a8083431a9bced01bc71b

Observation 294be3d0-06e5-4202-8929-1cbdf00938eb · outbound

This paper cites InterCode: Standardizing and benchmarking interactive coding with execution feedback.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis InterCode: Standardizing and benchmarking interactive coding with execution feedback

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.403469Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.403469Z digest=sha256:647f6ed5a254efaeeed83778d823b3fe0038e82f505cf55827a81b9bad670422

Observation 19e12766-6598-4602-8ab0-9bc7d65ded46 · outbound

This paper cites Narasimhan.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Narasimhan

Reference 54

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.503874Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.503874Z digest=sha256:d5f40baaa513de0d4a94686b9169cddb9a049470bafda9c0f456252f280623eb

Observation 8148cacd-91a5-4586-aa76-da92dcbe8311 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 55

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.612890Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.612890Z digest=sha256:7c14cfd52d779852337608e68bed0c24fa2a8501eae933c227657e898d1dae89

Observation 6a4904fb-7fca-4e45-9db5-b539db6374c3 · outbound

This paper cites Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving, April 2025.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving, April 2025

Reference 56

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.694797Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.694797Z digest=sha256:5be7795426731afad4803054d09be0baca71295fe0fd02c08701f0812bee7897

Observation 4b4f32a7-31a7-4744-bce7-7c995da0c51b · outbound

This paper cites Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflow.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflow

Reference 57

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.802633Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.802633Z digest=sha256:1268a3624693b990e938d9d3515de1b59e2f57b28aeeadbead60d52aa0110f62

Observation 5e4f68f8-7906-4b43-8340-c8a768d3462f · outbound

This paper cites Benchmarking Data Science Agents.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Benchmarking Data Science Agents

Reference 58

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:52.895292Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:52.895292Z digest=sha256:bf5dba10ca8d587f996dc1ae9e67308f72ef5e2e8b9dd1648c460284bcfc42d3

Observation d62c35ab-2a66-4820-a555-1998df3afb02 · outbound

This paper cites Decision Company.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Decision Company

Reference 59

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:53.012811Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:53.012811Z digest=sha256:b0a8331ead90544c67c1b2e0ebc453ac0fa508a4de8cff1ab34e02249057d8a4

Observation 356f18bc-fadf-4c13-bec4-a7172f015410 · outbound

This paper cites - Before taking consequential actions that update the dataset, list the action details and obtain explicit user confirmation (yes) to proceed.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis - Before taking consequential actions that update the dataset, list the action details and obtain explicit user confirmation (yes) to proceed

Reference 60

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:53.058249Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:53.058249Z digest=sha256:3ccb28676f0fc85868503fa2fc04d34e238913e8d718ce883d41176eab2c7c8e

Observation 6819f32e-4dc1-4839-9183-084ef4b1f2e6 · outbound

This paper cites - Output: Use print() exclusively -- no but no other methods (e.g., plt.show(), returns).

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis - Output: Use print() exclusively -- no but no other methods (e.g., plt.show(), returns)

Reference 61

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:53.129886Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:53.129886Z digest=sha256:1b682d6485fd58da15c442cf58b0346f2ce6805d8ab55bbdb61597b021a5e517

Observation 4911b584-05ff-4b84-ae10-f91610a2d0e4 · outbound

This paper cites - Adding analysis beyond the requested task.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis - Adding analysis beyond the requested task

Reference 62

Resolution
unresolved
no resolver link, observed 2026-08-07T14:46:53.208871Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:46:53.208871Z digest=sha256:d1b8fcc304403346c68d10377769d673666f77a6cd4ddf7652b52dcef9441d34

Observation eefe7998-fe8e-4f12-b1ca-ba53432410a1 · outbound

This paper cites The user has given you full permission to execute any code necessary to complete the task.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis The user has given you full permission to execute any code necessary to complete the task

Reference 63

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:15.354088Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:53.289214Z digest=sha256:42a14cdced6d79db3ce4244568e981ce82ca050f3ec3df75262adbf6fb5c9b40

Observation c95f9d02-1841-4e00-ba1b-1acacb25a166 · outbound

This paper cites guardian.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis guardian

Reference 64

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:15.197973Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:53.350669Z digest=sha256:e7a5e09dd39180e525d1a5510e466d3f028ec8a6a7305d2093f3ec386198635c

Observation b3942cd9-059d-4da6-88ae-4049c85a5310 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 65

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:15.055000Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:53.432085Z digest=sha256:2e66dd044d6eb3778a451924ecd9895f4fa1ae0c72e64dee729d110b4bd51bce

Observation 0b1cde42-b2f0-4c08-9dbf-e4f9a4c1614c · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 66

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:14.884560Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:53.507249Z digest=sha256:e7edfeaf8104b96b50c5d6b6f1301d8c5db25cde05d4a21432f0729c5b6a3026

Observation 9f9fd221-fe99-4e1b-ba9d-f6a10dd73f03 · outbound

This paper cites thought": <the reasoning process of the gatekeeper>.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis thought": <the reasoning process of the gatekeeper>

Reference 67

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:14.662236Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:53.617722Z digest=sha256:ad7029df0842928960d323d3f88cc961645473a3b327a9b27ddcc15d6b96831f

Observation 5b0bf50f-dd18-45ff-a0b3-ecbadae7a6ed · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 68

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:14.510799Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:53.700268Z digest=sha256:7a4203e9b1a6dc894fc51d7c2377894116cc5bac5bb26b85c0a57eea64a9da0b

Observation 9ecef980-519c-420c-8b61-72bc50a6aab4 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 69

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:14.332655Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:53.779862Z digest=sha256:5791031ea0b170f8b5bc14c0e86ea10fce9305634e58f896236a5259e4df9346

Observation d2cbaf3f-d01f-4685-8765-34bd666e477b · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 70

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:14.170602Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:53.867111Z digest=sha256:bf04d289f1404e04930a800e506f94945d461b753a2b50e2b4a787481b3cd4c9

Observation f798acac-d199-4eaf-8436-5a45dfc08f4b · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 71

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:14.013419Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:53.958532Z digest=sha256:6f4f6169d2a1ed6931d1b54cf28f7b4ad3ef59a4063e67cf399b6b46d212e531

Observation 5b4abff3-8beb-49f7-a7c1-3d50a7690256 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 72

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:13.796341Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:54.036650Z digest=sha256:c769eec6802bf8ef83a1bd1e56f010af4fac2e1c773d21a06c064ad5c9f138d1

Observation abc896a7-b9fd-408f-bd0a-846072760919 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 73

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:13.576523Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:54.108835Z digest=sha256:16c8a4f3c71277d63c125a66a11f5524414798b619d97f4014325c4935672f4f

Observation ced03377-9381-4161-b85c-b220bf757368 · outbound

This paper cites (omitted).

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis (omitted)

Reference 74

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:13.388357Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:54.172031Z digest=sha256:189daf3d007a5cad7413dd9f7154b7e6b9f6ab45d9f122569c35b8ca7e87b8c3

Observation f573cfbc-36ef-446e-9573-f9839bb84492 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 75

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:13.205552Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:54.243031Z digest=sha256:2261bbdcf4ac38a2533f8e8a04fd7b2592bb34d6200611bc00cfb1469b71ceb4

Observation 39e1111c-a514-4bee-852a-aaaffe5bf422 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 76

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:13.032118Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:54.329557Z digest=sha256:973f3d32ef3d600c3f8b8f32ae10646757ff0022bc67347f6a99b8f3208fbbe4

Observation 0586bd0d-8a26-4cba-a80f-608b5376abc3 · outbound

This paper cites System prompt of the shard user.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis System prompt of the shard user

Reference 77

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:12.801042Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:54.387429Z digest=sha256:2f27fee87ff7445526afac44e9c2854349f1e89b7796ed94846a183e222a45f2

Observation fe421636-1cda-4752-a4c7-0e1811b0524d · outbound

This paper cites You should select shards that are most “basic” and currently **the most relevant**.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis You should select shards that are most “basic” and currently **the most relevant**

Reference 78

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:12.612789Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:54.438122Z digest=sha256:481ef1090ed21cc1fa3e37fcbf5b8f6b6a353a5aebc00dc443b27d1d2bbbfb6b

Observation 61eec6c3-82a6-45fd-8c99-afb6f1dbf4b4 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 79

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:12.444651Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:54.498573Z digest=sha256:2870c45a0a355f448e9ddbcc9d305f328a78037fbfe2b63738b1c8531ffd9d88

Observation 01998609-5024-4963-9a26-b7ac132e56a3 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 80

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:12.215315Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:54.563626Z digest=sha256:8fe2517e482a894c32268c45dfd8b29babf3f60855a4c22ba6e1eae1bb96fc5d

Observation a00a1721-ac01-4169-a434-4132f4fa254e · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 81

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:12.010602Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:54.632882Z digest=sha256:186025f4deb3b93ddeb28ebc0c03091e90abe778bf4a9003181dee7aa8b7a680

Observation 68fd14cb-7d3b-49db-a844-7b2ec6880530 · outbound

This paper cites Consider these alternative directions:.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Consider these alternative directions:

Reference 82

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:11.782448Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:54.697431Z digest=sha256:7af05e8d90de78e37e3893cb183f06b8951669506e5029363d3e3b9f2ef74bf5

Observation c0640aac-3e59-48a3-8f5f-f7751b82b3d3 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 83

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:11.515593Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:54.750391Z digest=sha256:7df90df16b7f9f4b30213faf79f6bc4b88adf570ca9f7625ce9a6ff54aedba9e

Observation e03f52fd-6f48-4e9e-a905-5be12ffb984c · outbound

This paper cites thought":.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis thought":

Reference 84

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:11.322347Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:54.817573Z digest=sha256:61313b8318bbda1c57ab03aeffecc17c817cbdcfca8c2429d1d8a24103d0902f

Observation 08b44ea8-7e94-43b7-ae2c-59c7fe631b6d · outbound

This paper cites These metrics typically possess a theoretical upper bound (e.g., 1.0 for accuracy).

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis These metrics typically possess a theoretical upper bound (e.g., 1.0 for accuracy)

Reference 85

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:11.133038Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:54.876902Z digest=sha256:6e18db5d8414f3e98d4dcc3adbc4ffeeba9c6bc013d1dc903222692a8f4a1eae

Observation 3867b804-24e2-44c1-a911-bfdd99025404 · outbound

This paper cites Avg Score.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Avg Score

Reference 86

Resolution
malformed identifier
raw_fallback, observed 2026-08-07T14:47:10.993255Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:54.963256Z digest=sha256:00d0d533bd7e8c398997172e61037a8f3b2df5369d29e71e9cb828a4d17a6416

Observation 5ece733e-534c-4558-a899-a6602b0b4ade · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 87

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:10.812818Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:55.111812Z digest=sha256:f67dd2a644da65e2c2c9783f890c118c3746599d3a90d3c6d57d317b32449347

Observation 452d1b4f-bbd5-4d27-87f7-d38268ccd254 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 88

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:10.593754Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:55.260964Z digest=sha256:c1852fc1218cf5c167b41fa94b1f350427195d7666bfe5a73bd2183e8cf82077

Observation 5f2437a7-1f80-4206-8c1e-61437968fecf · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 89

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:10.372803Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:55.352626Z digest=sha256:dc207315786be5514548bf49776ea3804b8f15d585c349cc07cadeb993c46a0c

Observation 3e3b5a8e-27f3-4c71-80d0-ea858804a528 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 90

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:10.202351Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:55.451451Z digest=sha256:b85f97c6674a17784fe8b32aed5a690cb6a9d8752a02fac480e8a6998178b621

Observation ab1d6e91-d1a7-4be2-9b8c-69ccf5b7bffc · outbound

This paper cites metric_name.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis metric_name

Reference 91

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:10.045925Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:55.590513Z digest=sha256:7a5f76e31d9ce46c50eae1b77e0a59385532bbb1b2868cebd85ff50fab078030

Observation 7ad91a31-f9e9-4e82-8625-b0d07e08bea2 · outbound

This paper cites yes" -> 1 and.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis yes" -> 1 and

Reference 92

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:09.885569Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:55.662945Z digest=sha256:4f13cac1a0ba438756c4723a2d677d18b6ecd145c6c59c3e9d905226d64ac21c

Observation 8d0d2a8d-68b6-4efa-b0dc-f8fab30074b6 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 93

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:09.699479Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:55.725076Z digest=sha256:53cf1999c27b1867f0108e7c90943d8ad4f3b09d9e8628d3eabb734bf381e5ad

Observation 2071ba24-4855-49a0-bb2e-cbf4492b39ba · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 94

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:09.470809Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:55.783517Z digest=sha256:0d2d06536daae143b0af0860006af8e5801e32e11157073f8ff62ebb9474fe82

Observation fb5b5414-d716-406e-bd25-f1b24032addf · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 95

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:09.259524Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:55.853949Z digest=sha256:d8616b43263acfe20dca86ba3cdd4dd267bee6662d7448a1cd93996af7acec2a

Observation 1fa1beae-08ab-4a36-98b7-65eaefcfe2d3 · outbound

This paper cites an unresolved cited work.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis Unresolved cited work

Reference 96

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:47:09.047479Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:55.932041Z digest=sha256:7c659c1c8ea6cd30acc2bd50cda344e12c6f126428ad76c25723d4381998869f

Observation 05224c24-238a-41a0-a667-85a3968efa4e · outbound

This paper cites <markdown>.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis <markdown>

Reference 97

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:08.852908Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:56.019587Z digest=sha256:1e1cbbc371d7a29983340dbc4cc193dc195f096dead654b8011dc7997de6dc4a

Observation 770a40a6-c077-4eb1-9a81-4041e4ac5ce7 · outbound

This paper cites !pip install.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis !pip install

Reference 98

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:08.668817Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:56.091977Z digest=sha256:f24c6acc3a85c0b56960c4af59086c408475fbdeee35ad98df81a9dfb5d6a8a6

Observation b231fb36-f85a-4075-98aa-a770e510818f · outbound

This paper cites - Load the test feature set from the given directory, using <original_name>_test_features.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis - Load the test feature set from the given directory, using <original_name>_test_features

Reference 99

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:08.478825Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:56.212625Z digest=sha256:09ea735e01da473a7d4ae4d5a533e172f0b29cbfe0602def3fa03d4108a60618

Observation 144be1e0-9337-44e8-a6e4-a05306a4f790 · outbound

This paper cites - Apply the identical transformations to the test feature set.

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis - Apply the identical transformations to the test feature set

Reference 100

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:47:08.224725Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T14:46:56.334492Z digest=sha256:7315a8a8193caca8231ba8a9a89423fd50a3918da0ff1d5a621bac21dd712048

Pith citing papers

Observation 9a5ed600-2958-4aec-8a75-ad0184b222c7 · inbound

Agentic-imodels: Evolving agentic interpretability tools via autoresearch cites this paper.

Agentic-imodels: Evolving agentic interpretability tools via autoresearch IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis

Reference 34

Resolution
verified exact
arxiv_id, observed 2026-05-11T23:36:36.195393Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-07T16:37:43.371592Z digest=sha256:c27974e81298152741c5daef17367a09bc66fe5d182b6570e93d7f81bb219513

Observation bac24401-0195-4260-9e1c-0f3adccc3009 · inbound

Business Utility of Large Language Models as Exploratory Data Analysis Agents cites this paper.

Business Utility of Large Language Models as Exploratory Data Analysis Agents IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis

Reference 20

Resolution
metadata mismatch
arxiv_id, observed 2026-06-30T23:35:06.971550Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-06-30T23:25:17.416071Z digest=sha256:774506e56916dacde53ae517099472173fba28667252490649e34329b2b134cf

Observation df93a095-2e57-43a7-984e-0232a0767299 · inbound

GRACE-DS: a Guarded Reward-guided Agent Correction Environment in Data Science cites this paper.

GRACE-DS: a Guarded Reward-guided Agent Correction Environment in Data Science IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis

Reference 14

Resolution
verified exact
arxiv_id, observed 2026-07-03T17:48:46.135475Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-06-27T03:42:40.528376Z digest=sha256:f804accb482452319c5deea3d2ab8b81b738d5875c979c0453a230c5de3612c2

Observation 9a5bb880-d645-4644-bb41-fec033f6c5fa · inbound

CITBench: A Comprehensive Benchmark for Interactive Tabular Data Processing with LLMs cites this paper.

CITBench: A Comprehensive Benchmark for Interactive Tabular Data Processing with LLMs IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-04T02:02:25.908482Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-04T02:02:25.908482Z digest=sha256:fde1d6d878a59c44bef84d7b15c07ed353fc9e6f97c96107e3bdd5c0b45eb647