Pith. sign in

Paper Citation Record · LEDGER

The Unreasonable Effectiveness of Open Science in AI: A Replication Study

As of 22 August 2026, this Paper Citation Record lists 71 of 71 outbound references and 2 inbound Pith citation observations for arXiv:2412.17859.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2412.17859 v1

Coverage vector

measured 71 of 71 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-11T11:07:25.969841Z

measured 73 of 73 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-22T06:32:14.747728+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-25T08:18:18.448122Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

71 of 71 outbound references displayed

  • verified exact0
  • verified fuzzy17
  • unresolved54
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

1
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

Observation 69a20e80-49e6-45f4-bd13-ba68c864e336 · outbound

This paper cites , " * write output.state after.block = add.period write newline.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study , " * write output.state after.block = add.period write newline

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-11T11:07:25.501996Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T11:07:25.501996Z digest=sha256:95b7e426da0af4241d90586a24b38ed594d347dcc064fbcd5e9bb6c90193275b

Observation 8970917a-c495-47c7-85a9-3d4506e2635d · outbound

This paper cites write newline.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study write newline

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-11T11:07:25.510705Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T11:07:25.510705Z digest=sha256:bd06c592a7a308bdce73479984d95a4fe9c42b2d37a3d600d52b2f99394d83aa

Observation 01a2a656-84b9-4223-8143-9fbf7a3b8100 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:27.627470Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.518498Z digest=sha256:bcc314444ab322c9bc1351cd29123ac999a6797ac0411539796bebb6154c6154

Observation 554e511d-b034-4023-9a9f-7e38f2e18f1b · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:27.606710Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.527472Z digest=sha256:b281c6684023908d5435456d25efd094f961b926e311dc0ce6e24e0d4364da1a

Observation ff68eff0-b37e-4fcd-8410-ee0c8619a557 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:27.588355Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.533744Z digest=sha256:f1b1630f099833e64d69bee5fc3fe94a0fd395277dbd7ba364110b9b3a87b42c

Observation 1617638d-7f39-4450-b9a6-6789212d53d7 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:27.569785Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.541757Z digest=sha256:1e5e20ee3813c132058600fd83af8f51e369ce7036fbbc429283acd25a589b40

Observation a0bf883b-3673-4b18-b60e-bcb6d4ad9048 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:27.547959Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.548303Z digest=sha256:4ac43bea37178a999df3bd8cd59ceeab418ca6d8c42851717afa6881e40c57ca

Observation ac2b654f-b3a2-48aa-9ea5-82f4366123dc · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:27.525855Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.567497Z digest=sha256:b9aba9fe808c978ac3914f2d50d75974bc981ec178133b3b86bf3b5090bd073a

Observation 4e230c66-9837-4e32-85b2-0a5efcef597d · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:27.506445Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.574340Z digest=sha256:a72ea1e3b36df7d374709c3519f589e29672c3e3b1a8ba0814563bf3a91af43f

Observation f2900513-3ae3-4b1b-b3ba-c6492078ea7c · outbound

This paper cites F.; Dreber, A.; Forsell, E.; Ho, T.-H.; Huber, J.; Johannesson, M.; Kirchler, M.; Almenberg, J.; Altmejd, A.; Chan, T.; et al.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study F.; Dreber, A.; Forsell, E.; Ho, T.-H.; Huber, J.; Johannesson, M.; Kirchler, M.; Almenberg, J.; Altmejd, A.; Chan, T.; et al

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T11:07:27.486213Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.580738Z digest=sha256:727707054cd8504201cf7167c663826e88faf5694a11bdb2e18891ceef5d4343

Observation a37600d8-aa85-44a4-bf04-31590729ba0e · outbound

This paper cites F.; Dreber, A.; Holzmeister, F.; Ho, T.-H.; Huber, J.; Johannesson, M.; Kirchler, M.; Nave, G.; Nosek, B.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study F.; Dreber, A.; Holzmeister, F.; Ho, T.-H.; Huber, J.; Johannesson, M.; Kirchler, M.; Nave, G.; Nosek, B

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T11:07:27.465411Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.586624Z digest=sha256:ec6b41a15b86dafc037c662965fbe3266ab7fbb293ce6e1d7e7ed0a62e8f92e6

Observation ddb1dacb-b7eb-4b69-8600-de47171fb0e4 · outbound

This paper cites C.; et al.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study C.; et al

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T11:07:27.441896Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.592479Z digest=sha256:aa5bd7a0262204df64a60998192ac1bc6d05e5fe0feea2a7257744575c4fbc14

Observation 526bee27-5c95-400c-85e2-3ee8da72c67f · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-11T11:07:25.598289Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T11:07:25.598289Z digest=sha256:46942d05bff5e3307652a9ab6b7c2e339bc61c61f6639d16cbad783bc20318ba

Observation af87afc3-0b23-46a7-9111-7126e2e94023 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:27.398481Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.604137Z digest=sha256:6a85fc278f9e09944ce0e18322f6ac9765269ff8678a4a7c80b81acc27528369

Observation c6c19000-0f05-450b-98cc-fe6bb2b682d4 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:27.369730Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.609332Z digest=sha256:6c4957c5d4966ab26e4f63bf1e82159b1ac3ea189acc011da894026c437c3d3e

Observation 942799b9-c186-4320-bd19-30c87d869568 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:27.340647Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.614877Z digest=sha256:2dbc6e85ed4efabbff33d217548069dd7de452f5738663e5ea2c3092df8ce254

Observation 1231213a-8bd7-484c-984d-cb2c89a36f55 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:27.318438Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.620721Z digest=sha256:eebbb7d6d252e8f853171cfd350946a44d43de77f64e46b5a333347c159e8197

Observation c6bd36bc-8ebe-4eb3-bce5-1841fcf543f5 · outbound

This paper cites F.; Cremonesi, P.; and Jannach, D.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study F.; Cremonesi, P.; and Jannach, D

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T11:07:27.297137Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.627069Z digest=sha256:36735010d3202a2a8855f32029bb99a702225943116e355109dccab5cba855d3

Observation 11d095b5-0e23-4bc0-a4ce-60baf97c2412 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:27.274310Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.633693Z digest=sha256:6033d7fcc7305bdc4cfe471bed01bafb39ad262d5e01aae6db28ca51c4f0e3ef

Observation 87eaa462-5d73-4092-bae6-24b647f9c841 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:27.248920Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.641312Z digest=sha256:084b9051b49b4d6a0c928f18b642588160d48bacfb1dd926c79fc1d8d89e063f

Observation db87d04a-cc4e-4f2c-b2f7-0a7b36ba63c5 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-11T11:07:25.647601Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T11:07:25.647601Z digest=sha256:fcc6cb287ab051f9938662c5faf205b1cf9179aa21c619c0800a2bb5d8f23a2e

Observation bce0fea1-7842-433c-9bfb-af5f85f1496c · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:27.207152Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.653782Z digest=sha256:7ab9ebaab8abd3782fb9f8b3e0d09a22bd44169cce1185d3510a59f6d24b34cf

Observation 39d51e69-37b3-4018-b77a-684b126fc16c · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:27.186613Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.662308Z digest=sha256:2170981e6ca06fcd8d9a566dc41d532c27e1bafcbd1c7c4706603c7232a2c4f3

Observation acf88d22-c024-4b5b-b209-fb9619e46a68 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:27.163314Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.669142Z digest=sha256:6ae351d9e4b5946b80d77f3c008778b33b6c5103c635002490ab55c063b42918

Observation da4d5169-7dd8-48ef-8de4-454a95965bfc · outbound

This paper cites Sources of Irreproducibility in Machine Learning: A Review.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Sources of Irreproducibility in Machine Learning: A Review

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-11T11:07:25.675637Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T11:07:25.675637Z digest=sha256:94c047603f886b60c29de5cd535395122127a5f723cdcf5a2977026a1edeb1d7

Observation 56bea90a-a3c5-4637-a449-b10acdb789fa · outbound

This paper cites E.; and Kjensmo, S.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study E.; and Kjensmo, S

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T11:07:27.137535Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.681105Z digest=sha256:d18be9123e8ea040acea813dfbd36517379942d6e0b4af39c2d4991517a010f3

Observation 668ee4af-7e79-4bcb-a7f0-399c4d2382dc · outbound

This paper cites E.; Shamsaliei, S.; and Isdahl, R.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study E.; Shamsaliei, S.; and Isdahl, R

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T11:07:27.115964Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.686636Z digest=sha256:a4f1b32f23d4a2211f14e850f2f8bd065d1e49fe14d94f44ba008de3a2acebae

Observation 66433b72-2e1c-4efd-bf42-40b2189ecded · outbound

This paper cites E.; Shamsaliei, S.; Kj rnli, H.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study E.; Shamsaliei, S.; Kj rnli, H

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T11:07:27.089841Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.693378Z digest=sha256:8bc44d4a321ac24ecf585f53314f22384154e4eeb28616526f9bfa05c73003f2

Observation cc6fda9a-30b7-43a6-ab21-725e0b467e4e · outbound

This paper cites A.; Hosny, A.; Khodakarami, F.; of Directors Shraddha Thakkar 35 Kusko Rebecca 36 Sansone Susanna-Assunta 37 Tong Weida 35 Wolfinger Russ D.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study A.; Hosny, A.; Khodakarami, F.; of Directors Shraddha Thakkar 35 Kusko Rebecca 36 Sansone Susanna-Assunta 37 Tong Weida 35 Wolfinger Russ D

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T11:07:27.061340Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.700129Z digest=sha256:b071457aa8ae9a22ad709af1523b86175fb522ee4aa2b95d9a7f48c5892ad36c

Observation d7c846c6-f219-447c-aef2-5e79e9e28d39 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 30

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:27.029095Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.706271Z digest=sha256:c09992f241f7539fc33da301238b5decdaaef42e714a8244fdaa24003ad8fd82

Observation 54bc078c-a972-43ce-8b21-32d4ccce95c1 · outbound

This paper cites N.; and Wu, C.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study N.; and Wu, C

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T11:07:27.002534Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.712155Z digest=sha256:3cbd56d76f36827df0a842406d75e548cd430049ce056da89967fd15b44f26ed

Observation 3cfffddf-a7b0-41be-897b-20d8b8e37ca4 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 32

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.974377Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.720431Z digest=sha256:3caa54893061c6f0bf485ff7f921d4cc75540c32396b1d1e91a2043cb8019ecb

Observation d59f0dc9-bcd8-45d2-97cf-ddb4b88222a3 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 33

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.951929Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.726385Z digest=sha256:85f621a229534356e8d32a06b136196780cd1d524c5edfae471e0368050a55a6

Observation 9f4e3823-8bb1-47e0-8faa-d403f711dfe9 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 34

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.921315Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.731760Z digest=sha256:c62a96b368590da39ad2f63f7c9016e0f41b23ab4b37a0c355867f16df82c373

Observation a2636c13-0cb7-4bf8-a47f-aaff1796d0d7 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 35

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.893555Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.739597Z digest=sha256:85d642b820469b1426ce3c6169162bd7bc1bfeb604d1abb03097187ab83b2f74

Observation 30421857-8c67-4352-bb3c-95af543fc6c1 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 36

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.872350Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.749445Z digest=sha256:2e113575da9775245de9aab8db5cd15af6240af5c6784cdee1a4ea384cf72cb0

Observation aa52bbf0-eedc-4861-a8aa-68a94ef64af5 · outbound

This paper cites A.; Ratliff, K.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study A.; Ratliff, K

Reference 37

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T11:07:26.849573Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.755616Z digest=sha256:f902c1a6ae18bac2b3057bc3006f0fa25c91dc725b49fad2ed9e76936956b13a

Observation 301a217e-6bcc-4494-b152-32c06cb61248 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 38

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.826513Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.765031Z digest=sha256:9ac6b8eeb4b1068f9b97263808249212b19b9ca040128f4a5d5f97b1af598fbc

Observation faf0920e-8458-4eed-a337-c8d4d3466ae9 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 39

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.805814Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.772152Z digest=sha256:9e00e505c68dd206ce718615488420bf41b4d88f2c0ae7d5586a8541e6ad8a42

Observation e29477c2-3f72-4283-bf04-c846f191554d · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-11T11:07:25.778067Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T11:07:25.778067Z digest=sha256:f3edf02bcae62f5076e8e578ad2fa19ebfeaf6c69a39c80ee08d8a1d0e8f26a1

Observation 1090c4e8-a40f-4d9d-932e-3caaa1b5864e · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 41

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.773409Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.784346Z digest=sha256:7d1f3b2c4ca19718d978f2fae0fa29a34e0bb07d8b09ab3496d8e876814987bd

Observation d1115ecb-6b81-4933-bc2c-02b3419ca540 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 42

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.751262Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.790922Z digest=sha256:ecc87ca1b9a96d40ea2479c33da07d4987b7d88a0a62f5ca7432670f9f49200d

Observation 872456e7-edda-4deb-9cf2-13a1ceaf8675 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 43

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.729144Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.795906Z digest=sha256:a5816b7a6b21a472925dfa48db71577d1a2537b5a33068a53c82d1b41c6687b6

Observation d346cd58-857e-4f1b-a6d9-8c96134a5edb · outbound

This paper cites A.; and Dodge, J.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study A.; and Dodge, J

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T11:07:26.709363Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.802085Z digest=sha256:b095f3db32b5aafc4327260213d9acaf5583dfcd5603f7ae493d96489b7d3d16

Observation 38f11cd6-293a-47f6-97a0-1b264646ae45 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 45

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.687474Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.807661Z digest=sha256:019cb234cf90c80bbcceea916fd86bdcdc5d589be63a468bd988b97027f87062

Observation a107dda0-44fd-40e5-8476-55a01438a686 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 46

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.666952Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.813071Z digest=sha256:b1f02512344862e0d45188f417803e82505f7eff98f47c1ff77af1c1e1008006

Observation d10bdef3-b7e2-4fae-8244-12c7b4bdc4c7 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 47

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.645759Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.818654Z digest=sha256:4d1f7ddcb93667d04ef2f5b1f29054c0dfdd3c26867eeaf75f783f97b06f7e5e

Observation 0ee3351a-1c6f-47fb-994c-1b0261652ad9 · outbound

This paper cites J.; and Roggen, D.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study J.; and Roggen, D

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T11:07:26.618666Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.824446Z digest=sha256:b3e7a6436c122c6e418abbf22a473bf5bd88af8210a7d3f0553840343118a7b5

Observation b0d4418d-c508-46a9-990b-ecbe256699a4 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 49

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.599211Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.830883Z digest=sha256:a4977a57951329241d8aa76f0fc2d183e5e6ba956e3a21f34d760e18ebf9f03d

Observation 561ba951-56d9-4420-ac01-b7a58f1b9073 · outbound

This paper cites V.; Qian, S.; Wang, J.; Lutellier, T.; Rosenthal, J.; Tan, L.; Yu, Y.; and Nagappan, N.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study V.; Qian, S.; Wang, J.; Lutellier, T.; Rosenthal, J.; Tan, L.; Yu, Y.; and Nagappan, N

Reference 50

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T11:07:26.577989Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.838959Z digest=sha256:94045dbf5898d0218b03c1e1d0f7c3663514abff97c1a35c12fb5504c6294e2b

Observation be4bd4a8-96e0-45b9-990b-88d99d0e6e0d · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 51

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.557295Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.845975Z digest=sha256:c212df5644807cf18088c7bf486c16fd0517558b6e45609faf0bea98c47bc1cd

Observation 7d293601-5817-40d7-8099-17b3ccdc814d · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 52

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.539571Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.851694Z digest=sha256:26203fbced380eb3f30f033597c66ee8b4b0ba80380f6c73529de65375bb5ad6

Observation 5e9c97e4-217d-4672-858e-c168d1989dbd · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 53

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.521096Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.857879Z digest=sha256:dcc155131163d5f4d2de1c87ebd3509333cbe765e7f4630cad3a1f515db90bca

Observation 4235c657-deb0-48c4-919f-59f56706211b · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 54

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.501046Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.863456Z digest=sha256:5aa8e5f3047fe6c61e90e73f270392897beb723a1b0dde5444f600095da1ddc0

Observation 5db36f40-2bc6-4c13-b3a1-ccd6c15d81c0 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 55

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.480142Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.868639Z digest=sha256:e2af4400af7076a2dc98cd62fd4f10032483e1971a3e4ecd83a0ab11174ac745

Observation aa86bedd-88d3-45c0-ae9a-a60c1e654d7d · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 56

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.455674Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.875032Z digest=sha256:2be7137fdc54d6ab9457de9cd04a4a387924011d0b1cb022d2adfae5bb551bad

Observation db8bd760-4bca-418f-a4e7-81228469ad40 · outbound

This paper cites A.; Bovik, A.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study A.; Bovik, A

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T11:07:26.434141Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.881802Z digest=sha256:ebeaef4f4cbf9217c19539669cac3c081d17d7735f850417887736462b1eff10

Observation f593b9b7-d574-4d30-a2c4-388ad12965fa · outbound

This paper cites R.; Gao, M.; Lu, L.; Xu, Z.; Nogues, I.; Yao, J.; Mollura, D.; and Summers, R.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study R.; Gao, M.; Lu, L.; Xu, Z.; Nogues, I.; Yao, J.; Mollura, D.; and Summers, R

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T11:07:26.410496Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.888726Z digest=sha256:b546875c4d65080f6f089273c00222d0fe5dff1ea532b0e4a65817af2a311b74

Observation ea384f9e-18e3-46dd-a135-919155cbc197 · outbound

This paper cites J.; Guez, A.; Sifre, L.; Van Den Driessche, G.; Schrittwieser, J.; Antonoglou, I.; Panneershelvam, V.; Lanctot, M.; et al.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study J.; Guez, A.; Sifre, L.; Van Den Driessche, G.; Schrittwieser, J.; Antonoglou, I.; Panneershelvam, V.; Lanctot, M.; et al

Reference 59

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T11:07:26.386833Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.894599Z digest=sha256:92e2824e4a3183ae62637339a5ce699d4ac51e74a56a91fdde94b567f0ccff3d

Observation 5488a9e7-4f5b-494e-9cbe-586ad3e0eec6 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 60

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.361821Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.901459Z digest=sha256:c9dbb16dd54c0d25569de7c80d91b760c2f304d1fa929bd6e06fb0c61056ee50

Observation d172959a-0a78-4ca7-b7d7-e2b7f158e5dd · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 61

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.333325Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.906969Z digest=sha256:8050ef94c8854a188c84c5ee500b200896b36615cc1419c3f4c2eafcd4aefab9

Observation 00fc9719-7cd1-4f54-9585-e2d4ef840b58 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 62

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.304583Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.912319Z digest=sha256:eb345ed5f607dcd23331ee58eb1f4fed1e5a98fbc7e47c4fc66f42cad764ff49

Observation b093ad2e-681d-4098-86d2-0f3dfd58d57a · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 63

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.282280Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.918230Z digest=sha256:cc71c7b30884d9121bb3b26ce1daea424545f8ef21f7514d61522bfe38cb71ed

Observation e1c66fd4-6d5d-4066-9cc4-0bd90c3563b0 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 64

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.258061Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.923963Z digest=sha256:68ac53f5d5d8bba7c412de23ec5f2376810451b667b59ecec92f6efd11217c44

Observation cc0a30e4-9911-48df-a5f0-7bf9cea17e21 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 65

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.219716Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.931675Z digest=sha256:a45eb557927538f852a84f33fb6dbb51c010f74ae769be9c199e6b39f0165fc5

Observation 85142520-85cd-4f15-852c-496103ca74fd · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 66

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.197155Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.937458Z digest=sha256:0a06acf85077d3fdf1806b3f4ad4e5ee3030cd55594b2721f529a4a37af365e7

Observation 4d066fed-bde8-41ed-8123-a8d2e4f29ae8 · outbound

This paper cites D.; and Fergus, R.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study D.; and Fergus, R

Reference 67

Resolution
unresolved
no resolver link, observed 2026-08-11T11:07:25.943208Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T11:07:25.943208Z digest=sha256:01bd46a70cd66e0f9765c5a6ad304d3823fe64362ac23c74952be720da4ebb99

Observation 2637ec6c-70f2-445a-a671-000e4d03bc9d · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 68

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.148162Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.949711Z digest=sha256:ebafd079e8001662c371e73335ddc9f4caa702d13d0b8b1b0a0c79372916a07a

Observation 1aa4c983-09e5-413e-8e0f-9cd7d8cdf31d · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 69

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.114932Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.955680Z digest=sha256:b266ba865c10e5f3b34d237747c49c7ce5780cb5536aa24f3c84be390b7cc159

Observation b5f10e31-1729-44fb-abb5-17a5a65e4a4f · outbound

This paper cites C.; and Tang, X.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study C.; and Tang, X

Reference 70

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T11:07:26.094082Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.962528Z digest=sha256:e26565dc6b6a411436db50c0c488592c1c8826ac6216687f3b9ad225c555ee1a

Observation d1d30570-7596-43cb-92a2-7208de968c09 · outbound

This paper cites an unresolved cited work.

The Unreasonable Effectiveness of Open Science in AI: A Replication Study Unresolved cited work

Reference 71

Resolution
unresolved
raw_fallback, observed 2026-08-11T11:07:26.066274Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-11T11:07:25.969841Z digest=sha256:439ed8c575f543232889d8b5a3bcdee93fd6fa37a6334f2f046f73ddd8704260

Pith citing papers

Observation 7449a509-a88d-48a6-b10e-d414286b8e8d · inbound

Guidelines for Empirical Studies in Software Engineering involving Large Language Models cites this paper.

Guidelines for Empirical Studies in Software Engineering involving Large Language Models The Unreasonable Effectiveness of Open Science in AI: A Replication Study

Reference 48

Resolution
verified exact
arxiv_id, observed 2026-05-18T22:02:52.207253Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-05-18T22:02:36.307598Z digest=sha256:fc5042947a372ff20d6a68573c524c50bfe2c99c4f3471a2b6e08d86dbd49568

Observation f163166a-021a-436c-931b-8997a7007327 · inbound

Guidelines for Empirical Studies in Software Engineering involving Large Language Models cites this paper.

Guidelines for Empirical Studies in Software Engineering involving Large Language Models The Unreasonable Effectiveness of Open Science in AI: A Replication Study

Reference 48

Resolution
verified exact
arxiv_id, observed 2026-05-25T08:20:31.390001Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-05-25T08:18:18.448122Z digest=sha256:6222b82d1f63335568bef0ccf93fd06dcdc2ee4e41084ea36c669fb55a6103a1