Paper Citation Record · LEDGER

A Descriptive and Normative Theory of Human Beliefs in RLHF

As of 8 August 2026, this Paper Citation Record lists 34 of 34 outbound references and 0 inbound Pith citation observations for arXiv:2506.01692.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.01692 v2

Coverage vector

measured 34 of 34 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T11:47:50.148935Z

measured 34 of 34 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

34 of 34 outbound references displayed

verified exact5
verified fuzzy11
unresolved18
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 5ebbc9fc-cfae-4abe-b067-092378bc87cc · outbound

This paper cites Concrete Problems in AI Safety.

A Descriptive and Normative Theory of Human Beliefs in RLHF Concrete Problems in AI Safety

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-07T11:46:59.917255Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1ae3dbdb-b0ef-4d2b-8545-43a498d5cdf9 · outbound

This paper cites an unresolved cited work.

A Descriptive and Normative Theory of Human Beliefs in RLHF Unresolved cited work

Reference 2

Resolution: verified exact; doi, observed 2026-08-07T11:47:50.478135Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation cbd9d947-62bf-4e98-9ca6-57e132b85436 · outbound

This paper cites S., Goo, W., Nagarajan, P., and Niekum, S.

A Descriptive and Normative Theory of Human Beliefs in RLHF S., Goo, W., Nagarajan, P., and Niekum, S

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T11:48:04.386591Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 4300b9b1-bea4-4782-8ab6-4b03b0d5251b · outbound

This paper cites Human irrationality: both bad and good for reward inference.

A Descriptive and Normative Theory of Human Beliefs in RLHF Human irrationality: both bad and good for reward inference

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-07T11:47:00.035664Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 20ca9eb1-b770-426d-bb2f-848a48e22457 · outbound

This paper cites F., Leike, J., Brown, T., Martic, M., Legg, S., and Amodei, D.

A Descriptive and Normative Theory of Human Beliefs in RLHF F., Leike, J., Brown, T., Martic, M., Legg, S., and Amodei, D

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-07T11:47:00.069963Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a7c8a7a0-d5cf-467d-898d-bff6cc6a08b6 · outbound

This paper cites Dominance statistics: Ordinal analyses to answer ordinal questions.

A Descriptive and Normative Theory of Human Beliefs in RLHF Dominance statistics: Ordinal analyses to answer ordinal questions

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-07T11:47:00.111102Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8837d963-b9b1-4161-a1dc-c879a66b1611 · outbound

This paper cites Carla: An open urban driving simulator.

A Descriptive and Normative Theory of Human Beliefs in RLHF Carla: An open urban driving simulator

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T11:48:04.350973Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 75425d66-1f8a-418a-99af-3c628d085871 · outbound

This paper cites an unresolved cited work.

A Descriptive and Normative Theory of Human Beliefs in RLHF Unresolved cited work

Reference 8

Resolution: unresolved; raw_fallback, observed 2026-08-07T11:48:04.310724Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 31838fc5-572f-4491-89c4-e4491c82a1d0 · outbound

This paper cites and van Huyssteen, G.

A Descriptive and Normative Theory of Human Beliefs in RLHF and van Huyssteen, G

Reference 9

Resolution: verified exact; doi, observed 2026-08-07T11:47:50.386560Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 3be7b463-7b59-4de6-bf54-74b2819ac639 · outbound

This paper cites an unresolved cited work.

A Descriptive and Normative Theory of Human Beliefs in RLHF Unresolved cited work

Reference 10

Resolution: unresolved; raw_fallback, observed 2026-08-07T11:48:04.277782Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 1023af3c-e724-47c6-90d7-a33f793f600a · outbound

This paper cites and Zhang, Y.

A Descriptive and Normative Theory of Human Beliefs in RLHF and Zhang, Y

Reference 11

Resolution: verified exact; doi, observed 2026-08-07T11:47:50.297152Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation d7912542-b0ef-4d8f-9c97-6ba25966928d · outbound

This paper cites R., Millman, K.

A Descriptive and Normative Theory of Human Beliefs in RLHF R., Millman, K

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-07T11:47:00.341985Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 33883ee9-38f9-44b5-8f9b-ee6d611fa684 · outbound

This paper cites B., and Sadigh, D.

A Descriptive and Normative Theory of Human Beliefs in RLHF B., and Sadigh, D

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T11:48:04.251812Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 15a5ad74-26a2-4a5d-9496-9e627f94e8c3 · outbound

This paper cites AI Alignment: A Comprehensive Survey.

A Descriptive and Normative Theory of Human Beliefs in RLHF AI Alignment: A Comprehensive Survey

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-07T11:47:00.421523Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d1afc75d-4b75-4042-b54c-eb91d864bfbe · outbound

This paper cites Maps of bounded rationality: Psychology for behavioral economics.

A Descriptive and Normative Theory of Human Beliefs in RLHF Maps of bounded rationality: Psychology for behavioral economics

Reference 15

Resolution: verified exact; raw_fallback, observed 2026-08-07T11:47:50.868330Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation f0cc9cdc-bf93-4594-b41b-f31f835e3852 · outbound

This paper cites an unresolved cited work.

A Descriptive and Normative Theory of Human Beliefs in RLHF Unresolved cited work

Reference 16

Resolution: unresolved; raw_fallback, observed 2026-08-07T11:47:52.196241Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 70f5cf52-5cf6-40da-8914-8931b8a3ed0f · outbound

This paper cites A Survey of Reinforcement Learning from Human Feedback , 2023.

A Descriptive and Normative Theory of Human Beliefs in RLHF A Survey of Reinforcement Learning from Human Feedback , 2023

Reference 17

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T11:47:52.083710Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 75c1bec4-10f6-4d35-baac-f05df634028a · outbound

This paper cites B., Hatgis-Kessell, S., Booth, S., Niekum, S., Stone, P., and Allievi, A.

A Descriptive and Normative Theory of Human Beliefs in RLHF B., Hatgis-Kessell, S., Booth, S., Niekum, S., Stone, P., and Allievi, A

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T11:47:52.006278Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 6bd07457-abdb-4c93-8613-f36ae2e4ff31 · outbound

This paper cites and Wallis, W.

A Descriptive and Normative Theory of Human Beliefs in RLHF and Wallis, W

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T11:47:51.919803Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 3db34edc-88d3-4553-94a5-5dddc07c9388 · outbound

This paper cites and Rabin, M.

A Descriptive and Normative Theory of Human Beliefs in RLHF and Rabin, M

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-07T11:47:00.668780Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4ab6890b-4125-4d20-8a21-10d4fa6908df · outbound

This paper cites and Slovic, P.

A Descriptive and Normative Theory of Human Beliefs in RLHF and Slovic, P

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T11:47:51.859759Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation f2840a6a-00fa-4f19-b21b-09b4800f8e40 · outbound

This paper cites Choice Between Partial Trajectories: Disentangling Goals from Beliefs.

A Descriptive and Normative Theory of Human Beliefs in RLHF Choice Between Partial Trajectories: Disentangling Goals from Beliefs

Reference 22

Resolution: verified exact; local_arxiv, observed 2026-08-07T11:47:50.609940Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation fea89da2-6fdf-43bc-a24d-5e722d5ae9c1 · outbound

This paper cites D., Tang, Y., Geist, M., Mesnard, T., Fiegel, C., Michi, A., Selvi, M., Girgin, S., Momchev, N., Bachem, O., Mankowitz, D.

A Descriptive and Normative Theory of Human Beliefs in RLHF D., Tang, Y., Geist, M., Mesnard, T., Fiegel, C., Michi, A., Selvi, M., Girgin, S., Momchev, N., Bachem, O., Mankowitz, D

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T11:47:51.799229Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 67e64f80-b78d-4218-abbf-91e94b722baa · outbound

This paper cites GPT-4 Technical Report.

A Descriptive and Normative Theory of Human Beliefs in RLHF GPT-4 Technical Report

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-07T11:47:49.033815Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6ae71cd6-e38e-41a1-bca2-67cdae41284f · outbound

This paper cites an unresolved cited work.

A Descriptive and Normative Theory of Human Beliefs in RLHF Unresolved cited work

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-07T11:47:49.594747Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b2d066ad-ca9f-4db7-9ca7-5e0f6ab9f168 · outbound

This paper cites an unresolved cited work.

A Descriptive and Normative Theory of Human Beliefs in RLHF Unresolved cited work

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-07T11:47:49.663093Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 388c7e3f-62c6-4f78-97e9-d4b133a4830e · outbound

This paper cites Python: Version 3.11, 2023.

A Descriptive and Normative Theory of Human Beliefs in RLHF Python: Version 3.11, 2023

Reference 27

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T11:47:51.594908Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 74a04646-9b09-4230-aec5-9786d09de9f0 · outbound

This paper cites D., and Finn, C.

A Descriptive and Normative Theory of Human Beliefs in RLHF D., and Finn, C

Reference 28

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T11:47:51.431519Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 111d4b14-7c19-40fb-9c28-31dd6093ab68 · outbound

This paper cites Where do you think you re going?: Inferring beliefs about dynamics from behavior.

A Descriptive and Normative Theory of Human Beliefs in RLHF Where do you think you re going?: Inferring beliefs about dynamics from behavior

Reference 29

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T11:47:51.215744Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 818ac125-2d7c-4e72-b3b5-c4fd7dac940b · outbound

This paper cites Trust region policy optimization.

A Descriptive and Normative Theory of Human Beliefs in RLHF Trust region policy optimization

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-07T11:47:49.917522Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 66e2866c-611f-4812-a384-91aba944ab86 · outbound

This paper cites an unresolved cited work.

A Descriptive and Normative Theory of Human Beliefs in RLHF Unresolved cited work

Reference 31

Resolution: unresolved; raw_fallback, observed 2026-08-07T11:47:51.043892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 39562887-ab0a-43e5-8d70-faf6177ce6f4 · outbound

This paper cites an unresolved cited work.

A Descriptive and Normative Theory of Human Beliefs in RLHF Unresolved cited work

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-07T11:47:50.046193Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1d90ca97-3829-4ad7-9e2c-5aaf72123393 · outbound

This paper cites E., Haberland, M., Reddy, T., Cournapeau, D., Burovski, E., Peterson, P., Weckesser, W., Bright, J., van der Walt , S.

A Descriptive and Normative Theory of Human Beliefs in RLHF E., Haberland, M., Reddy, T., Cournapeau, D., Burovski, E., Peterson, P., Weckesser, W., Bright, J., van der Walt , S

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-07T11:47:50.078270Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6bad0e63-67c2-455e-ad75-4117758af7df · outbound

This paper cites Fine-Tuning Language Models from Human Preferences.

A Descriptive and Normative Theory of Human Beliefs in RLHF Fine-Tuning Language Models from Human Preferences

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-07T11:47:50.148935Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.