Paper Citation Record · LEDGER

Metamorphic Evaluation of ChatGPT as a Recommender System

As of 18 August 2026, this Paper Citation Record lists 23 of 23 outbound references and 1 inbound Pith citation observation for arXiv:2411.12121.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2411.12121 v1

Coverage vector

measured 23 of 23 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-12T17:57:18.852653Z

measured 24 of 24 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-15T05:15:57.846560Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-15T05:19:46.648211Z

Reference resolution

23 of 23 outbound references displayed

verified exact2
verified fuzzy12
unresolved9
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 147f890a-e6cd-4f71-8648-7bdbe5f2fb29 · outbound

This paper cites Is chatgpt a good recom- mender? a preliminary study,.

Metamorphic Evaluation of ChatGPT as a Recommender System Is chatgpt a good recom- mender? a preliminary study,

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:57:19.426443Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 3fa0cf2d-0c6b-4b87-ab77-4126a84eb23e · outbound

This paper cites Evaluating ChatGPT as a Recommender System: A Rigorous Approach.

Metamorphic Evaluation of ChatGPT as a Recommender System Evaluating ChatGPT as a Recommender System: A Rigorous Approach

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-12T17:57:18.780802Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 051f019d-3712-43b5-a41f-99e032a34f69 · outbound

This paper cites Recommendation as language processing (rlp): A unified pretrain, personalized prompt & predict paradigm (p5),.

Metamorphic Evaluation of ChatGPT as a Recommender System Recommendation as language processing (rlp): A unified pretrain, personalized prompt & predict paradigm (p5),

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-12T17:57:18.787761Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3c584b76-b406-4d7b-9734-16cc895ec891 · outbound

This paper cites Large language mod- els meet collaborative filtering: An efficient all-round llm-based recommender system,.

Metamorphic Evaluation of ChatGPT as a Recommender System Large language mod- els meet collaborative filtering: An efficient all-round llm-based recommender system,

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:57:19.417629Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation d96b6362-9029-445f-8ee3-e09a5e5ea2d8 · outbound

This paper cites Chat-rec: Towards interactive and explainable llms-augmented recommender system,.

Metamorphic Evaluation of ChatGPT as a Recommender System Chat-rec: Towards interactive and explainable llms-augmented recommender system,

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:57:19.408232Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 87988eff-60af-412e-830d-f7f3fc0a5303 · outbound

This paper cites The simpson’s paradox in the offline evaluation of recommendation systems,.

Metamorphic Evaluation of ChatGPT as a Recommender System The simpson’s paradox in the offline evaluation of recommendation systems,

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-12T17:57:18.797612Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 30a73744-bd90-4a78-a19e-77fa27568c63 · outbound

This paper cites Data-efficient fine-tuning for llm-based recommendation,.

Metamorphic Evaluation of ChatGPT as a Recommender System Data-efficient fine-tuning for llm-based recommendation,

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:57:19.398045Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation a212cf86-a49a-4223-9f99-16fe13d1ac6b · outbound

This paper cites Metamorphic testing: A review of challenges and opportunities,.

Metamorphic Evaluation of ChatGPT as a Recommender System Metamorphic testing: A review of challenges and opportunities,

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-12T17:57:18.803889Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8ce3009c-c5ed-4eb9-bb76-f59a358fb700 · outbound

This paper cites An empirical study on metamorphic testing for recommender systems,.

Metamorphic Evaluation of ChatGPT as a Recommender System An empirical study on metamorphic testing for recommender systems,

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:57:19.388170Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation fbd319bb-b713-4bc3-a7d0-0edb1a02230f · outbound

This paper cites METAL: Metamorphic Testing Framework for Analyzing Large-Language Model Qualities.

Metamorphic Evaluation of ChatGPT as a Recommender System METAL: Metamorphic Testing Framework for Analyzing Large-Language Model Qualities

Reference 11

Resolution: verified exact; local_arxiv, observed 2026-08-12T17:57:19.140238Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 83a64183-bc5e-4de5-84fb-6ebabe4aa551 · outbound

This paper cites Testing chatbots using metamorphic relations,.

Metamorphic Evaluation of ChatGPT as a Recommender System Testing chatbots using metamorphic relations,

Reference 12

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:57:19.378961Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation afbafa29-656b-4392-b20b-6dfb268e029d · outbound

This paper cites Language models as recommender systems: Evaluations and limitations,.

Metamorphic Evaluation of ChatGPT as a Recommender System Language models as recommender systems: Evaluations and limitations,

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:57:19.369810Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 53ae3daa-06e9-4be8-845f-0490953a82e3 · outbound

This paper cites Ppt: Pre-trained prompt tuning for few-shot learning,.

Metamorphic Evaluation of ChatGPT as a Recommender System Ppt: Pre-trained prompt tuning for few-shot learning,

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:57:19.359984Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 1ae4fe5f-b13a-40a0-a5dd-c1fc662bc591 · outbound

This paper cites Making pre-trained language models better few-shot learners,.

Metamorphic Evaluation of ChatGPT as a Recommender System Making pre-trained language models better few-shot learners,

Reference 15

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:57:19.350511Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation e128f337-ed86-4175-b7d4-517bf46664d0 · outbound

This paper cites The turking test: Can language models understand instruc- tions?.

Metamorphic Evaluation of ChatGPT as a Recommender System The turking test: Can language models understand instruc- tions?

Reference 16

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:57:19.339652Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 4918343a-448d-4529-b3f0-839d3dd59cf9 · outbound

This paper cites Llm based generation of item- description for recommendation system,.

Metamorphic Evaluation of ChatGPT as a Recommender System Llm based generation of item- description for recommendation system,

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-12T17:57:18.830330Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 970927e8-6156-4147-bc92-12dee2ba691d · outbound

This paper cites A survey on conversational recommender systems,.

Metamorphic Evaluation of ChatGPT as a Recommender System A survey on conversational recommender systems,

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-12T17:57:18.833463Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f513f36f-cd8c-4eee-b40d-b7b582fd46e4 · outbound

This paper cites Evaluating collaborative filtering recommender systems,.

Metamorphic Evaluation of ChatGPT as a Recommender System Evaluating collaborative filtering recommender systems,

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-12T17:57:18.836626Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e42a1e11-1969-4a50-b0c2-5cf93ab236d4 · outbound

This paper cites Cumulated gain-based evaluation of ir techniques,.

Metamorphic Evaluation of ChatGPT as a Recommender System Cumulated gain-based evaluation of ir techniques,

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-12T17:57:18.839754Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7ee6d5ab-84f4-47e5-a007-f9f93626b22e · outbound

This paper cites Recommender systems: Past, present, future,.

Metamorphic Evaluation of ChatGPT as a Recommender System Recommender systems: Past, present, future,

Reference 21

Resolution: verified exact; doi, observed 2026-08-12T17:57:18.882425Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation b5b1be14-d0e8-4f8d-b4c8-408fdb0867d0 · outbound

This paper cites A prompt pattern catalog to enhance prompt engi- neering with chatgpt,.

Metamorphic Evaluation of ChatGPT as a Recommender System A prompt pattern catalog to enhance prompt engi- neering with chatgpt,

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:57:19.330840Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 35e1538a-702d-4f9e-bc23-8ce6072311ed · outbound

This paper cites [Online].

Metamorphic Evaluation of ChatGPT as a Recommender System [Online]

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:57:19.321222Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation b441a806-fc63-4490-8d96-55e671188e0a · outbound

This paper cites A similarity measure for indefinite rankings,.

Metamorphic Evaluation of ChatGPT as a Recommender System A similarity measure for indefinite rankings,

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-12T17:57:18.852653Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation c14f5b5e-a7e0-4d1f-8834-b60939f5999b · inbound

Bidirectional Empowerment of Metamorphic Testing and Large Language Models: A Systematic Survey cites this paper.

Bidirectional Empowerment of Metamorphic Testing and Large Language Models: A Systematic Survey Metamorphic Evaluation of ChatGPT as a Recommender System

Reference 48

Resolution: verified exact; arxiv_id, observed 2026-05-15T05:19:46.651696Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.