Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons | Paper Citation Record

Observation be3d46be-6a4b-4285-9b6a-01e813ce598f · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.817210Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6b1f7a9a-3c21-478d-9009-a9fc405a9a4d · outbound

This paper cites Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.822426Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0b5bcc2c-6a9c-466c-8c08-0f47f57d34b4 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.827012Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b66b2701-1539-4dfd-b7cd-d72ca486d915 · outbound

This paper cites Beyond Human Norms: Unveiling Unique Values of Large Language Models through Interdisciplinary Approaches.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Beyond Human Norms: Unveiling Unique Values of Large Language Models through Interdisciplinary Approaches

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.830821Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d31a6332-3d1c-43d1-bcbd-14e14b2cf2eb · outbound

This paper cites Elephants Never Forget: Testing Language Models for Memorization of Tabular Data.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Elephants Never Forget: Testing Language Models for Memorization of Tabular Data

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.835116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0defba75-5860-4040-ab04-8de92acdfea3 · outbound

This paper cites How Do Large Language Models Acquire Factual Knowledge During Pretraining?.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons How Do Large Language Models Acquire Factual Knowledge During Pretraining?

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.839189Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c48d21eb-34f5-4bb6-94fd-b0728f4f44e9 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Evaluating Large Language Models Trained on Code

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.843560Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a37e6233-d4a7-427f-b753-92dc686d0203 · outbound

This paper cites Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.848171Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e8c9c9a1-1af3-4aec-bfe5-f8f37b16949f · outbound

This paper cites How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.852425Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9b4f2c8c-b709-419b-9656-9261b93f2d2c · outbound

This paper cites Cognitive Bias in Decision-Making with LLMs.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Cognitive Bias in Decision-Making with LLMs

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.856504Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7f72c403-5571-4b72-b6e3-e6d91972face · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.860248Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation add0e4ed-2a60-43b2-b9bf-7a7b564570ae · outbound

This paper cites Measuring Massive Multitask Language Understanding.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Measuring Massive Multitask Language Understanding

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.864124Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation caf00782-7f33-4abf-add2-4970e7ff18d6 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.868011Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3cc9abd6-4204-43ca-ae8e-4404f0b0c694 · outbound

This paper cites C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Models.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Models

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.871799Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e6552762-4a13-4086-900c-10e6e65bf5f6 · outbound

This paper cites Mercer, Lalit R.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Mercer, Lalit R

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.875671Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 12331cd9-c807-45ff-a61d-642d9d7c5173 · outbound

This paper cites Raising the Bar: Investigating the Values of Large Language Models via Generative Evolving Testing.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Raising the Bar: Investigating the Values of Large Language Models via Generative Evolving Testing

Reference 16

Resolution: verified exact; local_arxiv, observed 2026-08-09T10:26:07.561014Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 8e46a871-a14d-4854-aadb-9229148a2492 · outbound

This paper cites Can Machines Learn Morality? The Delphi Experiment.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Can Machines Learn Morality? The Delphi Experiment

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.883680Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b509fb7f-c652-42f9-acda-d1d976c1a974 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.887711Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f440211e-204c-4471-9d45-923ec4e592b1 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.895858Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 34399e51-cd30-47a2-aa20-dc9673f26f45 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.899646Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 08e40cce-7785-46dc-a878-6922821ff89f · outbound

This paper cites From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuning.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuning

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.907720Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dc0bf80f-caa7-488a-8b38-6a5a8127e90f · outbound

This paper cites From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipeline.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipeline

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.912272Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f547d0bd-4731-4c1f-a920-f54ef4010caa · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.916238Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6fd91538-2c06-44c8-93b7-3ce0d42b24ed · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.924394Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a6ce5c1b-10e3-4142-891d-a6383c32c97c · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.927917Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4cb36887-c76c-494b-9193-9c12d2543941 · outbound

This paper cites WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.920314Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 02f74949-ed50-4efe-824d-4ee66f82934a · outbound

This paper cites DyKnow: Dynamically Verifying Time-Sensitive Factual Knowledge in LLMs.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons DyKnow: Dynamically Verifying Time-Sensitive Factual Knowledge in LLMs

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.935195Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ddc85e57-5157-4936-8c1c-80fdb85602a4 · outbound

This paper cites Orca: Progressive Learning from Complex Explanation Traces of GPT-4.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Orca: Progressive Learning from Complex Explanation Traces of GPT-4

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.938927Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2effc0c7-cc26-48f1-b2bd-3739b840c7f0 · outbound

This paper cites AlignBench: Benchmarking Chinese Alignment of Large Language Models.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons AlignBench: Benchmarking Chinese Alignment of Large Language Models

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.931661Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4f33ea1a-0123-4c43-b8ac-85cd8ad5d979 · outbound

This paper cites Training language models to follow instructions with human feedback.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Training language models to follow instructions with human feedback

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.946505Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 86187629-cb05-4a5d-8900-6c9978297955 · outbound

This paper cites Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.950598Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5e99fb3d-655f-45eb-89af-5a4f17be4c4d · outbound

This paper cites GPT-4 Technical Report.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons GPT-4 Technical Report

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.942790Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8017578b-3cd1-40d4-bf43-65a3ce7a8fca · outbound

This paper cites Peng, Xi Yang, Aokun Chen, Kaleb E.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Peng, Xi Yang, Aokun Chen, Kaleb E

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.957794Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a806afed-7b33-49fc-ae43-0d72fcf3fdcb · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.961369Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e882d754-624c-4928-8ab1-7c6b44fb55f9 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.954234Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dd2e88cc-510f-4582-9440-f23a7b92435e · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.968348Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e1f4fd36-d6c1-444d-942d-401a9c7b59b1 · outbound

This paper cites Link, Roxana Daneshjou, and Nicolás W Cortés- Penfield.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Link, Roxana Daneshjou, and Nicolás W Cortés- Penfield

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.971926Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 67d14a92-6227-4e27-a194-ba2ce7f69ad5 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.964892Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b447b56b-f7eb-43c7-9f15-7e07cc42e8c8 · outbound

This paper cites TrustLLM: Trustworthiness in Large Language Models.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons TrustLLM: Trustworthiness in Large Language Models

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.983198Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ba93b126-4dc7-4203-ad72-4e7c3eb6e680 · outbound

This paper cites Hashimoto.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Hashimoto

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.986899Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 94dd0f13-a279-420c-9074-382b70b94005 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.975429Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 449c8f6a-fd07-4389-968e-0a2d2e54d28b · outbound

This paper cites Balanced Data Sampling for Language Model Training with Clustering.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Balanced Data Sampling for Language Model Training with Clustering

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.979516Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation af6ecb3f-2016-40f0-95d1-db9311c2b413 · outbound

This paper cites Foundational Autoraters: Taming Large Language Models for Better Automatic Evaluation.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Foundational Autoraters: Taming Large Language Models for Better Automatic Evaluation

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.997800Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ebeebc30-5e2c-46d2-a248-aaab702056d3 · outbound

This paper cites Self-Instruct: Aligning Language Models with Self-Generated Instructions.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Self-Instruct: Aligning Language Models with Self-Generated Instructions

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.001623Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 31178b6e-4d8f-4ba0-81a9-7f7a7ba630f5 · outbound

This paper cites Gemini: A Family of Highly Capable Multimodal Models.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Gemini: A Family of Highly Capable Multimodal Models

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.990380Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d5fa3378-1e24-4054-88d6-b8547c91307e · outbound

This paper cites Qwen2 Technical Report.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Qwen2 Technical Report

Reference 46

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:06.994040Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 41883e9e-f47e-41de-8fe4-7089df947271 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 47

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.017644Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation afc84953-b666-4491-a485-dd8475913de0 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 48

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.025199Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 736eabad-522a-4488-8b12-0f99501b77ef · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 49

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.005480Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dcdb9dd1-b7da-4657-910f-2a062a02b86d · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 50

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.009288Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3cdad77c-5806-4c65-a766-405eb59b9d5f · outbound

This paper cites SmallToLarge (S2L): Scalable Data Selection for Fine-tuning Large Language Models by Summarizing Training Trajectories of Small Models.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons SmallToLarge (S2L): Scalable Data Selection for Fine-tuning Large Language Models by Summarizing Training Trajectories of Small Models

Reference 51

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.012786Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation daa1fa42-6884-49d6-8aee-e3ace2c9d895 · outbound

This paper cites AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.043089Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 740895cd-dda9-4473-8fc9-dbb30f9541cd · outbound

This paper cites Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performance.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performance

Reference 53

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.021278Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2a8e2467-5cb0-4dd7-b4cb-eaa0a4abcbc9 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 55

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.028606Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dc33ccdc-86ba-45bc-8512-66a8af32cd4b · outbound

This paper cites Assessing and Understanding Creativity in Large Language Models.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Assessing and Understanding Creativity in Large Language Models

Reference 56

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.032116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e2406660-7881-4991-b79e-1e8687a5bc08 · outbound

This paper cites LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset

Reference 57

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.035838Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 079248f0-27bb-4433-8901-4b813b7bc10b · outbound

This paper cites Gonzalez, and Ion Stoica.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Gonzalez, and Ion Stoica

Reference 58

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.039751Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation baffcdb0-75e8-4e3c-ba63-4cef2ebc7c87 · outbound

This paper cites Don't Make Your LLM an Evaluation Benchmark Cheater.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Don't Make Your LLM an Evaluation Benchmark Cheater

Reference 60

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.046518Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 474f3143-8449-4e7d-9abe-4fe56a3cbb6c · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 61

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.050876Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1385e0d1-96c9-44b5-a532-e660174ecd53 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 62

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.054391Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a081cb06-f31d-42f6-9232-6a20dc5d78ef · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 63

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.058052Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e452ce85-2756-4dbe-b226-2ac1e1256bf9 · outbound

This paper cites 3.Instruction compli- ance: The output should strictly follow the specific requirements of the instructions, including action steps and any constraints.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons 3.Instruction compli- ance: The output should strictly follow the specific requirements of the instructions, including action steps and any constraints

Reference 64

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.061558Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2e46225c-6049-4568-817d-57d5cd8cd8b7 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 65

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.064933Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8578f05c-7e30-4006-b069-2e162d1d0981 · outbound

This paper cites (9) Role-playing.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons (9) Role-playing

Reference 66

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.068681Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 741285a0-f600-4d92-87e2-f91d2a239ee0 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 67

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.072732Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6d9a6233-5b67-4724-899a-3605d6de5f27 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 68

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.076622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 158abd19-0ce3-40c9-b338-1e83da2ebcd4 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 69

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.080525Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dcc2aaa7-b9d5-4889-8098-81240d8e567e · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 70

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.084242Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 35f1365f-ad6e-4aa5-bd0f-1b4ca5d1449f · outbound

This paper cites The same output requirement and format as in Table 1.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons The same output requirement and format as in Table 1

Reference 71

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.087822Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b51ba750-e9c9-4142-be8f-f013df2dd02f · outbound

This paper cites Requirements for the scenario: Name: {scenario name } Definition: {scenario description } Reference Text: {reference text } Requirements:.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Requirements for the scenario: Name: {scenario name } Definition: {scenario description } Reference Text: {reference text } Requirements:

Reference 72

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.091650Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 82af8738-c8e6-4739-a06e-fb9b18e8edb6 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 73

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.095181Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 578cf78f-f429-43c2-9a05-ba66a0076001 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 74

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.099401Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d6fd51ea-6759-4f9c-b3a6-83a42bbb3aa3 · outbound

This paper cites Sorry, this article does not contain enough information related to {scenario name } to generate relevant questions and answers.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Sorry, this article does not contain enough information related to {scenario name } to generate relevant questions and answers

Reference 75

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.103621Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 41963ea3-372d-48d4-a8c9-70b3ad72f2ea · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 76

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.107062Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 27935d7d-3675-4a21-9ae0-52f3815b7045 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 77

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.110270Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 42f63cfa-5dd8-4e39-91e2-a427376ebdb1 · outbound

This paper cites question.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons question

Reference 78

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.113484Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a033202f-2a09-44b6-8d0d-5fcaf05cbf35 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 79

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.116888Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation da25a752-bb6c-40f8-acaf-29464a326859 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 80

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.120376Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b71bebb5-c71d-4127-a373-ddd457bf2a1e · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 81

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.123609Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4b9b8cf7-ef28-408b-b5ca-60c90db9940f · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 82

Resolution: unresolved; no resolver link, observed 2026-08-09T10:26:07.127171Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2d0f0a54-ae8e-48c0-ab30-f024d5bb9eb7 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 83

Resolution: unresolved; raw_fallback, observed 2026-08-09T10:26:08.109294Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 419b57d7-70fc-400e-9868-716ac2a79fcb · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 84

Resolution: unresolved; raw_fallback, observed 2026-08-09T10:26:08.099447Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 8fba1f61-0ca7-4ffa-bce1-ef08edc05161 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 85

Resolution: unresolved; raw_fallback, observed 2026-08-09T10:26:08.089628Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation d6f5a985-953c-453f-8a91-64ff1daeb949 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 86

Resolution: unresolved; raw_fallback, observed 2026-08-09T10:26:08.079165Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 5a6415ea-619f-42cc-ad9c-7c47c787752a · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 87

Resolution: unresolved; raw_fallback, observed 2026-08-09T10:26:08.069611Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 7d92f8d6-27bf-4b39-85eb-919b89c6d79e · outbound

This paper cites answering mathematical questions.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons answering mathematical questions

Reference 88

Resolution: verified fuzzy; raw_fallback, observed 2026-08-09T10:26:08.059991Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 2f0e63f4-6606-4498-8e80-5be63eda0730 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 89

Resolution: unresolved; raw_fallback, observed 2026-08-09T10:26:08.049961Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation bee8ab36-431f-4d95-a01c-d69b02d92d48 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 90

Resolution: unresolved; raw_fallback, observed 2026-08-09T10:26:08.040625Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 77247908-1df8-488d-9bca-d5aeaf148899 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 91

Resolution: unresolved; raw_fallback, observed 2026-08-09T10:26:08.030964Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation ad00961e-cbf8-4957-be63-01bf446f8a09 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 92

Resolution: unresolved; raw_fallback, observed 2026-08-09T10:26:08.021706Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation ba33ef3a-c86e-445a-a03e-f93ddd0c2eea · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 93

Resolution: unresolved; raw_fallback, observed 2026-08-09T10:26:08.011969Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 4a783726-0f8b-45b7-997f-45b635ae97d6 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 94

Resolution: unresolved; raw_fallback, observed 2026-08-09T10:26:08.002138Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation b5e25f44-9539-4884-a32d-ef4e0143c4a9 · outbound

This paper cites answering mathematical questions.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons answering mathematical questions

Reference 95

Resolution: verified fuzzy; raw_fallback, observed 2026-08-09T10:26:07.992644Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 82c591b6-5a96-46c1-a092-56d85dfb17cc · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 96

Resolution: unresolved; raw_fallback, observed 2026-08-09T10:26:07.982876Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 6b597b12-3ee6-46d2-846b-c291354a95d4 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 97

Resolution: unresolved; raw_fallback, observed 2026-08-09T10:26:07.973017Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation d5f4c378-aaa6-404d-a1ff-5b99e76dc791 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 98

Resolution: unresolved; raw_fallback, observed 2026-08-09T10:26:07.962812Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 905e1a75-c732-4d9b-b8a0-d610f199af37 · outbound

This paper cites Think carefully for a moment, then give your conclusion.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Think carefully for a moment, then give your conclusion

Reference 99

Resolution: verified fuzzy; raw_fallback, observed 2026-08-09T10:26:07.953122Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation a0bf0c0e-4abe-4396-b4e5-128b6049f4b9 · outbound

This paper cites an unresolved cited work.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons Unresolved cited work

Reference 100

Resolution: unresolved; raw_fallback, observed 2026-08-09T10:26:07.943013Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation b8cfcbf2-c3c9-4af4-897f-8e72c222cebc · outbound

This paper cites GPT-4’s response I believe the overall rating for this reply is [[1]] for the following reasons: Advantages of the current reply:.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons GPT-4’s response I believe the overall rating for this reply is [[1]] for the following reasons: Advantages of the current reply:

Reference 101

Resolution: verified fuzzy; raw_fallback, observed 2026-08-09T10:26:07.933203Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 26c1c9bf-8dc7-4568-bb35-c477c232a335 · outbound

This paper cites [[3]] Shortcomings of the current reply:.

Training an LLM-as-a-Judge Model: Pipeline, Insights, and Practical Lessons [[3]] Shortcomings of the current reply:

Reference 102

Resolution: verified fuzzy; raw_fallback, observed 2026-08-09T10:26:07.921431Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Coverage vector

Reference resolution

Outbound references

Pith citing papers