Pith. sign in

Paper Citation Record · LEDGER

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors

As of 4 August 2026, this Paper Citation Record lists 64 of 64 outbound references and 0 inbound Pith citation observations for arXiv:2605.26955.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2605.26955 v1

Coverage vector

measured 64 of 64 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-06-29T17:47:11.338622Z

measured 64 of 64 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-04T06:34:03.388597+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

64 of 64 outbound references displayed

  • verified exact20
  • verified fuzzy0
  • unresolved37
  • parse uncertain0
  • malformed identifier2
  • metadata mismatch5

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation a4619eea-3db7-4c6e-9cb8-66efad165434 · outbound

This paper cites System Card: Claude Haiku 4.5, 2025.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors System Card: Claude Haiku 4.5, 2025

Reference 1

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:3361ccb5da7c75cec6baa9a8221ff349e82a0b66aafedb2403e9b1638e5e0dc6

Observation 09944844-4069-4bfa-9b4d-89488064d0df · outbound

This paper cites System Card: Claude Opus 4.7, 2026.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors System Card: Claude Opus 4.7, 2026

Reference 2

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:c81a39cb6562e220328ba3f4f03aaa0f9cc5b8f8d3a2519df48ecdb434211dbc

Observation 0a40819c-4b10-453b-a193-53660fb0d71f · outbound

This paper cites CaLMQA: Exploring culturally specific long-form question answering across 23 languages.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors CaLMQA: Exploring culturally specific long-form question answering across 23 languages

Reference 3

Resolution
verified exact
doi, observed 2026-06-29T17:53:46.593494Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:e440058578271c5e5faa63fd79a2907a2180744d7bb085c2d18c8bf6d5f52ec0

Observation 06544dfa-c6e1-4069-bcec-d453038ee9a2 · outbound

This paper cites Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems , articleno =.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems , articleno =

Reference 4

Resolution
metadata mismatch
arxiv_id, observed 2026-06-29T17:53:46.589630Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:aae05bdd88da80ab758399fdf3be5b7ec17ecee92e635880ba03cdc13d95b8f6

Observation fc79d55a-41f0-4566-9838-85f3ed56fcf5 · outbound

This paper cites Knowledge-Centric Hallucination Detection.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Knowledge-Centric Hallucination Detection

Reference 5

Resolution
verified exact
doi, observed 2026-06-29T17:53:46.593224Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:7a4a8ccd3b03b75d3d2fc8fe75682275f304531883370567e5c31eb63e450897

Observation e9b3cbb9-c095-46ed-acc5-08cc79c87d52 · outbound

This paper cites How people use chatgpt.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors How people use chatgpt

Reference 6

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:a6ef0bb196c44c7bcca245e2a049a557c8d825b50144cfd1c3143ca155a1128b

Observation 60953bf4-2b91-4e56-a1b6-3c7b6c7469da · outbound

This paper cites Humans or LLM s as the Judge? A Study on Judgement Bias.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Humans or LLM s as the Judge? A Study on Judgement Bias

Reference 7

Resolution
verified exact
doi, observed 2026-06-29T17:53:46.582163Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:49cdf4d4672e9d1e2a7686beabf1180ce99030ba2f1884a6079e30570bd04039

Observation 3e873e89-734a-482c-b7fb-6c53756d99c3 · outbound

This paper cites Diagnosing the Reliability of LLM-as-a-Judge via Item Response Theory.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Diagnosing the Reliability of LLM-as-a-Judge via Item Response Theory

Reference 8

Resolution
verified exact
local_arxiv, observed 2026-06-29T17:53:47.412884Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:9adfa7055d56a41a5e538154c0f599aafc43713b7f3cb3c2bf71ee64f46b576f

Observation 92b1dd5c-3a6e-473f-aa64-13e81f22fc77 · outbound

This paper cites Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities

Reference 9

Resolution
verified exact
local_arxiv, observed 2026-06-29T17:53:47.416237Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:93529c3f60ec0dfd6c1eabc439d07f614e0c3bc6e559da223cb9bd95d2cee011

Observation cb6399c7-fa6c-4847-919e-f7556099c6cd · outbound

This paper cites Massively Multi-Cultural Knowledge Acquisition & LM Benchmarking.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Massively Multi-Cultural Knowledge Acquisition & LM Benchmarking

Reference 10

Resolution
verified exact
arxiv_id, observed 2026-06-29T17:53:47.410265Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:060506fefa7be1087e6ba9668dc2f36b4ed4464880c211ad256ec06ce5a29bac

Observation 8687a163-8afd-49f5-aa86-c3a6c879ae55 · outbound

This paper cites Thick description: Toward an interpretive theory of culture.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Thick description: Toward an interpretive theory of culture

Reference 11

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:2b9c682f689d922da3beaaa3b46f608e2891034c44c8e44bee8334b0731ba679

Observation 823a593f-ff98-4dbd-8732-aed124a27aad · outbound

This paper cites Gemini 3 Flash Model Card, 2025.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Gemini 3 Flash Model Card, 2025

Reference 12

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:cbc62fe0d97bcf1fcb9938f88cc66e5b998687e87ad8c65de81875885119f0d6

Observation 2fc0f6a9-c570-44a9-83ad-1b5420f6ed19 · outbound

This paper cites Gemini 3 Pro Model Card, 2025.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Gemini 3 Pro Model Card, 2025

Reference 13

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:5395e4f5327e0714bdec8374eea8ac33f95afb1adb30446dc0ae01811a5f357a

Observation 56933d61-d3d1-4873-94cd-7c2ba7a1ad30 · outbound

This paper cites Gemini 3.1 Pro Model Card, 2026.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Gemini 3.1 Pro Model Card, 2026

Reference 14

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:badc478b483a2e1e9f7c2d781accdd40ca74be5f911abf6f4208057161de1dfa

Observation da142a95-0c6d-42e2-b5c0-c506d2fdf7d6 · outbound

This paper cites Gemma 4 model card, 2026.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Gemma 4 model card, 2026

Reference 15

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:0f57b22102bf1d9e2c2f6a1ae643e30ee3f90fb547c1a64bdc50c4bc3010bcc1

Observation dfd8faf6-733b-47eb-8564-fdf20802be7f · outbound

This paper cites LLM-GLOBE: A Benchmark Evaluating the Cultural Values Embedded in LLM Output.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors LLM-GLOBE: A Benchmark Evaluating the Cultural Values Embedded in LLM Output

Reference 16

Resolution
metadata mismatch
arxiv_id, observed 2026-06-29T17:53:47.407284Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:bd292cc29120aaafaa367fd07aeeb13b4e2f9302ab2beb4236fc72bf42ec4775

Observation d09e47b2-1b0d-495b-9367-ff5fb176e4da · outbound

This paper cites LLMs as span annotators: A comparative study of LLMs and humans.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors LLMs as span annotators: A comparative study of LLMs and humans

Reference 17

Resolution
verified exact
doi, observed 2026-06-29T17:53:46.601330Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:8c054c7a8143627cc50eb365e827516717e78b5076e1dc257a1a80313440c0a3

Observation bb1938be-67d7-4650-a846-46939ff4bd65 · outbound

This paper cites Gonzalez, Hao Zhang, and Ion Stoica.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Gonzalez, Hao Zhang, and Ion Stoica

Reference 18

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:844fcd1bfec20aa47a278a1b869e7678301915d01c69f42bde234bc14b5bd7b2

Observation 87972cc3-bde9-4d4d-a531-1df4d88dfab2 · outbound

This paper cites From generation to judgment: Opportunities and challenges of LLM-as-a-judge.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors From generation to judgment: Opportunities and challenges of LLM-as-a-judge

Reference 19

Resolution
verified exact
doi, observed 2026-06-29T17:53:46.595471Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:86caf59c7de5b4526332d79746e32c16fc5f4e29d832a98b480ab179bbd16189

Observation 2eecfd6a-652e-4520-9cf8-69f04e6243e6 · outbound

This paper cites The Llama 4 herd: The beginning of a new era of natively multimodal AI innovation,.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors The Llama 4 herd: The beginning of a new era of natively multimodal AI innovation,

Reference 20

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:92fe5edcec0faf0a3ceb3c535ea5037cd0aeb1c1c0cc6ee1697494dd07af2b75

Observation 2e0d077c-86f3-4d82-b806-ec23feb66ba6 · outbound

This paper cites Accessed: 2026-05-06.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Accessed: 2026-05-06

Reference 21

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:3bc983b0cc84acc98872a35442c4b4e7aca202c49e85ee254f1457d82163b7ba

Observation 7875d8f1-4fd4-43a2-8cd0-502f0e419535 · outbound

This paper cites Blend: A benchmark for llms on every- day knowledge in diverse cultures and languages.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Blend: A benchmark for llms on every- day knowledge in diverse cultures and languages

Reference 22

Resolution
malformed identifier
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:0168c782ad64a4f5e676dac8a9da0592aff4421503760906b8e29aea90383d3b

Observation a51ca0c8-0833-47bb-8be9-81bac77a46e0 · outbound

This paper cites Having beer after prayer? mea- suring cultural bias in large language models.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Having beer after prayer? mea- suring cultural bias in large language models

Reference 23

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:6ac72c3329bca50ae7bd3a817f12442d62a8dee3f936bb036fbafb1bb046a707

Observation d87269c6-69f2-44ce-a58c-d46590d35566 · outbound

This paper cites Having Beer after Prayer? Measuring Cultural Bias in Large Language Models.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Having Beer after Prayer? Measuring Cultural Bias in Large Language Models

Reference 24

Resolution
metadata mismatch
doi, observed 2026-06-29T17:53:46.599384Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:f6a99326c73308b94d53dcd2de32602518c8acf089728fb31474d0d4fb76f61f

Observation 9542a2ac-8ac6-4e46-adfe-c8f50a5f7c88 · outbound

This paper cites In: Christodoulopoulos, C., Chakraborty, T., Rose, C., Peng, V.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors In: Christodoulopoulos, C., Chakraborty, T., Rose, C., Peng, V

Reference 25

Resolution
metadata mismatch
doi, observed 2026-06-29T17:53:46.588647Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:577f4bb053f78d9a1ee889429d63973006e0128d9f5bdef126195566e0a4b991

Observation 3d42089f-8941-43e2-9a33-ccf9af695491 · outbound

This paper cites GPT-5.1 Instant and GPT-5.1 Thinking System Card Addendum, 2025.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors GPT-5.1 Instant and GPT-5.1 Thinking System Card Addendum, 2025

Reference 26

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:3f45d04e186c51293b9d1ae982f2b79811fd5d2b09fb1414682ece59bf9121b0

Observation 4a7c4567-2585-4d63-9e7b-669ed0d677cf · outbound

This paper cites Introducing GPT -5.4 mini and nano, 2026.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Introducing GPT -5.4 mini and nano, 2026

Reference 27

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:ec8822b14899d4f80352f186d26ab5f2b1cb0efec51992331aad836c0ef5ad4b

Observation c9e01772-e4f8-4a89-ad14-224034195cf2 · outbound

This paper cites GPT-5.5 System Card, 2026.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors GPT-5.5 System Card, 2026

Reference 28

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:0fd41cd1c98ed32f31eb59a8c3b494a430b289559da94926b03593bdce01a248

Observation 1394af87-4e52-4154-a1e2-9cd7b06855f0 · outbound

This paper cites gpt-oss-120b & gpt-oss-20b Model Card.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors gpt-oss-120b & gpt-oss-20b Model Card

Reference 29

Resolution
verified exact
local_arxiv, observed 2026-06-29T17:53:47.399537Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:96de5556e0fc54f72cab144897e9963937b60bb5b1e4020371e0481bc8e9b51a

Observation a3b50e3b-6b03-4232-a2cf-ab084bba021f · outbound

This paper cites Survey of cultural awareness in language models: Text and beyond.Computational Linguistics, 51(3):907–1004, September.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Survey of cultural awareness in language models: Text and beyond.Computational Linguistics, 51(3):907–1004, September

Reference 30

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:5411b0f7da6318d8cb9b2be9bae688046eeda8ac854b2dacaf6f906127ddc515

Observation 868defe5-53da-4cdc-8ab3-72e18d02949b · outbound

This paper cites URLhttps://aclanthology.org/2025.cl-3.7/.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors URLhttps://aclanthology.org/2025.cl-3.7/

Reference 31

Resolution
verified exact
doi, observed 2026-06-29T17:53:46.580070Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:e5778405669b2402a7e5d0e0d7181928307e55592d39e3515a6ff4423f98d9ac

Observation 3c928154-e474-425f-a209-834ca98d1dc2 · outbound

This paper cites thick evaluations.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors thick evaluations

Reference 32

Resolution
verified exact
doi, observed 2026-06-29T17:53:46.603685Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:cb967712711b25fec6caa9ab813249a82847c0fbc4836ab9a945300456cd0507

Observation 00c60c5e-8280-416c-898c-21ce2bd5ef2d · outbound

This paper cites Localizing and mitigating errors in long-form question answering.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Localizing and mitigating errors in long-form question answering

Reference 33

Resolution
verified exact
doi, observed 2026-06-29T17:53:46.595178Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:d0035aab3d6aa2458867c9d7edd0006af70b211d7da7db726ac59a157f1cc510

Observation 39c2e6f2-8883-4d33-af02-1cb899aa03b3 · outbound

This paper cites C ulture B ank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologies.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors C ulture B ank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologies

Reference 34

Resolution
verified exact
doi, observed 2026-06-29T17:53:46.576095Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:1330740dc0d261de35f688db70c392840efe6d116afe9a8666a467f38ba0b616

Observation 342599ab-95bf-4db7-bb7f-66e7b1a970ee · outbound

This paper cites OpenAI GPT-5 System Card.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors OpenAI GPT-5 System Card

Reference 35

Resolution
verified exact
local_arxiv, observed 2026-06-29T17:53:47.401833Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:60ade4b043d993d8cdf4016fe0a922886ab12e215893a16aef7a306b774d4cd5

Observation 5eee0f55-d720-4fea-b851-e1af78d24fd6 · outbound

This paper cites MM-Eval: A Multilingual Meta-Evaluation Benchmark for LLM-as-a-Judge and Reward Models.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors MM-Eval: A Multilingual Meta-Evaluation Benchmark for LLM-as-a-Judge and Reward Models

Reference 36

Resolution
verified exact
arxiv_id, observed 2026-06-29T17:53:47.404546Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:3e97cfcaa2193da455531e78e631c2dc35b2f00a57925a4767f71f96518bd2f8

Observation ba0a2b5a-8483-4b7b-81f4-f57ccf47bc4c · outbound

This paper cites doi: 10.18653/v1/2024.findings-emnlp.552.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors doi: 10.18653/v1/2024.findings-emnlp.552

Reference 37

Resolution
metadata mismatch
doi, observed 2026-06-29T17:53:46.599555Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:90386c80e4c16e5d93bce16e701dd09031071bdc0c9a4b94489fb9816b947c7f

Observation c38fe32f-fd56-41d4-829f-53fa67ec7600 · outbound

This paper cites Judgebench: A benchmark for evaluating LLM-based judges.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Judgebench: A benchmark for evaluating LLM-based judges

Reference 38

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:0722840be9d52214429cf07a2f16077da22ec67863a717e75ffc729c53baa726

Observation 10ffa468-3d00-417d-a16c-9b22d5fda495 · outbound

This paper cites Cure: Cultural understanding and reasoning evaluation - a framework for "thick" culture alignment evaluation in llms, 2025.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Cure: Cultural understanding and reasoning evaluation - a framework for "thick" culture alignment evaluation in llms, 2025

Reference 39

Resolution
verified exact
arxiv_id, observed 2026-06-29T17:53:47.396624Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:df5fe000ae863ba19c1b38420b3cfc9d28c122deeb52400e89cb9a0d649e1312

Observation 288747a9-1a83-4f51-84de-bbf58bba0e8d · outbound

This paper cites Qwen3 Technical Report.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Qwen3 Technical Report

Reference 40

Resolution
verified exact
local_arxiv, observed 2026-06-29T17:53:47.418969Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:fe881261e14f536556b197eccf8bb0d5ec647d55245bca82b8b7d62f0ebbf60d

Observation 44992b7e-d786-42db-a60e-10e1dea9fe65 · outbound

This paper cites Hedderich.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Hedderich

Reference 41

Resolution
verified exact
doi, observed 2026-06-29T17:53:46.586802Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:9d5d421685ce70e7a49d76b3fd3ede47b271a7170cf7d9001d5002d2490e70eb

Observation 6668b4cb-1608-4641-a520-a79f5b947ed9 · outbound

This paper cites Judging llm-as-a-judge with mt-bench and chatbot arena.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Judging llm-as-a-judge with mt-bench and chatbot arena

Reference 42

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:9db5168af73d00734702cd06ace2cef044f19783a4eae8ab30458d3eac3c022c

Observation 5d62ea6a-7346-437c-b896-1037d82bbe8a · outbound

This paper cites ISBN 979-8-89176-251-0.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors ISBN 979-8-89176-251-0

Reference 43

Resolution
verified exact
doi, observed 2026-06-29T17:53:46.597559Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:47b43722650f11d76036224dbee8904722efce232ab8caa32c63393e4a64bb14

Observation 9b7bb17e-3117-4d45-9dec-f7beb7a6c7de · outbound

This paper cites fresh soy milk (kacang kedelai).

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors fresh soy milk (kacang kedelai)

Reference 44

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:b1eea4a76e9b51ca0fc5d1053b6c0875f0f0308a420b52ceee655f17676731cc

Observation da30f39e-24a2-4a38-bb98-374c54c8157c · outbound

This paper cites Rewrite the explanation to clearly convey their rationale.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Rewrite the explanation to clearly convey their rationale

Reference 46

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:eefd330e63698f1c462691c7fb1dc03871d840e6c8702963aa92abded490988f

Observation 82daa28e-e76d-423e-9f29-ba6da7f07021 · outbound

This paper cites Validator Comment.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Validator Comment

Reference 48

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:6140661616da61151b20aa446ba6e656c7f11b7ed4f50ad84502106c2ff8b03b

Observation e1b3ea3f-94cd-4ba2-b830-a000802a0fa9 · outbound

This paper cites Suggested Correction.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Suggested Correction

Reference 49

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:e23ead0d38733a4eb976b073c6a8f906c271ad37799f6bfeceba69f10699d48a

Observation 59ac089f-0e02-45a4-aaf7-d70f189b9dfb · outbound

This paper cites LLM Response.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors LLM Response

Reference 50

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:82af22f6ab15734a08de7dc2a5ae16777218d39f0783eb3a58b6bf73c2c23404

Observation d43761c8-30a2-4735-9e93-0d984f4ec109 · outbound

This paper cites Validator Comment.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Validator Comment

Reference 51

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:8c827166778c47c3d7cbc145ba87ef15596a85d7fd7bbdab32c2ae8d0afb5186

Observation f0bde085-7314-4039-a05b-878e09c714cf · outbound

This paper cites You may also use code-switched text where English acts as the matrix (base) language, embedding specific expressions, words, or idioms from the original language of the text.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors You may also use code-switched text where English acts as the matrix (base) language, embedding specific expressions, words, or idioms from the original language of the text

Reference 52

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:b4b1bc21af2f1dc48535ddc0e3e18f646ba306b54b85a751902433d0f0348797

Observation 5807551f-6cdb-4fef-8c8e-819a5647c2dc · outbound

This paper cites Validator Comment.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Validator Comment

Reference 53

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:df2379cbf13ea080c422adb64fd0cba7ce46807b32a95416ce174b87b18cb51f

Observation b03d5283-e0aa-47aa-88a3-4a865b3f13aa · outbound

This paper cites an unresolved cited work.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Unresolved cited work

Reference 54

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:d8db14ac0cbcc0a0dec1a4a73846e13f8c02bd10ff1b403e25d8994f07fe8d67

Observation 243da317-d5ce-4e55-84b5-4b693a888d2e · outbound

This paper cites an unresolved cited work.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Unresolved cited work

Reference 55

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:d33afbeeba32e1a499a267d898cb6e01882ba4f5c31c154e19a6a86db5654223

Observation 93033d76-dd19-4089-a231-34aa4808a2b0 · outbound

This paper cites Guidelines:.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Guidelines:

Reference 56

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:83253707e538896da50783c9e5c5e7188cf08747e087d9573a2cbed1f625e889

Observation 10b18940-125c-4e70-b275-ec6da9bf5a8a · outbound

This paper cites - The text spans do not need to be perfectly identical.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors - The text spans do not need to be perfectly identical

Reference 57

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:7b559165a0d7e4da3faa6765fff68729293a4bc704924625123ce048cd711c35

Observation b3d864ba-101f-4b85-89a1-542375f93513 · outbound

This paper cites {span_a}.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors {span_a}

Reference 58

Resolution
malformed identifier
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:89dc42b6726519d704483125d56947be4419ffbf7f1125c86c403f009a22e5a4

Observation 4f531cc1-9187-46ba-b104-4357d84fa974 · outbound

This paper cites error_type.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors error_type

Reference 61

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:365eeb0dc2f2f1fc14f562734d7bbc8d6a426e875c0ae7ee25a18c314a9fab00

Observation 5a42f340-6b2d-400b-8d8b-5150a9f6027e · outbound

This paper cites error_type.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors error_type

Reference 64

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:ef76e1bedd005636e13c481e5e689c9ba3f4c25265caa29e57d538a933f32762

Observation 6fad9ce4-62c8-4d74-b0ff-12e7f368c6fd · outbound

This paper cites error_type.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors error_type

Reference 67

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:553b588a570b44951e956f3e05e6e0f82d45307b0701f3ff147dc8da2b9588a5

Observation 2ac0150e-f117-490d-84e9-a40436dbf52e · outbound

This paper cites an unresolved cited work.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Unresolved cited work

Reference 68

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:66ec91fc78d86ff12821ed7228e1ba8685e4dd666c6887d4f201eb070ce0e114

Observation c5215c34-ea2b-4cc3-8c47-5cf23572d431 · outbound

This paper cites an unresolved cited work.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Unresolved cited work

Reference 69

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:231f239546c0a6141e4a97dbea9ed403d85fe7790c8706a91f25a0be4f2af4b1

Observation 919c0f68-7587-454a-bed6-77b25c74b85f · outbound

This paper cites error_type.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors error_type

Reference 70

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:7379cab62f8e4b07400585ed05582733a43f252a5b7fd72cfa0da6fee158d303

Observation fa062876-347a-479a-8b35-ab9bee7f4edd · outbound

This paper cites same/different.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors same/different

Reference 71

Resolution
unresolved
no resolver link, observed 2026-06-29T17:47:11.338622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:55af8707f262e6df3d99eaba7bdf3d9fe63366d1077d9df71ff93cc52a08d05d

Observation 5658ce11-e77a-4a93-b119-c3353881f541 · outbound

This paper cites an unresolved cited work.

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors Unresolved cited work

Reference 72

Resolution
verified exact
arxiv_id, observed 2026-06-29T17:53:47.393828Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-06-29T17:47:11.338622Z digest=sha256:51b27d718e8dee93770df97351751a683df2324c62da48a2de52b335a55c539b

Pith citing papers

No inbound Pith citation observations are available.