Pith. sign in

Paper Citation Record · LEDGER

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation

As of 8 August 2026, this Paper Citation Record lists 14 of 14 outbound references and 0 inbound Pith citation observations for arXiv:2506.11237.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.11237 v1

Coverage vector

measured 14 of 14 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T04:15:57.248959Z

measured 14 of 14 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

14 of 14 outbound references displayed

  • verified exact1
  • verified fuzzy0
  • unresolved13
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 322da3ed-11c6-47b4-8417-0a365e6a6b7c · outbound

This paper cites an unresolved cited work.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation Unresolved cited work

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:56.108897Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:56.108897Z digest=sha256:52e419c5d5bbd0227c5ac4d940871bb297fad88ca6bbd61ddd8de5cd46cb21af

Observation 2af61963-1fb7-4272-869b-c5ce447f49e3 · outbound

This paper cites an unresolved cited work.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation Unresolved cited work

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:56.175034Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:56.175034Z digest=sha256:57e4f687676e4c3d4ebff2e613a95d83226a1fde7467f5f3bc01bd0ef6f64d35

Observation ed8ce834-b70a-48a8-8a37-b4855c869ef8 · outbound

This paper cites GPTScore: Evaluate as You Desire.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation GPTScore: Evaluate as You Desire

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:56.303867Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:56.303867Z digest=sha256:e4630c513d438beec299a809d3c2f41e4c7b16f0acf172ca0a8d27cff235c1f1

Observation 1c79f0e6-8d8c-45d9-ad65-d6c0a5bb5213 · outbound

This paper cites an unresolved cited work.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation Unresolved cited work

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:56.379860Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:56.379860Z digest=sha256:9e3a873099673bf8f222d398742136297b024b324a92563fdcd67178cf5eddb5

Observation fc854bf4-b478-4cd9-98f2-95c32856f6de · outbound

This paper cites G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:56.484331Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:56.484331Z digest=sha256:21a8c0189befbe703966baed43940432eda08099796a8b3d5b9a47f530e6194b

Observation d6037926-308a-47f5-8264-043df51d932c · outbound

This paper cites GPT-4 Technical Report.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation GPT-4 Technical Report

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:56.569558Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:56.569558Z digest=sha256:1a3134b2c4db76edfd65a564738c647ae151c0645d60d6a531a317898deaf9b3

Observation 01736c5d-2db0-43dc-8a6b-4f5247f98262 · outbound

This paper cites an unresolved cited work.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation Unresolved cited work

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:56.645607Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:56.645607Z digest=sha256:3bf42ceb9636f90060064caef549f1e29fbba7466147787e87da026eb8eec95e

Observation a27aa9c3-4bc7-425f-9b83-79a79f7cac0a · outbound

This paper cites CodeBLEU: a Method for Automatic Evaluation of Code Synthesis.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation CodeBLEU: a Method for Automatic Evaluation of Code Synthesis

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:56.728459Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:56.728459Z digest=sha256:5ed0acad5adccebe60099af94e2447feb936a5d8cbb97c7aa6c561b98e8ad2c0

Observation 03b70daa-2187-4ed2-9f0a-7fd0610ab354 · outbound

This paper cites Execution-Based Evaluation of Natural Language to Bash and PowerShell for Incident Remediation.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation Execution-Based Evaluation of Natural Language to Bash and PowerShell for Incident Remediation

Reference 9

Resolution
verified exact
local_arxiv, observed 2026-08-07T04:15:57.437306Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T04:15:56.808012Z digest=sha256:b641ef618306a5e4ba8ba66aada5c21cd4f647f4319ea59e5a9c46d8d9b0b39a

Observation 455c4b78-3140-4a1b-9c67-4a77c259d479 · outbound

This paper cites an unresolved cited work.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-07T04:15:57.931865Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T04:15:56.864925Z digest=sha256:7cb8c999527a4a5be706f7cf8f82d943aab6d18b8b568a28513a5a4240791fac

Observation 0d63beb1-a575-47a6-9b4b-1e27ab0d1bac · outbound

This paper cites CodeBERTScore: Evaluating Code Generation with Pretrained Models of Code.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation CodeBERTScore: Evaluating Code Generation with Pretrained Models of Code

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:56.956169Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:56.956169Z digest=sha256:62b90b8a578051df786186cf1df31350b14ad0a7040e7d8a5beaf681b96658b6

Observation 60b6cb92-cccd-46da-b332-65b0935fbba7 · outbound

This paper cites an unresolved cited work.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-07T04:15:57.789791Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T04:15:57.080553Z digest=sha256:ae11bc2bb6ff12641b4485b3c695737fb63e048ddfed33d40da18061a72e46d3

Observation e7d5dccd-102a-4386-b46b-011d92567cb0 · outbound

This paper cites online" 'onlinestring :=.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation online" 'onlinestring :=

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:57.151356Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:57.151356Z digest=sha256:f7971527e709dee6790f2e3d339e229caa5deb98f1e4efdd1d4175e8a4cbaa4b

Observation e0b919a5-7f07-4c85-9e21-d6a1af4bfeb5 · outbound

This paper cites write newline.

LLM-as-a-Judge for Reference-less Automatic Code Validation and Refinement for Natural Language to Bash in IT Automation write newline

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T04:15:57.248959Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T04:15:57.248959Z digest=sha256:a80e205d0ecd377e118256e86c6885cbff71f7643cd5e6806502a342eec51d85

Pith citing papers

No inbound Pith citation observations are available.