REVIEW 6 cited by
TARGET: Automated Scenario Generation from Traffic Rules for Testing Autonomous Vehicles via Validated LLM-Guided Knowledge Extraction
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Recent incidents with autonomous vehicles highlight the need for rigorous testing to ensure safety and robustness. Constructing test scenarios for autonomous driving systems (ADSs), however, is labor-intensive. We propose TARGET, an end-to-end framework that automatically generates test scenarios from traffic rules. To address complexity, we leverage a Large Language Model (LLM) to extract knowledge from traffic rules. To mitigate hallucinations caused by large context during input processing, we introduce a domain-specific language (DSL) designed to be syntactically simple and compositional. This design allows the LLM to learn and generate test scenarios in a modular manner while enabling syntactic and semantic validation for each component. Based on these validated representations, TARGET synthesizes executable scripts to render scenarios in simulation. Evaluated seven ADSs with 284 scenarios derived from 54 traffic rules, TARGET uncovered 610 rule violations, collisions, and other issues. For each violation, TARGET generates scenario recordings and detailed logs, aiding root cause analysis. Two identified issues were confirmed by ADS developers: one linked to an existing bug report and the other to limited ADS functionality.
Forward citations
Cited by 6 Pith papers
-
Chat2Scenic: An Iterative RAG-Based Framework for Scenario Generation in Autonomous Driving
Chat2Scenic generates executable Scenic driving-scenario scripts from regulation-style text with 76.4% compilation success, using iterative component-wise generation with retrieval-augmented prompting.
-
Causality-aware Safety Testing for Autonomous Driving Systems
Causal-Fuzzer uses causal graphs of scene, action, and violation relationships to guide simulation fuzzing, and reports finding more diverse violations and better testing sufficiency than three baselines on Apollo.
-
From Failures to Fixes: LLM-Driven Scenario Repair for Self-Evolving Autonomous Driving
SERA uses LLM-driven failure analysis and scenario retrieval to select training scenarios for few-shot fine-tuning, improving simulated autonomous driving scores.
-
Multi-modal Traffic Scenario Generation for Autonomous Driving System Testing
TrafficComposer combines an LLM text parser and computer-vision object and lane detectors to generate executable CARLA/LGSVL traffic scenarios, reporting 97% IR accuracy and improved ADS fuzz testing.
-
AutoODD: Agentic Audits via Bayesian Red Teaming in Black-Box Models
AutoODD combines an LLM agent with per-axis Gaussian Process uncertainty to automatically discover failure modes of black-box models, demonstrated on missing-digit MNIST and aircraft detect-and-avoid.
-
Survey of GenAI for Automotive Software Development: From Requirements to Executable Code
A review of roughly 60 papers and 9 industry respondents finds GPT-family models dominate automotive code generation while requirements handling lags due to confidentiality constraints.
Discussion (0). Continue with ORCID to comment.