{"id":"9df6633a-7820-45bb-8532-c7e3a70fe216","arxiv_id":"2606.19267","paper_version":1,"verdict":"UNVERDICTED","confidence":"LOW","novelty_score":5.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":0,"one_line_summary":"A mixed-reality testbed integrates physical robots with simulation for validating AV perception, planning, and control, including a CBF-based safety framework for connected autonomous vehicles.","lead":"The paper proposes a mixed-reality hardware-in-the-loop testbed that combines physical mobile robots equipped with sensors and a high-fidelity simulation to test autonomous vehicle algorithms in diverse scenarios. A smart generalist might read it to see a practical approach for safely validating self-driving technologies before full real-world use.","discovery_kind":"new_method","skeptic_critique":{"model":"grok-4.3","headline":"CBF safety certificates may fail to hold under unmodeled HIL latency and synchronization errors","rationale":"The reader’s weakest assumption already isolates the exact integration-risk point that would falsify the safety guarantee. Because the full text was unavailable to the reader, the current UNVERDICTED verdict is appropriate; once the latency and CBF-robustness data are checked, the verdict can be moved to CONDITIONAL (or lower) if the numbers do not support the claim.","tokens_in":1764,"tokens_out":421,"duration_ms":11789,"concrete_test":"From the experiments section, extract the reported CBF control frequency, the measured round-trip latency of the wireless/physical-virtual interface, and whether the barrier function uses a standard or ISSf-CBF formulation. Re-simulate the closed-loop system with an additive delay equal to the measured latency; if any trajectory violates the original barrier condition, the safety claim does not survive the integration.","verdict_should_be":"CONDITIONAL","load_bearing_attack":"The central claim is that the mixed-reality testbed plus the online-learning CBF controller delivers safety-guaranteed validation for CAV perception-planning-control. CBF safety proofs (typically η(x) ≥ 0 → u ∈ K(x) keeps the system inside the safe set) rest on the assumption that the measured state reaches the controller with bounded, known delay and that the plant model used in the barrier function matches the closed-loop dynamics. The testbed description explicitly combines physical robots, wireless V2X links, photorealistic rendering, and a variable number of virtual agents; any of these introduce variable latency, clock skew, or rendering-to-sensor mismatch. No section in the provided abstract or reader summary shows that the CBF formulation was extended to input-to-state safety or that end-to-end loop timing was measured and folded into the certificate. If those effects are larger than the robustness margin, the “safety-guaranteed” label does not transfer from theory to the deployed HIL system.","agreement_with_reader":"agree"},"referee_report":{"model":"grok-4.3","summary":"The manuscript proposes a mixed-reality hardware-in-the-loop (HIL) testbed for autonomous vehicles that integrates a physical testbed of mobile robots equipped with multimodal sensors into a high-fidelity simulation environment. The virtual component enables diverse safety-critical scenarios, while physical robots in photorealistic settings support rigorous validation; the testbed also incorporates wireless V2X connectivity and scales to many agents via mixed physical-virtual setups for multi-agent CAV research. A safety-guaranteed framework is presented that combines perception, planning, and a novel online learning-based controller using Control Barrier Functions (CBFs). Experiments are stated to validate the testbed's key functionalities and utility in bridging simulation and real-world deployment.","tokens_in":1933,"tokens_out":448,"duration_ms":23931,"significance":"If the HIL integration proves robust and the CBF safety guarantees hold under deployed conditions, the testbed would offer a useful platform for scalable validation of perception-planning-control pipelines in multi-agent CAV settings, particularly by allowing controlled introduction of physical hardware into otherwise simulated scenarios. The explicit combination of physical robots and virtual agents is a constructive feature for studying connectivity and coordination.","major_comments":[{"comment":"Abstract: The central claim of a 'safety-guaranteed framework' using CBFs is load-bearing, yet the manuscript contains no analysis, extension (e.g., input-to-state safety), or measurements addressing variable latency, clock skew, or rendering-to-sensor mismatch arising from wireless links, photorealistic rendering, and mixed physical-virtual agents. Without such handling, the theoretical CBF certificates (η(x) ≥ 0 implying u ∈ K(x)) do not necessarily transfer to the HIL closed loop.","section":"Abstract"},{"comment":"Abstract (validation paragraph): The statement that 'Experiments using the proposed framework are used to validate...' is load-bearing for demonstrating utility, but the manuscript provides no quantitative results, timing data, safety-violation metrics, or error analysis from those experiments, preventing assessment of whether unmodeled HIL effects remain within robustness margins.","section":"Abstract"}],"minor_comments":[],"recommendation":"major_revision","confidential_remarks":null},"author_rebuttal":{"model":"grok-4.3","summary":"We thank the referee for their constructive and detailed feedback on our manuscript. We address the two major comments point by point below, acknowledging where the current version falls short and outlining the revisions we will make.","responses":[{"response":"We agree that the manuscript does not provide explicit analysis or measurements of HIL-induced effects such as variable latency, clock skew, or rendering-to-sensor mismatch on the CBF safety guarantees. The framework is presented with theoretical CBF certificates, but these HIL-specific factors are not addressed. In the revised manuscript we will add a dedicated discussion subsection on these issues, including potential robustness margins, conservative design choices, and any available preliminary measurements from the testbed hardware.","revision_made":"yes","referee_comment":"[Abstract] Abstract: The central claim of a 'safety-guaranteed framework' using CBFs is load-bearing, yet the manuscript contains no analysis, extension (e.g., input-to-state safety), or measurements addressing variable latency, clock skew, or rendering-to-sensor mismatch arising from wireless links, photorealistic rendering, and mixed physical-virtual agents. Without such handling, the theoretical CBF certificates (η(x) ≥ 0 implying u ∈ K(x)) do not necessarily transfer to the HIL closed loop."},{"response":"The experiments section demonstrates the testbed functionalities and framework through a combination of qualitative demonstrations and basic quantitative validation. However, we acknowledge that detailed timing data, safety-violation counts, and error analysis specifically quantifying HIL effects are not reported. In the revision we will expand the experimental results with additional quantitative metrics, timing measurements, and safety-related statistics drawn from the existing experiment logs.","revision_made":"yes","referee_comment":"[Abstract] Abstract (validation paragraph): The statement that 'Experiments using the proposed framework are used to validate...' is load-bearing for demonstrating utility, but the manuscript provides no quantitative results, timing data, safety-violation metrics, or error analysis from those experiments, preventing assessment of whether unmodeled HIL effects remain within robustness margins."}],"tokens_in":1386,"tokens_out":443,"duration_ms":22689,"standing_objections":[]},"desk_editor":{"model":"grok-4.3","letter":"The paper's core offering is a mixed-reality testbed that runs physical mobile robots inside photorealistic simulated scenes while mixing in virtual agents and wireless V2X links. It also adds an online-learning CBF controller for the perception-planning-control stack in CAVs. The setup aims to let researchers create safety-critical multi-agent scenarios without full real-world exposure.\n\nThe practical side is the strongest part. Blending hardware sensors with high-fidelity rendering and scaling agent count through virtual entities is a straightforward way to expand test coverage. Groups that already run robot testbeds or need repeatable edge cases for connected vehicles could borrow the architecture.\n\nThe soft spot is the safety claim. Standard CBF certificates assume the measured state arrives with bounded delay and that the plant model matches the closed loop. The testbed explicitly includes wireless links, variable rendering, and physical-virtual handoff, all of which introduce latency and clock skew. Nothing in the abstract shows the CBF was made input-to-state safe or that end-to-end timing was measured and folded into the certificate. If those effects exceed the robustness margin, the \"safety-guaranteed\" label does not carry over to the deployed HIL system.\n\nThe abstract mentions validation experiments but supplies no numbers, error bars, or timing data, so it is impossible to judge how well the controller actually performed under the mixed conditions. The work is incremental on existing HIL and CBF ideas rather than a fundamental shift.\n\nThis is for robotics and controls labs that build or use AV testbeds. A reader who needs a concrete starting point for mixed-reality validation will find the description helpful even if the results section is thin. It is coherent enough on its own terms to warrant referee time so the timing and safety issues can be checked against the full implementation.","headline":"The paper gives a usable mixed-reality HIL testbed description plus an online-learning CBF controller, but the safety guarantees look vulnerable to unmodeled delays and sync errors.","tokens_in":2446,"tokens_out":439,"would_cite":false,"duration_ms":26750,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"grok-4.3","headline":"A mixed-reality hardware-in-the-loop testbed integrates physical mobile robots with high-fidelity virtual simulations to validate autonomous vehicle algorithms.","keywords":["mixed-reality","hardware-in-the-loop","autonomous vehicles","control barrier functions","connected autonomous vehicles","testbed","simulation","multi-agent systems"],"falsifier":"An experiment in which a safety-critical maneuver produces a control barrier function violation traceable to measured integration latency or desynchronization between the physical robot and the virtual environment.","tokens_in":2668,"feed_emoji":"🚗","tokens_out":670,"duration_ms":24440,"temperature":0.7,"pith_summary":"The paper sets out to show that blending physical robots equipped with multimodal sensors into photorealistic virtual environments creates a practical way to test connected autonomous vehicle systems in complex, safety-critical scenarios. This matters because full physical testing carries high risk and cost while pure simulation often fails to capture real hardware behavior. The testbed adds wireless connectivity for multi-agent work and includes a framework that combines perception, planning, and an online learning controller based on control barrier functions to enforce safety. Experiments confirm the setup can move algorithms from virtual testing to hardware deployment while handling large numbers of agents through the mix of real and simulated entities.","feed_headline":"Physical robots join simulations to test connected vehicle safety","feed_subtitle":"Hardware-in-the-loop setup places real sensors into virtual scenarios and applies barrier functions to guarantee safe control for multi-agen","key_machinery":"The mixed-reality HIL testbed that places physical robots with sensors into photorealistic virtual environments, together with the Control Barrier Function-based online learning controller that enforces safety during perception, planning, and control.","core_discovery":"The authors establish a mixed-reality hardware-in-the-loop testbed that seamlessly combines a physical testbed of mobile robots with multimodal sensors operating in high-fidelity simulation environments, supports vehicular connectivity, accommodates large numbers of agents through physical and virtual combinations, and includes a safety-guaranteed framework that integrates perception, planning, and a novel online learning-based controller using Control Barrier Functions for connected autonomous vehicles.","pith_inferences":["The hybrid setup could shorten AV development cycles by letting teams iterate on edge cases without full physical risk.","If latency stays low, the same physical-virtual scaling might apply to testing other autonomous systems such as delivery robots.","Standard test protocols for regulatory review of vehicle behaviors could draw on this mixed-reality pattern.","Multi-lab collaborative experiments become feasible when one site supplies the physical robots and another supplies additional virtual agents."],"forward_implications":["Validation of perception, planning, and control algorithms occurs in diverse safety-critical driving scenarios created in the virtual environment.","Research on multi-agent systems including connected autonomous vehicles proceeds with wireless communication and scalable agent counts.","The testbed supports experiments that demonstrate bridging simulation to real-world hardware deployment.","Safety guarantees hold through the combination of the physical robots and the CBF-based controller in mixed settings."],"fun_headline_variants":["Mixed-reality testbed merges robots and simulations for CAV validation","Real robots with sensors operate inside high-fidelity virtual driving scenes","Connectivity and multi-agent support in hardware-in-the-loop AV testbed","Safety framework uses online learning and barrier functions for CAVs"],"cache_read_input_tokens":2112,"weakest_assumption_plain":"The physical-virtual integration introduces no significant latency, synchronization errors, or communication delays that would undermine the safety guarantees of the control barrier functions.","fun_headline_variants_meta":{"raw":{"variants":["Mixed-reality testbed merges robots and simulations for CAV validation","Real robots with sensors operate inside high-fidelity virtual driving scenes","Connectivity and multi-agent support in hardware-in-the-loop AV testbed","Safety framework uses online learning and barrier functions for CAVs"]},"model":"grok-4.3","cost_usd":0.009257,"raw_usage":{"total_tokens":4120,"prompt_tokens":619,"num_sources_used":0,"completion_tokens":69,"cost_in_usd_ticks":92574500,"prompt_tokens_details":{"text_tokens":619,"audio_tokens":0,"image_tokens":0,"cached_tokens":256},"completion_tokens_details":{"audio_tokens":0,"reasoning_tokens":3432,"accepted_prediction_tokens":0,"rejected_prediction_tokens":0}},"tokens_in":619,"tokens_out":69,"duration_ms":19633,"temperature":1.0,"reasoning_tokens":3432,"cache_read_input_tokens":256,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-06-26T21:03:26.623352+00:00","model_set":{"reader":"grok-4.3"},"falsifier":"An experiment in which a safety-critical maneuver produces a control barrier function violation traceable to measured integration latency or desynchronization between the physical robot and the virtual environment.","supporting_citations":[],"review_version":1}