{"id":"d3ed76b5-278a-492a-937e-51d67762ad1f","arxiv_id":"2606.25146","paper_version":1,"verdict":"UNVERDICTED","confidence":"LOW","novelty_score":5.0,"correctness_risk":"unknown","formal_verification":"none","parameter_count":0,"one_line_summary":"SwarmFly is a modular MATLAB simulator for UAV swarms with leader-follower, decentralized, heterogeneous relay, and heterogeneous speed modes plus plugins for faults and analysis.","lead":"SwarmFly is a MATLAB-based simulation platform for multi-UAV swarms that includes real-time maps, four coordination modes, simulated IMU data, and a plugin system for adding behaviors and fault models. Researchers developing drone swarms might use it to test coordination strategies and disruptions in simulation before hardware experiments.","discovery_kind":"new_method","skeptic_critique":{"model":"grok-4.3","headline":"No significant objection identified","rationale":"Reader's weakest assumption correctly flags the experiments' sufficiency as the soft spot for a tool paper. Full text does not introduce a new load-bearing technical risk beyond that; the UNVERDICTED verdict therefore stands.","tokens_in":1801,"tokens_out":266,"duration_ms":12369,"concrete_test":"Re-run the eight experiments from the results section while logging the exact quantitative metrics (e.g., RMSE for formation accuracy, recovery time for faults) and compare against at least one other open UAV swarm simulator on the same scenarios; if the reported numbers differ by more than the stated tolerances, the characterization claim weakens.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central claim is that SwarmFly fills a recognized gap via its listed features plus eight experiments that verify/characterize the subsystems. The full text (now available) presents the platform as a MATLAB tool with described plugins and experiments; it does not advance a novel scientific discovery whose correctness hinges on a single fragile assumption. The experiments are presented as verification steps rather than as load-bearing evidence for an empirical claim. No internal inconsistency, hidden assumption in an equation, or untested extension is required for the platform-description claim to hold at the level asserted.","agreement_with_reader":"agree"},"referee_report":{"model":"grok-4.3","summary":"The paper presents SwarmFly, a MATLAB-based modular simulation platform for UAV swarm experiment design and validation. It integrates a real-time operational map, four swarm coordination modes (leader-follower, decentralized, heterogeneous relay, heterogeneous speed), simulated IMU telemetry, IP-based geolocation, and a plugin architecture allowing addition of behaviors, fault models, and analysis tools. Eight bundled plugins extend the simulator into a test harness, and the platform is validated through eight experiments characterizing formation accuracy, wind tolerance, fault recovery, energy endurance, and airspace compliance. The design supports extension to hardware-in-the-loop testing and larger swarms, with an open-source release provided.","tokens_in":1869,"tokens_out":417,"duration_ms":17449,"significance":"If the implementation matches the description, SwarmFly offers a practical, extensible open-source tool that addresses limitations of existing UAV swarm simulators (unmaintained code, steep learning curves, fixed scenarios). The plugin architecture and verification experiments are strengths that support reproducibility and community use in swarm behavior research under disruptions.","major_comments":[],"minor_comments":[{"comment":"Abstract: the phrase 'multi- UAV' contains an extraneous space; correct to 'multi-UAV' for consistency with standard terminology.","section":null},{"comment":"The manuscript should include a dedicated table or section explicitly listing the eight bundled plugins and their specific functions, as the current description only states that they 'extend the base simulator' without enumeration.","section":null},{"comment":"Experiments section: while the abstract states that eight experiments measure the listed properties, the main text should provide at least one quantitative result (e.g., mean formation error or recovery time) per experiment with units, to allow readers to assess the verification claims without needing to run the code.","section":null},{"comment":"The GitHub link is given but the manuscript does not state the commit hash or release tag used for the reported experiments; add this for reproducibility.","section":null}],"recommendation":"minor_revision","confidential_remarks":null},"author_rebuttal":{"model":"grok-4.3","summary":"We thank the referee for the positive summary, significance assessment, and recommendation of minor revision. No specific major comments were provided in the report.","responses":[],"tokens_in":1269,"tokens_out":47,"duration_ms":5565,"standing_objections":[]},"desk_editor":{"model":"grok-4.3","letter":"SwarmFly packages a MATLAB-based UAV swarm simulator that includes a real-time map, four coordination modes, simulated IMU data, IP geolocation, and a plugin architecture for adding behaviors and fault models.\n\nThe paper does a clear job describing how the plugins turn the base simulator into a test harness and how the eight experiments check formation accuracy, wind tolerance, fault recovery, energy use, and airspace rules. Releasing the code on GitHub is a practical step that lets others inspect or extend it.\n\nThe main limitation is that this remains a tool-description paper. The text does not include quantitative results from the experiments or direct comparisons against other simulators, so the strength of the verification claims is hard to judge from the description alone. The choice of MATLAB may also limit uptake compared with Python or ROS-based options.\n\nResearchers already working in MATLAB who need a customizable swarm testbed will get the most from it. A reader looking for a documented starting point for simulation experiments could find it worthwhile. The work shows enough concrete implementation to merit peer review rather than an immediate desk reject.\n\nI would send it out for review, expecting referees to request more data and usage examples.","headline":"SwarmFly is a new open MATLAB UAV swarm simulator with a plugin system and eight verification experiments; useful tooling but incremental.","tokens_in":2375,"tokens_out":309,"would_cite":false,"duration_ms":12711,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"grok-4.3","headline":"SwarmFly is a modular MATLAB platform for simulating UAV swarms with real-time mapping, four coordination modes, and extensible plugins.","keywords":["UAV swarm simulation","MATLAB platform","multi-agent coordination","plugin architecture","formation accuracy","fault recovery","energy endurance","airspace compliance"],"falsifier":"An attempt to add a new behavior or fault model via plugin that requires changes to the core simulator code, or real-world UAV swarm tests that produce failure modes absent from the eight simulation experiments.","tokens_in":2681,"feed_emoji":"🚁","tokens_out":488,"duration_ms":17648,"temperature":0.7,"pith_summary":"The paper presents SwarmFly as a solution to the lack of flexible, maintained simulation tools for UAV swarm research. Existing tools often have steep learning curves or are limited to fixed scenarios, making it hard to test new ideas quickly. SwarmFly provides a real-time operational map, four coordination modes including leader-follower and decentralized, simulated sensors, and a plugin system for custom additions. It demonstrates the platform through eight experiments on formation, wind, faults, energy, and compliance. This allows researchers to observe and measure swarm behaviors under disruptions in a controlled environment.","feed_headline":"SwarmFly simulates UAV swarms in MATLAB with four coordination modes","feed_subtitle":"A modular platform with real-time maps and plugins lets researchers test formations, wind tolerance, and fault recovery before hardware depl","key_machinery":"The plugin architecture that lets researchers add behaviors, fault models, and analysis tools without touching the core code, together with the real-time operational map and four coordination modes.","core_discovery":"SwarmFly addresses the recognized research gap in comprehensive, modular simulation platforms for UAV swarms by combining a real-time operational map, four swarm coordination modes (leader-follower, decentralized, heterogeneous relay, and heterogeneous speed), simulated IMU telemetry, IP-based geolocation, and a plugin architecture that lets researchers add behaviors, fault models, and analysis tools without touching the core code. Eight bundled plugins extend the base simulator into a full test harness. The platform verifies and characterizes each subsystem through eight experiments that measure formation accuracy, wind tolerance, fault recovery, energy endurance, and airspace compliance, w","pith_inferences":[],"forward_implications":[],"fun_headline_variants":["SwarmFly tests UAV swarms in MATLAB with four modes","MATLAB based SwarmFly for modular UAV swarm experiments","SwarmFly platform enables UAV swarm plugin extensions","Real-time map supports SwarmFly UAV coordination tests","SwarmFly verifies UAV swarm accuracy and endurance in MATLAB"],"cache_read_input_tokens":2112,"weakest_assumption_plain":"That the eight experiments sufficiently verify all subsystems and that the modular design will support straightforward extension to hardware-in-the-loop testing and larger swarms.","fun_headline_variants_meta":{"raw":{"variants":["SwarmFly tests UAV swarms in MATLAB with four modes","MATLAB based SwarmFly for modular UAV swarm experiments","SwarmFly platform enables UAV swarm plugin extensions","Real-time map supports SwarmFly UAV coordination tests","SwarmFly verifies UAV swarm accuracy and endurance in MATLAB"]},"model":"grok-4.3","cost_usd":0.006582,"raw_usage":{"total_tokens":3109,"prompt_tokens":737,"num_sources_used":0,"completion_tokens":75,"cost_in_usd_ticks":65824500,"prompt_tokens_details":{"text_tokens":737,"audio_tokens":0,"image_tokens":0,"cached_tokens":256},"completion_tokens_details":{"audio_tokens":0,"reasoning_tokens":2297,"accepted_prediction_tokens":0,"rejected_prediction_tokens":0}},"tokens_in":737,"tokens_out":75,"duration_ms":10618,"temperature":1.0,"reasoning_tokens":2297,"cache_read_input_tokens":256,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-06-25T23:47:43.058646+00:00","model_set":{"reader":"grok-4.3"},"falsifier":"An attempt to add a new behavior or fault model via plugin that requires changes to the core simulator code, or real-world UAV swarm tests that produce failure modes absent from the eight simulation experiments.","supporting_citations":[],"review_version":1}