{"id":"77dd28d0-516d-4aef-9b15-bcca5929b0cf","arxiv_id":"2611.16786","paper_version":1,"verdict":"ACCEPT","confidence":"HIGH","novelty_score":6.0,"correctness_risk":"low","formal_verification":"none","parameter_count":0,"one_line_summary":"RadarML is a multi-channel over-the-air dataset of common radar waveforms for electronic surveillance evaluation.","lead":"This paper presents RadarML, a publicly available dataset of around two million over-the-air radar pulses recorded across three semi-independent receiver channels. It aims to provide a standard reference for evaluating radar modulation classification algorithms on real-world data.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek/deepseek-v4-flash","headline":"No significant objection identified","rationale":"The reader's verdict is ACCEPT with high confidence, and the weakest assumption identified is about generalizability to real-world scenarios. This is a reasonable limitation but not a load-bearing concern because the paper does not claim the dataset is representative of all operational environments; it is a controlled, reproducible benchmark. The stress-test finds no internal contradictions, missing evidence, or unsupported claims. The dataset is publicly available, the code is provided, and the hardware setup is thoroughly described. The paper fulfills its stated goal of providing a multi-channel over-the-air dataset. Therefore, no adjustment to the verdict is needed, and the agreement with the reader is complete.","tokens_in":6582,"tokens_out":444,"duration_ms":4718,"concrete_test":"Download the dataset from the provided DOI and verify that a randomly selected subset of files has the stated dimensions [3, 1000, 33600] and np.int16 dtype. Run the provided dataloader_demo.ipynb to confirm that the pulses load and display as described. This would confirm the dataset's basic integrity.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The paper presents a dataset, not a scientific claim that can be falsified. The central claim is that RadarML is a publicly available, multi-channel, over-the-air dataset of radar pulses. The paper provides the dataset DOI, code repository, detailed hardware description, and waveform definitions. The reader's weakest assumption—that the dataset may not generalize to real-world ES scenarios—is acknowledged by the authors implicitly through the controlled chamber setup, but this is a limitation of scope, not a flaw in the dataset's construction or documentation. No internal inconsistency, missing evidence, or unsupported assertion is present. The dataset is what it claims to be: a large, reproducible collection of over-the-air radar pulses with multiple channels. The paper does not make a strong empirical claim that would require statistical validation or comparison to other datasets; it is a data descriptor. Therefore, no load-bearing concern about the central claim can be identified.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek/deepseek-v4-flash","summary":"The paper presents RadarML, a publicly available dataset of around two million over-the-air radar pulses with various modulations (CW, linear/nonlinear FM, CP-FSK, Barker codes) and parameters (centre frequency, bandwidth, pulse width), recorded simultaneously across three semi-independent receiver channels using the UCL ARESTOR RFSoC platform. The dataset is provided as raw digitised samples (np.int16) with no synthetic noise, along with a PyTorch dataloader, augmentation routines, and a baseline VGG13 classifier for demonstration. The goal is to enable reproducible comparative evaluation of radar modulation classification and multi-channel signal processing techniques.","tokens_in":9442,"tokens_out":823,"duration_ms":23814,"significance":"If the dataset is as described, it fills a clear gap: existing public radar waveform datasets are either synthetic or single-channel, whereas RadarML provides multi-channel over-the-air measurements with controlled variation of key parameters. The use of three mesochronous ADC channels with different analogue front-ends introduces realistic channel diversity. The dataset is large (∼2M pulses), well-documented, and publicly released under a permissive license. The accompanying code and baseline classifier lower the barrier for entry. This resource has the potential to become a standard benchmark for electronic surveillance research, analogous to what RadioML did for communications modulation classification.","major_comments":[],"minor_comments":[{"comment":"The abstract states 'around two million waveforms' but the dataset description does not give the exact number of parameter combinations. Adding a brief calculation or a table with the total number of pulses per modulation type would improve clarity.","section":"Abstract & §II","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The table lists '4 CP-FSK' as a modulation type. The meaning of '4' is clear from context (four frequencies), but it would be helpful to spell out '4-ary CP-FSK' or add a footnote.","section":"§II, Table 1","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The equation for the tangential chirp appears to have a formatting glitch: 'T an f(t)' should likely be 'f(t)' or 'f_{tan}(t)'. Please check the LaTeX rendering.","section":"§II, Eq. (4)","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The paper says 'In half of the frequency-modulated examples, the start (f0) and stop (f1) frequencies were swapped to generate the corresponding \"down\" chirps.' This is good, but it would be useful to state explicitly whether the dataset includes both up and down chirps for all FM types or only for a subset.","section":"§II","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The table lists attenuations for ADC2 and ADC4 but not for ADC0. It says 'N/A' for DAC0 and ADC0, which is clear, but consider adding a note that ADC0 has no additional attenuation.","section":"§III, Table 3","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The dataset DOI is provided. It would be helpful to also mention the approximate total size of the dataset (e.g., in GB) so users can plan downloads.","section":"§IV","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The paper would benefit from a brief discussion of limitations, such as the controlled anechoic chamber environment, the use of a single transmitter, and the absence of multipath or interference. This would help users assess the dataset's applicability to operational scenarios.","section":"General","authors_acknowledge":null,"authors_acknowledge_p":null}],"recommendation":"accept"},"author_rebuttal":null,"desk_editor":{"model":"deepseek/deepseek-v4-flash","letter":"Hey,\n\nRadarML is exactly what it says on the tin: a public, multi-channel, over-the-air dataset of ~2 million radar pulses with a wide parameter sweep. That alone is a genuine contribution to the radar ES community, where public datasets are scarce and most work is on synthetic data. The hardware documentation is thorough, the data is raw (no synthetic noise baked in), and they ship code for loading and a baseline classifier. Credit where due: this is reproducible, well-scoped, and fills a gap.\n\nThe paper is a data descriptor, so there is no scientific claim to falsify. The baseline VGG13 results are just a demo, not a claim of state-of-the-art performance. That is fine for this kind of paper.\n\nSoft spots: the dataset was recorded in an anechoic chamber at short range with co-located receivers. The authors do not discuss limitations of generalizability to real-world ES scenarios (multipath, interference, non-cooperative emitters). The stress-test note says this is a limitation of scope, not a flaw, and I agree—but it is worth noting because a naive user might over-interpret the dataset as representative of operational environments. Also, the paper leans heavily on previous ARESTOR publications for hardware details; a reader new to the platform may need to chase references. Minor point: the waveform definitions are given but the CP-FSK frequency selection is described as 'chosen at random' without a seed or reproducibility guarantee—this could matter if someone wants to exactly replicate the dataset.\n\nOverall: this is a solid data paper for the radar ES subfield. It does not overclaim, it ships the goods, and it will be useful as a benchmark. I would send it to peer review without hesitation.\n\nBest,\n[Your name]","headline":"RadarML is a solid, well-documented dataset that fills a real gap in radar ES. The paper is a data descriptor, not a scientific claim, and it does what it sets out to do. No load-bearing flaws, but the scope is narrow and the generalizability to operational environments is limited.","tokens_in":7296,"tokens_out":491,"duration_ms":117490},"pith_extraction":null,"created_at":"2026-11-13T12:45:16.671330+00:00","model_set":{"reader":"deepseek/deepseek-v4-flash"},"pipeline_version":"pith-pipeline@v1.4.1-daily-deepseek-or-medium","input_kind":null,"input_chars":null,"input_total_chars":null,"passes_missing":null,"published_standing":null,"published_confidence":null,"objection_audit":null,"run_record":null,"basis":{"kind":"not_recorded","source":null,"chars_given":null,"chars_total":null},"receipt":null,"falsifier":null,"supporting_citations":[],"lane_accuracy":{"status":"not yet measured","lane":{"model":"deepseek/deepseek-v4-flash","input_kind":null},"url":"https://pith.science/accuracy"},"review_version":1}