{"id":"20674b54-d94c-4528-86fd-b23daf85c910","arxiv_id":"2508.04004","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":6.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":1,"one_line_summary":"SioLENA builds full spatial channel matrices inside ns-3 from ray-tracing traces, giving 5G-LENA site-specific propagation while keeping its beamforming and scheduling code untouched.","lead":"This paper introduces SioLENA, a module that lets the ns-3 cellular simulator use ray-traced or measured radio paths instead of statistical channel models, including each path's direction. This enables site-specific 5G simulations of corner diffraction and building blockage, moving toward digital twins of real cellular networks.","discovery_kind":"extension","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The module's MPC-to-channel-matrix conversion in Sec. III-B is asserted but never directly validated; if it mis-handles per-subcarrier delay/phase, all claimed site-specific inflections could be artifacts.","rationale":"I read the paper as a software contribution whose value is a faithful bridge between MPC traces and 5G-LENA. The strongest claim is not that Sionna is accurate but that the module preserves the geometric content of whatever trace it ingests. The paper gives no direct evidence of this: no equations, no comparison against Sionna's own channel response, and no unit test of the matrix construction. The beamforming validation is necessary but not sufficient; it checks one projection of the channel (the dominant steering direction) and is robust to a broad class of implementation errors. The end-to-end comparison uses a single 3GPP realization, so it cannot discriminate between true site-specific sensitivity and artifacts. A minimal analytic check would settle this cheaply. If the check passes, the module is very likely sound and the main remaining limitation is the reader's ray-tracer-accuracy concern; if it fails, the central claim is unsubstantiated. Since the paper is already CONDITIONAL in the reader's verdict, I retain that verdict rather than moving to ACCEPT or REJECT.","tokens_in":9819,"tokens_out":8155,"duration_ms":103363,"concrete_test":"Use a synthetic scene with known geometry: one gNB and one UE with a LoS path plus one specular reflection, carrier 28 GHz, 100 MHz. Compute the analytic per-subcarrier, per-antenna channel H_a(f_k) from the MPC parameters. Run the same MPCs through the SioLENA CSV pipeline and read back the matrices produced by TracesChannelModel/TracesSpectrumPropagationLossModel. Also call Sionna RT's native channel response for the identical scene as a second reference. If the complex channel matrices do not match the analytic or Sionna reference to numerical precision (e.g., normalized RMSE < 1e-6), or if beamforming/SINR outputs diverge, the central conversion is not faithful and the paper's claims need revision.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central claim is that SioLENA faithfully converts MPC traces (delay, complex gain, AoD/AoA) into frequency-domain channel matrices for 5G-LENA's unmodified PHY/MAC stack. This conversion is the load-bearing link: even with perfect ray-traced or measured MPCs, a construction error would invalidate every site-specific result. Section III-B describes the conversion only qualitatively ('appropriate phase shifts ... according to element positions and carrier wavelength') and gives no closed-form definition of H(f) per subcarrier, no treatment of the per-path delay phase 2πfτ across the OFDM band, and no statement about how the exported complex gains from Sionna map onto antenna-pattern-free path coefficients. The validation in Fig. 2 only verifies that ideal beamforming recovers the LoS azimuth; that test is insensitive to errors in absolute phase, per-subcarrier phase slope, and Doppler, so it cannot certify the channel matrix. Section IV-B then feeds these unvalidated matrices into end-to-end metrics; the claimed inflections are exactly the kind of effect a subtle sign or scaling error in the array manifold or delay phase would manufacture. The ray-tracer-realism concern raised by the reader is real but secondary: it concerns the input quality, whereas this concern concerns the integrity of the simulator's internal representation.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper presents SioLENA, an ns-3 extension to 5G-LENA that replaces the stochastic 3GPP TR 38.901 channel model with a trace-driven channel model. The module takes multipath component (MPC) traces—delay, complex gain, AoD/AoA, and Doppler—from external ray tracers such as Sionna RT or from measurement campaigns, constructs frequency-domain channel matrices, and feeds them into the existing 5G-LENA PHY/MAC stack without modifying that stack. The authors claim this preserves full compatibility with 5G-LENA while adding site-specific geometric fidelity. The evaluation has two parts: a beamforming validation in a Place de l'Étoile LoS scenario, where ideal beamforming recovers the UE azimuth with sub-degree RMSE, and an end-to-end comparison in a Boston street-canyon scenario, where trace-based SINR, MCS, throughput, and delay are compared against one realization of the TR 38.901 UMi model. The trace-based model exhibits sharp inflections (NLoS-to-LoS transitions, blockage, corner diffraction) that the statistical model does not show.","tokens_in":10140,"tokens_out":5161,"duration_ms":65571,"significance":"If the channel-matrix construction is correct, SioLENA is a valuable open-source contribution: it provides a path to site-specific, full-stack ns-3 simulations for beam-management, blockage, and digital-twin studies while reusing the mature 5G-LENA MAC/PHY pipeline. The explicit release of the module and trace-generation pipeline, and the architectural choice to keep the existing scheduler and beamforming stack untouched, are practical strengths. However, the current validation is largely an internal-consistency check against the ray tracer's own geometry, and the end-to-end comparison uses a single stochastic realization. The central claim that the trace-driven engine exposes inflections that the statistical model does not exhibit is therefore plausible but not yet established with the statistical rigor required for a definitive comparison.","major_comments":[{"comment":"The core transformation from MPC traces to per-subcarrier channel matrices is described only qualitatively (\"appropriate phase shifts ... according to element positions and carrier wavelength\"). No explicit equation is given for H(f) or the per-subcarrier channel coefficient; the delay phase exp(-j2π f τ) across the OFDM band, the mapping of Sionna's exported complex gain to a path coefficient, and the normalization of the array response are not specified. Every end-to-end result in Section IV flows through this matrix, so a sign or scaling error in the phase/array manifold would manufacture exactly the reported inflections. The beamforming test in Fig. 2 is insensitive to absolute phase and delay-phase slope because it only recovers the LoS azimuth. Please add the closed-form channel-matrix equation, define all symbols, and add a small two-path frequency-selective validation against a k","section":"Section III-B"},{"comment":"The end-to-end comparison with TR 38.901 uses a single realization of the stochastic model. A statistical channel model produces different LoS/NLoS draws and small-scale fading in every realization; one draw cannot support the claims that the statistical model \"erroneously reports LoS\" (Fig. 4a) or that it \"smooths\" fluctuations. Run multiple seeds/realizations for the 3GPP model, report the range or confidence intervals of SINR/MCS/throughput, and show that the trace-based inflections lie outside that variability. Without this, the paper's strongest claim—that the trace-driven engine exposes performance inflections that the statistical model does not exhibit—is not statistically supported.","section":"Section IV-B"},{"comment":"The beamforming validation is a self-consistency check: idealBeamforming selects the steering vector that maximizes received power in a channel matrix built from the same MPC traces that contain the AoD being recovered. The sub-degree RMSE therefore certifies internal consistency of the trace import and the array response, not that the traced AoDs match a real-world channel. The text should present this as an integration test, not as \"precise beam-steering validation\" in the abstract. A complementing test using an independently generated angle reference (e.g., a measured or analytically specified trace) would make the validation meaningful.","section":"Section IV-A"},{"comment":"The site-specific fidelity claim rests entirely on the assumption that Sionna RT, with the Boston Twin mesh and the configured propagation physics, accurately represents a real propagation channel. No comparison with field measurements is provided, so ray-tracer or mesh errors propagate directly into the reported results. The paper should explicitly state this limitation; ideally, at least one comparison with a measured channel dataset or public channel-sounding measurement in a similar environment would be included. This is a correctness-risk concern, not a rejection of the approach.","section":"Section III-C and Section IV"}],"minor_comments":[{"comment":"Legend typo: \"Los: 3GPP only\" should be \"LoS: 3GPP only.\"","section":"Fig. 4a"},{"comment":"Minor formatting issues: \"10 000 packets/s\" and \"100 msusing\" lack proper spacing; please clean up the text.","section":"Section IV-B"},{"comment":"The CSV schema expected by TracesChannelModel is never shown. A small table listing columns, units, and an example row would make the interface reproducible and tool-agnostic.","section":"Section III-B"},{"comment":"The dashed line is described as \"true UE azimuth\" but it is presumably the geometric azimuth computed from positions, not the AoD of the LoS MPC. Define it precisely in the caption or text.","section":"Figure 2"},{"comment":"Reference [1] is incomplete: \"p. 101933\" lacks the journal/proceedings name and volume. Please correct.","section":"References"}],"recommendation":"major_revision","confidential_remarks":"The paper is a solid systems contribution with useful open-source artifacts, but the absence of an explicit channel-matrix formulation and the single-realization statistical comparison are load-bearing weaknesses that need to be addressed before publication. The manuscript seems well suited to a networking-systems venue where tool evaluation by architecture and internal consistency is accepted, but it should not overstate validation against the ray tracer as ground truth. I recommend major revision with focused requests for equations, multiple statistical realizations, and an explicit limitation statement."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"First, the headline: this is a useful, clearly-written software contribution. SioLENA extends 5G-LENA so it can consume ray-tracing MPCs with full AoA/AoD and build spatial channel matrices inside ns-3, instead of reducing the channel to a scalar gain as prior integrations do. That is the right advancement for anyone wanting site-specific beamforming, blockage, or sensing studies in ns-3.\n\nThe architecture is clean: two new classes replace the stochastic TR 38.901 channel model and the spectrum propagation loss, leaving the PHY/MAC/beamforming stack untouched. The code is open source, and the two validation scenarios are sensible. The beamforming test is worth emphasizing: an RMSE of 0.74 degrees on steering azimuth is a concrete check that the array-manifold phases are correctly encoded, and it correctly suggests the module is not hiding a sign error in the angular dimension.\n\nThe soft spots are in the validation depth, not the architecture. Section III-B describes the MPC-to-channel-matrix conversion qualitatively; there is no closed-form H(f) and no explicit treatment of the per-subcarrier delay phase or Doppler. The beamforming test only exercises the spatial component, so the frequency-selective behavior that drives SINR, MCS, and throughput is effectively unvalidated. That is the load-bearing link, so I would want a sanity check against a known analytical channel before trusting the end-to-end numbers. Also, the TR 38.901 comparison is a single realization with no error bars, and calling the statistical model's LoS reports 'erroneous' is overstatement—it is simply not site-specific. A few Monte-Carlo runs would help.\n\nFinally, the ray-tracer fidelity is not compared to field measurements; the paper validates against Sionna's own geometry. That is acceptable for a simulator integration paper, but it means the end-to-end inflections are Sionna+ns-3 behavior, not measured reality. The claims should be toned to match.\n\nThis is a solid paper for a software track. It deserves serious review; the revision should add equations, a frequency-selectivity check, and a multi-realization baseline. I'd cite it and bring it to the group if anyone is doing ns-3 beam management or ray-tracing work.","headline":"A genuinely useful trace-driven channel module for ns-3 that preserves AoA/AoD and runs the standard LENA stack, with validation gaps around the frequency-domain construction and the statistical baseline.","tokens_in":10647,"tokens_out":3977,"would_cite":true,"duration_ms":46087,"reading_group":"yes","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"A new ns-3 module, SioLENA, feeds ray-traced multipath components into 5G-LENA's unchanged PHY/MAC/beamforming stack, giving site-specific beam steering and end-to-end performance that the standard 3GPP statistical model smooths away.","keywords":["ray tracing","ns-3","5G-LENA","site-specific channel model","beam management","digital twin","multipath components","millimeter wave"],"falsifier":"Run a channel-sounding measurement campaign in the same Boston street-canyon geometry, with the same routes and array configurations; if the measured SINR, MCS, and selected-beam trajectories do not show corner-diffraction and blockage inflections at the same locations, or if the measured beam-steering error exceeds the reported roughly 0.7° and 0.5° RMSE in LoS regions, the central fidelity claim is falsified. A quicker sensitivity check: regenerate the traces with no diffraction and with more than four reflections and observe whether the end-to-end inflections survive.","tokens_in":9740,"feed_emoji":"📡","tokens_out":12883,"duration_ms":135090,"temperature":0.7,"pith_summary":"Standard system-level cellular simulation uses statistical 3GPP channel models that reproduce average behavior but blur the geometry of a real site. This paper claims that deterministic multipath-component traces — from a ray tracer or from measurements — can be turned into frequency-domain channel matrices inside ns-3 and fed to the existing 5G-LENA PHY/MAC/scheduler/beamforming pipeline unchanged, giving the simulation true site-specific fidelity. In the reported scenarios, the trace-driven channel recovers the true line-of-sight steering direction with sub-degree mean error, and end-to-end SINR/MCS/throughput show sharp inflections at corners, blockage, and diffraction that the 3GPP statistical model largely smooths out. The module is compatible with any trace source in the defined CSV format and with any ns-3 antenna or beam-management configuration, and is presented as a building block for digital-twin simulations.","feed_headline":"Ray-traced 5G channel model captures corner diffraction and blockage","feed_subtitle":"SioLENA feeds ray-tracer multipath into ns-3's 5G-LENA stack, producing site-specific SINR and beam-steering swings.","key_machinery":"Trace-based channel model: two classes, TracesChannelModel and TracesSpectrumPropagationLossModel, replace the 3GPP cluster-generation and spectrum-propagation blocks. They consume external MPC traces in CSV form, construct frequency-domain channel matrices from antenna-array response vectors, apply Doppler shifts per path from node velocities, and compute beamforming gains by multiplying the channel matrix with transmit and receive steering vectors. This keeps 5G-LENA's native PHY abstraction, scheduler, HARQ, link adaptation, and beam management running unmodified.","core_discovery":"The central claim is that the geometric information needed for directional 5G communication can survive intact into a system-level simulator without rewriting the radio stack. SioLENA parses time-indexed multipath records (delay, amplitude, phase, departure and arrival angles) and assembles the full frequency-domain channel matrix per link at runtime, using array response vectors with phase shifts from element positions; Doppler shifts are computed from node velocity projected onto each MPC direction, and beamforming gains from the channel matrix times steering vectors. The paper demonstrates that this preserves angular fidelity — ideal beamforming selects the true LoS azimuth with 0.74° and","pith_inferences":["The paper stops short of validating the ray tracer's own accuracy; a natural next step is to compare SioLENA output against channel-sounding measurements on the same mesh. Until that comparison exists, the module's fidelity is bounded by the fidelity of the trace source.","Because full channel matrices and MPC angles are available inside ns-3, the same pipeline could support environment-aware sensing and positioning studies beyond communication metrics, which the paper lists as future work but does not demonstrate.","If trace-accurate angular labels are paired with beam-training logs, the simulator can generate ML training sets with geometrically consistent steering directions, an application the paper mentions but does not quantify.","The CSV time-indexed trace format also leaves room for dynamic updates mid-simulation, so moving blockers or changing mesh geometry could be imported during a run to study blockage prediction."],"forward_implications":["Beamforming and beam-training algorithms can be validated against a specific 3D environment: the trace-based channel recovers true LoS directions and shows the expected end-fire degradation of planar arrays, which a statistical channel cannot generate.","End-to-end performance becomes geometry-aware: corner diffraction, street-canyon blockage, and LoS transitions translate directly into MCS, throughput, and delay inflections (for example, a roughly 20 dB SINR drop and MCS collapse during blockage) rather than being averaged out.","The approach is trace-source agnostic and frequency-agnostic, so any ray tracer or measurement campaign exporting MPCs in the CSV schema can drive the same ns-3 pipeline in FR1, FR2, or FR3.","Statistical and trace-based models are complementary within one simulator: 3GPP models remain available for Monte-Carlo sweeps and large layouts, while the trace engine pinpoints worst-case corners, indoor-outdoor transitions, and moving blockers.","Because full channel matrices are exposed at runtime, hybrid or learning-based beam selection and the generation of ML training data for channel estimation become feasible without re-running the ray tracer."],"supporting_citations":[{"why":"The 5G-LENA NR simulator module that the extension plugs into, providing the PHY/MAC/scheduler/beamforming stack that remains unmodified.","marker":"[1]"},{"why":"3GPP TR 38.901, the statistical channel model used as the baseline and comparison target throughout the evaluation.","marker":"[2]"},{"why":"The ns-3 implementation of the TR 38.901 spatial channel model, whose cluster-generation and spectrum-propagation classes SioLENA replaces.","marker":"[3]"},{"why":"Sionna RT, the ray tracer used to generate the multipath traces for both case studies.","marker":"[4]"},{"why":"Prior full-stack ray-tracing integration for mmWave ns-3 simulation, grounding the geometry-based channel approach.","marker":"[6]"},{"why":"The first trace-based quasi-deterministic channel integration in ns-3, the precedent that SioLENA extends to 5G-LENA.","marker":"[7]"},{"why":"An alternative Sionna-to-ns-3 bridge that reduces the channel to a scalar gain, the contrast motivating SioLENA's full channel-matrix design.","marker":"[9]"},{"why":"Another Sionna/ns-3 interface lacking native 5G-LENA beam-management compatibility, motivating the new architecture.","marker":"[10]"},{"why":"Boston Twin, the street-canyon digital-twin mesh used as the environment for the end-to-end validation.","marker":"[11]"}],"fun_headline_variants":["Ray-traced channels in ns-3 capture site-specific 5G effects","SioLENA brings ray-traced multipath to ns-3 5G-LENA","Site-specific 5G simulation via ray-tracing in ns-3","Ray-tracing drives ns-3 5G beam steering fidelity","ns-3 5G-LENA gets ray-traced channel matrices"],"cache_read_input_tokens":2816,"weakest_assumption_plain":"The load-bearing premise is that the multipath traces — here generated by a ray tracer limited to diffraction plus at most four specular reflections, or by measurements — accurately represent the real propagation channel, including its angles and phases; the paper validates the simulator against the ray tracer's own geometry, not against field measurements.","fun_headline_variants_meta":{"raw":{"variants":["Ray-traced channels in ns-3 capture site-specific 5G effects","SioLENA brings ray-traced multipath to ns-3 5G-LENA","Site-specific 5G simulation via ray-tracing in ns-3","Ray-tracing drives ns-3 5G beam steering fidelity","ns-3 5G-LENA gets ray-traced channel matrices"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000438,"raw_usage":{"total_tokens":2116,"prompt_tokens":854,"completion_tokens":1262,"prompt_tokens_details":{"cached_tokens":256},"prompt_cache_hit_tokens":256,"prompt_cache_miss_tokens":598,"completion_tokens_details":{"reasoning_tokens":1161}},"tokens_in":598,"tokens_out":1262,"duration_ms":10186,"temperature":1.0,"reasoning_tokens":1161,"cache_read_input_tokens":256,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-06T00:57:32.907821+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Run a channel-sounding measurement campaign in the same Boston street-canyon geometry, with the same routes and array configurations; if the measured SINR, MCS, and selected-beam trajectories do not show corner-diffraction and blockage inflections at the same locations, or if the measured beam-steering error exceeds the reported roughly 0.7° and 0.5° RMSE in LoS regions, the central fidelity claim is falsified. A quicker sensitivity check: regenerate the traces with no diffraction and with more than four reflections and observe whether the end-to-end inflections survive.","supporting_citations":[{"cited_title":"An E2E simulator for 5G NR networks,","cited_arxiv_id":null,"evidence_quote":"The 5G-LENA NR simulator module that the extension plugs into, providing the PHY/MAC/scheduler/beamforming stack that remains unmodified."},{"cited_title":"Study on channel model for frequencies from 0.5 to 100 GHz,","cited_arxiv_id":null,"evidence_quote":"3GPP TR 38.901, the statistical channel model used as the baseline and comparison target throughout the evaluation."},{"cited_title":"Implementation of a Spatial Channel Model for ns-3,","cited_arxiv_id":null,"evidence_quote":"The ns-3 implementation of the TR 38.901 spatial channel model, whose cluster-generation and spectrum-propagation classes SioLENA replaces."},{"cited_title":"Sionna RT: Differentiable ray tracing for radio propagation modeling,","cited_arxiv_id":null,"evidence_quote":"Sionna RT, the ray tracer used to generate the multipath traces for both case studies."},{"cited_title":"Accuracy Versus Complexity for mmWave Ray-Tracing: A Full Stack Perspective,","cited_arxiv_id":null,"evidence_quote":"Prior full-stack ray-tracing integration for mmWave ns-3 simulation, grounding the geometry-based channel approach."},{"cited_title":"High Fi- delity Simulation of IEEE 802.11ad in ns-3 Using a Quasi-deterministic Channel Model,","cited_arxiv_id":null,"evidence_quote":"The first trace-based quasi-deterministic channel integration in ns-3, the precedent that SioLENA extends to 5G-LENA."},{"cited_title":"Boston Twin: the Boston Digital Twin for Ray-Tracing in 6G Networks,","cited_arxiv_id":null,"evidence_quote":"Boston Twin, the street-canyon digital-twin mesh used as the environment for the end-to-end validation."}],"review_version":1}