REVIEW 5 major objections 4 minor 23 references
GFlowNets for Active Learning Based Resource Allocation in Next Generation Wireless Networks
T0 review · 5 major / 4 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read An active learning loop pairing a GFlowNet sampler with a Gaussian-process surrogate allocates radio resources with 20% higher utility in less than half the acquisition rounds of PPO or MCMC.
desk verdict A plausible new application of GFlowNet active learning to ISCC resource allocation, but the headline gains are not verifiable as written because the generator's stated constraints do not enforce the system model's one-block-per-device rule. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is the combination of a Gaussian-process surrogate with a GFlowNet generator inside a sequential active learning loop. A GFlowNet is a generative model over compositional objects: it builds an M×W allocation matrix one entry at a time from an all-zero start, with each action setting X_{m,w}=d, and it is trained with the trajectory balance loss so that terminal objects are sampled with probability proportional to the reward—here the GP's predicted utility. The GP uses a Matérn kernel applied to neural-network embeddings of the matrices, keeping the surrogate tractable. The paper argues that proportional-to-reward sampling yields better mode coverage than PPO's expected-return maximization and faster mixing than MCMC, which is what allows fewer acquisition rounds.
What would settle it
Sample a few thousand terminal matrices from the trained GFlowNet and check the system model's per-device constraint: if the same device appears in multiple resource blocks while some other device appears in none, the claimed feasibility guarantee fails and the reported utilities are computed over invalid allocations. A simpler version: re-run the active loop with an explicit one-block-per-device constraint; if the 20% gain disappears, the original advantage depended on those invalid configurations.
Extended reading notes
Core claim
The paper's central claim is that a generative flow network trained with the trajectory balance objective can serve as the sampler in an active learning loop for combinatorial radio resource allocation, outperforming both a deep RL policy (PPO) and a classical MCMC sampler. The utility optimized is the sum over devices of weighted products of communication bitrate, sensing mutual information, and inverse computing latency, which couples MEC-server selection and subcarrier assignment. In simulations with 20 devices, the GFlowNet agent reaches its best solution in roughly five acquisition rounds—about half the ten rounds PPO needs—with a solution about 8% higher, while MCMC takes about twenty rounds for a solution 4% above PPO. Scaled over device counts up to 40, the GFlowNet consistently outperforms both baselines by about 20% after ten rounds. The authors directly attribute the gain to GFlowNet's training objective, which makes the probability of sampling an allocation proportional to its surrogate reward and therefore keeps exploring diverse high-return modes.
Load-bearing premise
The central claim assumes the GFlowNet's stated constraints—never reusing a resource block and editing exactly as many entries as there are devices—guarantee feasible allocations, but those rules still allow one device to take several blocks while another device gets none, and the paper does not say whether device-uniqueness is enforced.
Editorial extensions
If this is right
- If the reported gains are correct, a GFlowNet-based scheduler can configure a multi-functional wireless network at the start of each slot with less than half the system evaluations required by PPO or MCMC.
- Because the trajectory balance objective makes sampling proportional to the surrogate reward, the active loop keeps proposing diverse high-utility allocations rather than collapsing onto one optimum, which is the failure mode the paper attributes to PPO.
- Applied to other combinatorial radio resource problems with expensive objectives—beamforming pattern selection, user association, subcarrier assignment—the same GFlowNet-plus-GP loop would need only a redefinition of the DAG's actions.
- The reduction in acquisition rounds translates directly into shorter scheduling delay in the time-slotted scenario the paper assumes, since the allocation is fixed for the duration of the slot.
Reading between the lines
- A clean control that keeps the GP surrogate but replaces the GFlowNet with random sampling would isolate whether the reported gains come from the sampler's proportional-to-reward coverage or simply from the GP learning; the paper does not report such an ablation.
- Since the generator's stated constraints do not explicitly stop one device from taking several resource blocks while a neighbor gets none, the natural robustness check is to add a one-block-per-device constraint and re-measure the 20% gain; the paper leaves that check unstated.
- The conclusion names multi-fidelity active learning as future work; a concrete version would let the sampler choose the evaluation fidelity, spending cheap surrogate evaluations early and expensive oracle evaluations only around promising modes.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes an active-learning framework for radio resource allocation in an integrated sensing, communication, and computing network. A Gaussian process surrogate is iteratively updated with utility evaluations, and a GFlowNet is trained against this surrogate to propose diverse high-return resource allocation matrices. The authors report that the method achieves about 20% utility gains over PPO and MCMC baselines in a scalability experiment, and reaches the baseline performance in about half the acquisition rounds in a convergence experiment. The central novelty is the use of a GFlowNet as a discrete compositional sampler inside an active-learning loop.
Significance. If the reported results hold, the paper makes a useful contribution by showing that GFlowNet-based generative active learning can be a viable heuristic for high-dimensional discrete resource allocation, where classical RL and MCMC suffer from mode collapse or slow mixing. The evaluation is not circular: the GFlowNet is trained on the GP surrogate while the reported utilities are computed from the true system model, so the numbers are not an artifact of the surrogate. The main strengths are the clear problem formulation, the use of trajectory balance with a stated convergence guarantee, and a sensible comparison setup. However, the current manuscript leaves the central empirical claims unverifiable because of an incorrect feasibility argument, an ill-defined sensing SINR expression, and missing experimental details such as seeds, error bars, and hyperparameter values.
major comments (5)
- [Section IV, Generator Model] The feasibility guarantee stated in Section IV does not follow from the constraints described. The text says that previously selected resource blocks cannot be re-used and that the number of modified entries equals U, then concludes that terminal objects are feasible allocation matrices. Section III defines feasibility as each device being allocated to one MEC server over one resource block. The two stated constraints only ensure that U distinct entries are non-zero; they do not prevent the same device from occupying several blocks while another device receives none. Such a matrix violates the system model, and the computing latency in (11) is undefined for an omitted device because the numerator has no allocated block. The fix is to add an explicit constraint in the action mask forbidding a device that has already been assigned, and to state that constraint in the text. If the implementation silently enforces this, the description is incomplete; if it does not, the reported utilities may be computed over infeasible allocations.
- [Abstract and Section V, Figs. 3a and 3b] The abstract combines two separate gains into one claim. Figure 3a shows that GFlowNet reaches a solution about 8% better than PPO in half the acquisition rounds (5 versus 10), while Figure 3b shows roughly 20% improvement after 10 rounds when the number of devices is varied. As written, the abstract's statement '20% performance gains against benchmarks, while requiring less than half of the number of acquisition rounds' implies the 20% gain is achieved at the half-round point, which is not supported by the displayed curves. Please report these two results separately, or show a joint trade-off curve so that the claim matches the evidence.
- [Section V, Eq. (10)] The sensing SINR in Eq. (10) is not well defined. The numerator sums over the MEC index m, but the denominator contains the term m' ≠ m with m appearing as a free variable outside the numerator's summation convention. As typeset, the expression has no unambiguous meaning. Moreover, if the generator can produce a matrix in which device d occupies multiple blocks, the numerator would sum over multiple terms, which is inconsistent with the one-block-per-device rule of Section III. Please rewrite Eq. (10) with a fixed MEC index or a clear convention, and ensure it is consistent with the feasibility constraints.
- [Section V, Simulation Results] No random seeds, number of independent runs, or error bars are reported for any figure. GFlowNet, PPO, and MCMC are all stochastic algorithms, and the text makes strong statements such as 'consistently outperforming benchmarks by around 20%' based on what appears to be a single run. Please add the number of seeds, report mean and standard deviation (or confidence intervals), and describe the variance across runs. This is necessary to verify the robustness of the central claim.
- [Section V, Simulation Setup] Several parameters that are essential for reproducibility are missing: the utility weights ω_d^ρ, ω_d^ζ, and ω_d^ξ in Eq. (12) are not specified; the GP kernel hyperparameters ν and l, and the architecture and training details of the deep kernel network, are not reported; and the number of GFlowNet training steps per active-learning round and the backward policy parameterization are not given. Without these details, the reported gains could depend on unstated tuning choices. Please provide the full experimental configuration.
minor comments (4)
- [Section II-A] In the definition of terminal states, the phrase 'states with no outgoing edges are terminal states are terminal states' contains a duplicated fragment. Please revise.
- [Section III] The feasibility rule 'each device can be allocated to communicate with one MEC server over one resource block; conversely, each subcarrier can be retained for one device only' is stated informally. It would be clearer to define the set X of feasible allocations explicitly, including whether a device must receive exactly one block or at most one block.
- [Section III-D] The claim that problem (13) is 'a variant of the knapsack problem which belongs to the class of NP-complete problems' is stated without a reduction or reference. A brief justification or citation would be appropriate.
- [Section V, Fig. 4] The claim that the GFlowNet solution is 'much better' than the baselines is not quantified. Please add numerical values or a table, since the 3D scatter plot alone does not show the utility differences clearly.
Circularity Check
No circularity: GFlowNet proposals are evaluated on the true utility, not on the surrogate they were trained against.
full rationale
The paper's central claim is an optimization result: a GFlowNet trained against a GP surrogate in an active-learning loop proposes resource allocations whose utilities are then evaluated by the true environment oracle f in (13). The reported gains are therefore not measured against the same function used to train or reward the sampler. The GP surrogate h is fitted to evaluations of f, and the GFlowNet is trained to sample proportionally to h, but the final utilities in Figs. 3 and 4 are computed from the system model f via (5)-(12), not from h, so no fitted parameter is renamed as a prediction. The GFlowNet references [14], [17], and [18] are external foundations used as tools; the only author self-citation ([2], supporting the broad statement that classical resource optimization involves zero-sum trade-offs) is motivational and does not carry the derivation. The feasibility gap noted in Section IV (the stated constraints do not by themselves prevent a device from being assigned to several blocks while another receives none) is a correctness or implementation-verifiability risk, but it is not circularity: it does not make the reported utility equal to the method's input by construction. No circular step meets the evidentiary bar of the review.
Assumptions & free parameters
free parameters (3)
- Utility weights omega_d^rho, omega_d^zeta, omega_d^xi =
unspecified
- GP kernel hyperparameters nu and l (deep kernel) =
optimized internally
- GFlowNet training steps per round and backward policy details =
not stated
assumptions (6)
- standard math Trajectory balance objective converges so that sampled objects are proportional to reward (Proposition 1 of [18]).
- standard math GP posterior inference equations (3)-(4) provide a valid surrogate of the unknown utility.
- domain assumption The resource allocation problem (13) is NP-complete as a variant of the knapsack problem.
- domain assumption Channels are static during each scheduling slot and independent across slots.
- domain assumption Sensing performance is characterized by conditional mutual information between target impulse response and received signal.
- domain assumption MEC server capacity is uniformly split among served devices.
Cite this review
Pith. "Pith review of GFlowNets for Active Learning Based Resource Allocation in Next Generation Wireless Networks." pith.science (2026). https://pith.science/paper/4E5NMD3O
@misc{pith2026250505224,
author = {Pith},
title = {Pith review of: GFlowNets for Active Learning Based Resource Allocation in Next Generation Wireless Networks},
year = {2026},
howpublished = {\url{https://pith.science/paper/4E5NMD3O}},
note = {Machine review of arXiv:2505.05224}
}
read the original abstract
In this work, we consider the radio resource allocation problem in a wireless system with various integrated functionalities, such as communication, sensing and computing. We design suitable resource management techniques that can simultaneously cater to those heterogeneous requirements, and scale appropriately with the high-dimensional and discrete nature of the problem. We propose a novel active learning framework where resource allocation patterns are drawn sequentially, evaluated in the environment, and then used to iteratively update a surrogate model of the environment. Our method leverages a generative flow network (GFlowNet) to sample favorable solutions, as such models are trained to generate compositional objects proportionally to their training reward, hence providing an appropriate coverage of its modes. As such, GFlowNet generates diverse and high return resource management designs that update the surrogate model and swiftly discover suitable solutions. We provide simulation results showing that our method can allocate radio resources achieving 20% performance gains against benchmarks, while requiring less than half of the number of acquisition rounds.
Figures
Reference graph
Works this paper leans on
-
[1]
Twelve scientific challenges for 6g: Rethink- ing the foundations of communications theory,
M. Chafii, L. Bariah et al., “Twelve scientific challenges for 6g: Rethink- ing the foundations of communications theory,” IEEE Communications Surveys & Tutorials, vol. 25, no. 2, pp. 868–904, 2023
work page 2023
-
[2]
Ultrareliable and low-latency wireless communication: Tail, risk, and scale,
M. Bennis, M. Debbah, and H. V . Poor, “Ultrareliable and low-latency wireless communication: Tail, risk, and scale,” Proceedings of the IEEE, vol. 106, no. 10, pp. 1834–1853, 2018
2018
-
[3]
A survey on integrated sensing, communication, and computation,
D. Wen, Y . Zhou et al., “A survey on integrated sensing, communication, and computation,” IEEE Communications Surveys & Tutorials , 2024
work page 2024
-
[4]
Radio resource allocation for integrated sensing, communication, and computation networks,
L. Zhao, D. Wu et al., “Radio resource allocation for integrated sensing, communication, and computation networks,” IEEE Transactions on Wireless Communications, vol. 21, no. 10, pp. 8675–8687, 2022
work page 2022
-
[5]
Integrated sensing, computation, and com- munication: System framework and performance optimization,
Y . He, G. Yu et al. , “Integrated sensing, computation, and com- munication: System framework and performance optimization,” IEEE Transactions on Wireless Communications , vol. 23, no. 2, pp. 1114– 1128, 2023
work page 2023
-
[6]
Integrated sensing, communication, and compu- tation over-the-air: Mimo beamforming design,
X. Li, F. Liu et al. , “Integrated sensing, communication, and compu- tation over-the-air: Mimo beamforming design,” IEEE Transactions on Wireless Communications, vol. 22, no. 8, pp. 5383–5398, 2023
work page 2023
-
[7]
Integrated sensing-communication- computation for over-the-air edge ai inference,
Z. Zhuang, D. Wen et al. , “Integrated sensing-communication- computation for over-the-air edge ai inference,” IEEE Transactions on Wireless Communications, vol. 23, no. 4, pp. 3205–3220, 2023
work page 2023
-
[8]
D. Wang, C. Huang et al., “Mean field game-based waveform precoding design for mobile crowd integrated sensing, communication, and compu- tation systems,” IEEE Transactions on Wireless Communications, 2024
work page 2024
Show all 23 references
-
[9]
Joint sensing, communication, and computation resource allocation for cooperative perception in fog-based vehicular networks,
X. Zhang, Z. He et al., “Joint sensing, communication, and computation resource allocation for cooperative perception in fog-based vehicular networks,” in 2021 13th International Conference on Wireless Commu- nications and Signal Processing (WCSP) . IEEE, 2021, pp. 1–6
2021
-
[10]
Deep reinforcement learning-based resource allocation for integrated sensing, communication, and computation in vehicular network,
L. Yang, Y . Wei et al. , “Deep reinforcement learning-based resource allocation for integrated sensing, communication, and computation in vehicular network,” IEEE Transactions on Wireless Communications , 2024
2024
-
[11]
Gdsg: Graph diffusion-based solution gen- eration for optimization problems in mec networks,
R. Liang, B. Yang et al. , “Gdsg: Graph diffusion-based solution gen- eration for optimization problems in mec networks,” arXiv preprint arXiv:2412.08296, 2024
2024 arXiv
-
[12]
Active learning: A survey,
C. C. Aggarwal, X. Kong et al. , “Active learning: A survey,” in Data classification. Chapman and Hall/CRC, 2014, pp. 599–634
2014
-
[13]
Bayesian optimization for radio resource management: Open loop power control,
L. Maggi, A. Valcarce, and J. Hoydis, “Bayesian optimization for radio resource management: Open loop power control,” IEEE Journal on Selected Areas in Communications, vol. 39, no. 7, pp. 1858–1871, 2021
2021
-
[14]
Flow network based generative models for non-iterative diverse candidate generation,
E. Bengio, M. Jain et al. , “Flow network based generative models for non-iterative diverse candidate generation,” Advances in Neural Information Processing Systems , vol. 34, pp. 27 381–27 394, 2021
2021
-
[15]
Biological sequence design with gflownets,
M. Jain, E. Bengio et al., “Biological sequence design with gflownets,” in International Conference on Machine Learning . PMLR, 2022, pp. 9786–9801
2022
-
[16]
Multi-fidelity active learning with gflownets,
A. Hernández-García, N. Saxena et al. , “Multi-fidelity active learning with gflownets,” Transactions on Machine Learning Research , 2024
2024
-
[17]
Gflownet foundations,
Y . Bengio, S. Lahlou et al., “Gflownet foundations,” Journal of Machine Learning Research, vol. 24, no. 210, pp. 1–55, 2023
2023
-
[18]
Trajectory balance: Improved credit assign- ment in gflownets,
N. Malkin, M. Jain et al., “Trajectory balance: Improved credit assign- ment in gflownets,” Advances in Neural Information Processing Systems, vol. 35, pp. 5955–5967, 2022
2022
-
[19]
From theories to queries: Active learning in practice,
B. Settles, “From theories to queries: Active learning in practice,” in Active learning and experimental design workshop in conjunction with AISTATS 2010. JMLR Workshop and Conference Proceedings, 2011, pp. 1–18
2010
-
[20]
C. E. Rasmussen and C. K. I. Williams, Gaussian Processes for Machine Learning. The MIT Press, 11 2005
2005
-
[21]
Adaptive ofdm integrated radar and com- munications waveform design based on information theory,
Y . Liu, G. Liao et al. , “Adaptive ofdm integrated radar and com- munications waveform design based on information theory,” IEEE Communications Letters, vol. 21, no. 10, pp. 2174–2177, 2017
2017
-
[22]
Stochastic variational deep kernel learning,
A. G. Wilson, Z. Hu et al., “Stochastic variational deep kernel learning,” Advances in neural information processing systems , vol. 29, 2016
2016
-
[23]
Proximal policy optimization algorithms,
J. Schulman, F. Wolski et al., “Proximal policy optimization algorithms,” arXiv preprint arXiv:1707.06347 , 2017
2017 arXiv
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.