Pith. sign in

REVIEW 4 major objections 6 minor 1 cited by

Age of Information Optimization in Laser-charged UAV-assisted IoT Networks: A Multi-agent Deep Reinforcement Learning Method

T0 review · 4 major / 6 minor · reviewed 2026-08-06 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read This paper claims a MAPPO variant with LSTM temporal memory and a dual-attention value function reduces peak age-of-information by up to 15.1% in laser-charged multi-UAV IoT networks.

desk verdict Decent system model and a plausible RL formulation, but the headline 15.1% claim is not supported by the reported results and the reward function is underspecified. read the letter →

arxiv 2507.08429 v1 pith:NCKTTS4W submitted 2025-07-11 cs.NI

Geng Sun , Likun Zhang , Jiahui Li , Jing Wu , Jiacheng Wang , Zemin Sun , Changyuan Zhao , Victor C.M. Leung This is my paper
classification cs.NI
keywords ageofinformationlaserchargingUAVtrajectoryoptimizationmulti-agentdeepreinforcementlearningMAPPOLSTMtemporalmemoryIoTdatacollectionpeakAoI
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper claims that a multi-agent reinforcement learning algorithm, MAPPO-TM, can jointly optimize the flight trajectories and laser-charging decisions of multiple UAVs so as to minimize the peak age of information (AoI) in an IoT data-collection network. The system it models lets UAVs recharge wirelessly from laser beam directors while flying, avoiding returns to fixed charging stations. If the claim holds, MADRL methods can sustain information freshness in long-duration missions where energy is the bottleneck. The evidence is a set of simulations in which MAPPO-TM outperforms MAPPO, MATD3, and MADDPG on peak AoI and energy rewards, with up to a 15.1% reduction in peak AoI.

What carries the argument

The load-bearing mechanism is the MAPPO-TM policy architecture: an LSTM-enhanced actor network that maintains a hidden state $h_i^t = \mathrm{LSTM}(o_i^t, h_i^{t-1})$ to capture temporal dependencies, paired with a centralized critic that blends a local value network and a global value network through learnable weights $w_l$ and $w_g$. Together these convert a high-dimensional, non-convex joint control problem (UAV trajectories plus charging decisions) into a partially observable Markov decision process that can be trained with decentralized execution. The reward function in Eqs. (10)-(11), which penalizes both low-energy and full-energy states and rewards data collection, is what couples the learning objective to the AoI and energy goals, though its numerical components are not specified.

What would settle it

Train MAPPO-TM with the reward function replaced by the actual peak-AoI value from Eq. (5a) (or a direct measurable surrogate), and compare the resulting policies against the baselines; if the 15.1% peak-AoI reduction disappears, the reported gain is an artifact of reward shaping rather than genuine AoI minimization.

Watch

Extended reading notes

Core claim

On its own terms, the paper's central discovery is that adding two mechanisms to standard MAPPO unlocks better trade-offs between information freshness and energy use in laser-charged multi-UAV IoT networks. The first is temporal memory: LSTM-based actor networks let each UAV use historical trajectories and energy states rather than only the current observation. The second is multi-agent coordination: a dual-attention value function $V_i(s_t)=w_l V_i^{\text{local}}(o_i^t)+w_g V^{\text{global}}(s_t)$ lets each agent dynamically weight its individual objective against the global system objective. With these additions, the learned policies keep UAVs near charging areas when energy is low, collect IoT data efficiently, and reduce the network's peak AoI, according to the reported simulations.

Load-bearing premise

The paper assumes that the hand-designed reward function in Eqs. (10)-(11) faithfully encodes the true peak-AoI objective of Eq. (5a), but it never specifies the reward's numerical components and offers no evidence that maximizing that reward transfers to minimizing real peak AoI.

Editorial extensions

If this is right

  • If the algorithm works as claimed, any fleet of laser-charged UAVs can be scheduled with CTDE-trained policies that run in execution time $O(TN|\theta_a|)$ and space $O(N|\theta_a|)$, making real-time deployment plausible.
  • The LSTM temporal memory should yield more stable training and lower variance in both AoI and energy rewards than feed-forward MAPPO, as the paper reports in its training curves.
  • The dual-attention value function should make the system robust to UAV failures, since remaining agents can reweight global versus local objectives when the fleet changes.
  • The 15.1% peak-AoI reduction is the headline quantitative claim, and it appears to hold across a range of laser-to-electricity conversion efficiencies $\eta_{le}$.
  • The paper argues the formulated problem is NP-hard by reducing a simplified single-UAV case to the traveling salesman problem, implying that exact methods are intractable and learning-based approximations are justified.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the reward function in Eqs. (10)-(11) does not track the actual peak AoI, then the published numerical gain is a statement about reward optimization, not about information freshness; a direct test is to re-run the comparison with the true objective as reward.
  • The paper's NP-hardness argument reduces the problem to TSP by ignoring charging and collision constraints; a stronger reduction would show hardness persists with the full set of constraints.
  • The approach could be extended to time-varying IoT data generation, where LSTM memory might give an even larger advantage over feed-forward baselines, though the paper only tests static data volumes.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 6 minor

Summary. The paper studies an IoT data-collection network in which multiple UAVs are recharged by laser beam directors (LBDs) while collecting data from ground IoT devices. It formulates a joint optimization problem minimizing peak Age of Information (AoI) over UAV trajectories and charging decisions, argues NP-hardness via TSP, and reformulates the problem as a POMDP. The proposed algorithm, MAPPO-TM, extends MAPPO with LSTM-based actor networks and a weighted local-plus-global value function for multi-agent coordination. Simulation comparisons against MAPPO, MATD3, and MADDPG are reported for cumulative reward, AoI reward, energy reward, peak AoI, and UAV trajectories, with the abstract claiming up to 15.1% peak-AoI reduction.

Significance. If the claimed results are reproducible, the paper would provide a useful application of multi-agent reinforcement learning to laser-charged UAV-assisted IoT networks, combining a standard POMDP formulation with two sensible architectural extensions: temporal memory in actors and a local-global value decomposition. The system model and notation are clearly presented, the complexity comparison in Table III is informative, and the comparison against three common MADRL baselines is appropriate. However, the central empirical claim is currently supported only by self-reported simulation plots with undisclosed reward ingredients, no error bars or seed counts, and an abstract number that cannot be traced to any figure or table. The contribution is therefore plausible but not yet verified to the standard expected for a journal publication.

major comments (4)
  1. [Section IV-D, Eqs. (10)-(11)] The reward function is the only learning signal, but its components r_a(t) and r_s(t), the weights alpha, beta, gamma, the penalty constants r_pen1 and r_pen2, and the energy threshold E_phi are never specified numerically or even as functional forms. The text only says that r_a(t) is 'the reward associated with the AoI' and r_s(t) rewards successful collection. This is load-bearing because all reported gains are measured after optimizing this reward. The authors must define these terms completely and provide either a proof or a simulation-grounded argument that maximizing the additive reward in Eq. (11) is monotonically related to minimizing the max-type peak AoI objective in Eq. (5a). Without that bridge, a policy can earn higher cumulative reward while producing the same or worse actual peak AoI.
  2. [Section V-B, Fig. 4(a) and Abstract] The abstract claims 'up to 15.1% reduction in peak AoI compared to conventional MADRL methods,' but Fig. 4(a) is a bar chart without numerical values, and Section V-B2 reports only a 5-10% lower peak AoI for the eta_le sweep. No figure or table in the paper displays the 15.1% figure or identifies the specific configuration that produces it. The authors need to report the exact peak AoI values for all algorithms, the corresponding standard deviations, and the precise condition (e.g., number of IoTs, eta_le value, episode index) under which 15.1% is achieved.
  3. [Section V-A and V-B] All conclusions are drawn from the authors' own simulator without reporting the number of random seeds, error bars, or statistical significance. The shaded variance regions in Fig. 3 and the bar chart in Fig. 4(a) are described qualitatively, and the final peak AoI comparison in Section V-B2 is given only as a percentage range. Because DRL results are stochastic and the baselines are also sensitive to hyperparameters, the authors should provide per-seed results, mean and standard deviation over at least several seeds, and a statistical test (or at least non-overlapping confidence intervals) before claiming that MAPPO-TM outperforms the baselines.
  4. [Section III-F] The NP-hardness reduction is stated too loosely to be rigorous. The authors claim that a simplified single-UAV case 'reduces to finding the shortest path that visits each IoT exactly once, precisely the definition of TSP,' but the objective in Eq. (5a) is peak AoI, not tour length, and the simplified problem also omits how AoI evolves over time during the tour. A formal reduction should construct an instance of the peak-AoI problem whose optimal value encodes the TSP tour length, or the authors should weaken the claim to a statement that the problem 'contains TSP as a special case' with a clear mapping. This issue does not affect the algorithm itself, but it is a correctness claim in the problem formulation.
minor comments (6)
  1. [Eq. (1) and Table II] The data rate Rf_ij(t) is called 'in bits/Hz' but the formula includes the bandwidth W and outputs bits/s; also b1 and b2 in the LoS probability expression are not defined in Table II.
  2. [Eq. (3)] The peak AoI definition uses the notation Q(t) without defining it, and the max should be over the IoT index i and time t; please rewrite as A = max_{i,t} a_i(t) or define Q(t) explicitly.
  3. [Table IV] The parameters beta0 and sigma2 are listed in one table cell with the value '80 dB' for sigma2, but the value of beta0 is missing; this prevents reproduction of Eq. (1).
  4. [Eq. (10)] The penalty for E_j(t)=E appears to penalize a fully charged UAV regardless of whether it is inside or outside the charging area, which may conflict with the intent to encourage leaving the charging zone; please clarify whether the penalty applies only when the UAV is inside the charging area and what r0 represents.
  5. [Algorithm 1] Algorithm 1 updates the critic and actor inside every time slot, whereas the clipped surrogate objective in Eq. (14) and standard PPO practice assume updates on collected trajectory batches; please specify the actual update schedule (e.g., after a rollout of length T) and how the experience buffer is sampled.
  6. [Section IV-F2] The mechanism in Eq. (17) is a weighted sum of two value functions with learnable scalar weights, but it is repeatedly called a 'dual-attention mechanism'; this is not attention in the usual sense, so either rename the mechanism or provide an actual attention formulation with query/key/value vectors.

Circularity Check

0 steps flagged · score 0.0 of 10

No circular derivation: the algorithmic contributions are additive to standard MAPPO and the evaluation compares on the same simulator, with the reward-proxy concern being a correctness risk rather than a circularity.

full rationale

The paper's claimed derivation chain is: formulate the peak-AoI problem in Eq. (5a), reformulate it as a POMDP with the hand-designed reward in Eqs. (10)-(11), extend MAPPO with LSTM temporal memory and a dual-attention value function in Eqs. (15)-(17), and then evaluate peak AoI in simulation. None of these steps defines a quantity in terms of the quantity it is supposed to predict. The AoI metric in Eq. (3) is a simulation quantity, while the reward in Eq. (11) is a training signal with unspecified components r_a(t), r_s(t), weights alpha, beta, gamma, and penalty constants. The paper asserts that the reward 'directly relates to our optimization goal by penalizing high AoI', but it never equates the reward with Eq. (5a), nor does it fit any parameter to the reported peak-AoI results. The abstract's 15.1% claim and Section V-B2's 5-10% range are inconsistent, and the undisclosed reward design makes the empirical claims hard to audit, but these are correctness and reproducibility concerns, not circularity. Self-citations such as [79], [100], and [104] support background assumptions and are accompanied by external citations, so they are not load-bearing. A misaligned reward proxy could invalidate the conclusion, but that would be an empirical failure, not a derivation that reduces to its own inputs.

Assumptions & free parameters 3 free parameters · 5 assumptions · 0 invented entities

The central claim rests on standard RL components plus a hand-designed, partially specified reward and an unverified simulator. No new physical entities are introduced.

free parameters (3)
  • Reward weights α, β, γ = not reported
    Eq. (11) weights the AoI reward, penalty reward, and success reward; the balance determines what the agent learns, and no values are given.
  • Penalty constants r_pen1, r_pen2 and energy threshold E_phi = not reported
    Eq. (10) defines energy penalties using these constants; they shape charging behavior and are never disclosed.
  • Algorithm hyperparameters (learning rate, discount factor, clip ratio, LSTM hidden size) = not reported
    No training configuration is provided, so the reported performance cannot be reproduced.
assumptions (5)
  • domain assumption UAVs operate at fixed altitude H and constant speed v
    Made in Section III-A to simplify trajectory optimization; if violated, the propulsion model and action space change.
  • domain assumption Data collection is instantaneous when a UAV is within communication range of an IoT
    Section III-A assumption; removes collection time from the AoI dynamics.
  • domain assumption Laser charging is stable and reliable within the charging area, following the attenuation model without interruptions
    Section III-A assumption; real laser charging has beam tracking errors and atmospheric effects.
  • ad hoc to paper The hand-designed reward (Eqs. 10-11) encodes the true peak AoI objective
    The paper never defines ra(t) or rs(t) and gives no values for α, β, γ, r_pen1, r_pen2; the entire learning signal rests on this mapping.
  • standard math TSP is NP-hard and the simplified single-UAV problem reduces to TSP
    Used in Section III-F to argue the joint problem is NP-hard; the reduction is only sketched.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Age of Information Optimization in Laser-charged UAV-assisted IoT Networks: A Multi-agent Deep Reinforcement Learning Method." pith.science (2026). https://pith.science/paper/NCKTTS4W

@misc{pith2026250708429,
  author       = {Pith},
  title        = {Pith review of: Age of Information Optimization in Laser-charged UAV-assisted IoT Networks: A Multi-agent Deep Reinforcement Learning Method},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/NCKTTS4W}},
  note         = {Machine review of arXiv:2507.08429}
}
read the original abstract

The integration of unmanned aerial vehicles (UAVs) with Internet of Things (IoT) networks offers promising solutions for efficient data collection. However, the limited energy capacity of UAVs remains a significant challenge. In this case, laser beam directors (LBDs) have emerged as an effective technology for wireless charging of UAVs during operation, thereby enabling sustained data collection without frequent returns to charging stations (CSs). In this work, we investigate the age of information (AoI) optimization in LBD-powered UAV-assisted IoT networks, where multiple UAVs collect data from distributed IoTs while being recharged by laser beams. We formulate a joint optimization problem that aims to minimize the peak AoI while determining optimal UAV trajectories and laser charging strategies. This problem is particularly challenging due to its non-convex nature, complex temporal dependencies, and the need to balance data collection efficiency with energy consumption constraints. To address these challenges, we propose a novel multi-agent proximal policy optimization with temporal memory and multi-agent coordination (MAPPO-TM) framework. Specifically, MAPPO-TM incorporates temporal memory mechanisms to capture the dynamic nature of UAV operations and facilitates effective coordination among multiple UAVs through decentralized learning while considering global system objectives. Simulation results demonstrate that the proposed MAPPO-TM algorithm outperforms conventional approaches in terms of peak AoI minimization and energy efficiency. Ideally, the proposed algorithm achieves up to 15.1% reduction in peak AoI compared to conventional multi-agent deep reinforcement learning (MADRL) methods.

Figures

Figures reproduced from arXiv: 2507.08429 by the authors.

Figure 1
Figure 1. Sketch map of the LBD-powered multi-UAV data collection [PITH_FULL_IMAGE:figures/full_fig_p008_1.png] view at source ↗
Figure 2
Figure 2. The framework of the proposed MAPPO-TM algorithm. [PITH_FULL_IMAGE:figures/full_fig_p012_2.png] view at source ↗
Figure 3
Figure 3. Training results. (a) Cumulative rewards training curve. (b) AoI rewards training curve. (c) Energy rewards training curve. [PITH_FULL_IMAGE:figures/full_fig_p015_3.png] view at source ↗
Figures from the paper (1 more)
Figure 4
Figure 4. Figure 4: (a) Peak AoI comparison across algorithms. (b) Peak AoI changing across different values of [PITH_FULL_IMAGE:figures/full_fig_p015_4.png]

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Enhanced Evolutionary Multi-Objective Deep Reinforcement Learning for Reliable and Efficient Wireless Rechargeable Sensor Networks

    cs.NI 2025-10 conditional novelty 4.0 of 10

    An LSTM-and-MLP-augmented evolutionary multi-objective PPO algorithm selects mobile-charger routes that improve the balance between sensor survival and charger energy efficiency in simulated wireless rechargeable sens...

Reference graph

Works this paper leans on

134 extracted references · 77 canonical work pages · cited by 1 Pith paper

  1. [1]

    Fair energy-efficient resource optimization for multi-UA V enabled Internet of Things,

    X. Liu, Z. Liu, B. Lai, B. Peng, and T. S. Durrani, “Fair energy-efficient resource optimization for multi-UA V enabled Internet of Things,”IEEE Trans. Veh. Technol., vol. 72, no. 3, pp. 3962–3972, 2023

    2023

  2. [2]

    Joint communication and trajectory optimization for multi-UA V enabled mobile Internet of Vehicles,

    X. Liu, B. Lai, B. Lin, and V . C. M. Leung, “Joint communication and trajectory optimization for multi-UA V enabled mobile Internet of Vehicles,” IEEE Trans. Intell. Transp. Syst., vol. 23, no. 9, pp. 15 354– 15 366, 2022

    2022

  3. [3]

    Charging techniques for UA V-assisted data collection: Is laser power beaming the answer?

    M. Lahmeri, M. A. Kishk, and M. Alouini, “Charging techniques for UA V-assisted data collection: Is laser power beaming the answer?” IEEE Commun. Mag. , vol. 60, no. 5, pp. 50–56, 2022

    2022

  4. [4]

    Reliable and energy-efficient UA V communications: A cost-aware perspective,

    F. H. Panahi and F. H. Panahi, “Reliable and energy-efficient UA V communications: A cost-aware perspective,” IEEE Trans. Mob. Com- put., vol. 23, no. 5, pp. 4038–4049, 2024

    2024

  5. [5]

    Age-optimal trajectory planning for UA V-assisted data collection,

    J. Liu, X. Wang, B. Bai, and H. Dai, “Age-optimal trajectory planning for UA V-assisted data collection,” inProc. IEEE INFOCOM, 2018, pp. 553–558

    2018

  6. [6]

    Energy- efficient trajectory optimization with wireless charging in UA V-assisted MEC based on multi-objective reinforcement learning,

    F. Song, M. Deng, H. Xing, Y . Liu, F. Ye, and Z. Xiao, “Energy- efficient trajectory optimization with wireless charging in UA V-assisted MEC based on multi-objective reinforcement learning,” IEEE Trans. Mob. Comput., vol. 23, no. 12, pp. 10 867–10 884, 2024

    2024

  7. [7]

    Data collection in UA V- assisted wireless sensor networks powered by harvested energy,

    I. Benmad, E. Driouch, and M. Kardouchi, “Data collection in UA V- assisted wireless sensor networks powered by harvested energy,” in Proc. IEEE PIMRC , 2021, pp. 1351–1356

    2021

  8. [8]

    Age-optimal data gathering and energy recharging of UA V in wireless sensor networks,

    C. Zhang, J. Liu, L. Xie, and X. He, “Age-optimal data gathering and energy recharging of UA V in wireless sensor networks,” in Proc. ACM AISS, 2021, pp. 78:1–78:6

    2021

Show all 134 references
  1. [9]

    URLLC-enabled by laser powered UA V relay: A quasi-optimal design of resource allocation, trajectory planning and energy harvesting,

    A. Ranjha and G. Kaddoum, “URLLC-enabled by laser powered UA V relay: A quasi-optimal design of resource allocation, trajectory planning and energy harvesting,” IEEE Trans. Veh. Technol., vol. 71, no. 1, pp. 753–765, 2022

    2022

  2. [10]

    Advancements in laser and LED-based optical wireless power transfer for IoT applications: A comprehensive review,

    K. Ahmadi and W. A. Serdijn, “Advancements in laser and LED-based optical wireless power transfer for IoT applications: A comprehensive review,” IEEE Internet Things J. , 2025

    2025

  3. [11]

    Aerial refueling: Scheduling wireless energy charging for UA V enabled data collection,

    K. Zhu, J. Yang, Y . Zhang, J. Nie, W. Y . B. Lim, H. Zhang, and Z. Xiong, “Aerial refueling: Scheduling wireless energy charging for UA V enabled data collection,” IEEE Trans. Green Commun. Netw. , vol. 6, no. 3, pp. 1494–1510, 2022

    2022

  4. [12]

    Energy minimization for wireless communication with rotary-wing UA V,

    Y . Zeng, J. Xu, and R. Zhang, “Energy minimization for wireless communication with rotary-wing UA V,”IEEE Trans. Wirel. Commun., vol. 18, no. 4, pp. 2329–2345, 2019

    2019

  5. [13]

    Load balance and trajectory design in multi-UA V aided large-scale wireless rechargeable networks,

    P. Wu, F. Xiao, H. Huang, and R. Wang, “Load balance and trajectory design in multi-UA V aided large-scale wireless rechargeable networks,” IEEE Trans. Veh. Technol., vol. 69, no. 11, pp. 13 756–13 767, 2020

    2020

  6. [14]

    Optimal scheduling and deep reinforcement learning for multimodal charging system via unmanned aerial vehicles,

    Z. Lu, X. Wang, Z. Wang, and Y . Pei, “Optimal scheduling and deep reinforcement learning for multimodal charging system via unmanned aerial vehicles,” IEEE Trans. Green Commun. Netw. , 2024

    2024

  7. [15]

    AoI- minimal trajectory planning and data collection in UA V-assisted wire- less powered IoT networks,

    H. Hu, K. Xiong, G. Qu, Q. Ni, P. Fan, and K. B. Letaief, “AoI- minimal trajectory planning and data collection in UA V-assisted wire- less powered IoT networks,” IEEE Internet Things J., vol. 8, no. 2, pp. 1211–1223, 2021

    2021

  8. [16]

    Deep rein- forcement learning for AoI minimization in UA V-aided data collection for WSN and IoT applications: A survey,

    O. A. Amodu, C. Jarray, R. A. R. Mahmood, H. Althumali, U. A. Bukar, R. Nordin, N. F. Abdullah, and N. C. Luong, “Deep rein- forcement learning for AoI minimization in UA V-aided data collection for WSN and IoT applications: A survey,” IEEE Access , vol. 12, pp. 108 000–108 04...

    2024

  9. [17]

    AoI-aware sensing scheduling and trajectory optimization for multi-UA V-assisted wireless backscatter networks,

    Y . Long, S. Zhao, S. Gong, B. Gu, D. Niyato, and X. Shen, “AoI-aware sensing scheduling and trajectory optimization for multi-UA V-assisted wireless backscatter networks,” IEEE Trans. Veh. Technol. , vol. 73, no. 10, pp. 15 440–15 455, 2024

    2024

  10. [18]

    AoI, timely- throughput, and beyond: A theory of second-order wireless network optimization,

    D. Guo, K. Nakhleh, I. Hou, S. Kompella, and C. Kam, “AoI, timely- throughput, and beyond: A theory of second-order wireless network optimization,” IEEE/ACM Trans. Netw., vol. 32, no. 6, pp. 4707–4721, 2024

    2024

  11. [19]

    Convex optimization-based trajectory planning for quadrotors landing on aerial vehicle carriers,

    Z. Shen, G. Zhou, H. Huang, C. Huang, Y . Wang, and F. Wang, “Convex optimization-based trajectory planning for quadrotors landing on aerial vehicle carriers,” IEEE Trans. Intell. Veh. , vol. 9, no. 1, pp. 138–150, 2024

    2024

  12. [20]

    Interactive AI with retrieval-augmented generation for next generation networking,

    R. Zhang, H. Du, Y . Liu, D. Niyato, J. Kang, S. Sun, X. Shen, and H. V . Poor, “Interactive AI with retrieval-augmented generation for next generation networking,” IEEE Netw., vol. 38, no. 6, pp. 414–424, 2024

    2024

  13. [21]

    Generative AI for space-air-ground integrated networks,

    R. Zhang, H. Du, D. Niyato, J. Kang, Z. Xiong, A. Jamalipour, P. Zhang, and D. I. Kim, “Generative AI for space-air-ground integrated networks,” IEEE Wirel. Commun., vol. 31, no. 6, pp. 10–20, 2024

    2024

  14. [22]

    A survey on resource management in joint communication and computing- embedded SAGIN,

    Q. Chen, Z. Guo, W. Meng, S. Han, C. Li, and T. Q. S. Quek, “A survey on resource management in joint communication and computing- embedded SAGIN,” IEEE Commun. Surv. Tutorials , 2024

    2024

  15. [23]

    Deep reinforcement learning for fresh data collection in UA V-assisted IoT networks,

    M. Yi, X. Wang, J. Liu, Y . Zhang, and B. Bai, “Deep reinforcement learning for fresh data collection in UA V-assisted IoT networks,” in Proc. IEEE INFOCOM , 2020, pp. 716–721

    2020

  16. [24]

    On-board deep Q-network for UA V-assisted online power transfer and data collection,

    K. Li, W. Ni, E. Tovar, and A. Jamalipour, “On-board deep Q-network for UA V-assisted online power transfer and data collection,” IEEE Trans. Veh. Technol., vol. 68, no. 12, pp. 12 215–12 226, 2019

    2019

  17. [25]

    Utility-oriented optimization for video streaming in UA V-aided MEC network: A DRL approach,

    J. Miao, S. Bai, S. Mumtaz, Q. Zhang, and J. Mu, “Utility-oriented optimization for video streaming in UA V-aided MEC network: A DRL approach,” IEEE Trans. Green Commun. Netw., vol. 8, no. 2, pp. 878– 889, 2024

    2024

  18. [26]

    DRL- driven optimization for energy efficiency and fairness in NOMA-UA V networks,

    B. I. Ghomri, M. Y . Bendimerad, and F. T. Bendimerad, “DRL- driven optimization for energy efficiency and fairness in NOMA-UA V networks,” IEEE Commun. Lett. , vol. 28, no. 5, pp. 1048–1052, 2024

    2024

  19. [27]

    Applications of multi-agent reinforcement learning in future Internet: A comprehensive survey,

    T. Li, K. Zhu, N. C. Luong, D. Niyato, Q. Wu, Y . Zhang, and B. Chen, “Applications of multi-agent reinforcement learning in future Internet: A comprehensive survey,” IEEE Commun. Surv. Tutorials , vol. 24, no. 2, pp. 1240–1279, 2022

    2022

  20. [28]

    Efficient task offloading strategy for energy-constrained edge computing environments: A hybrid optimization approach,

    D. Alsadie, “Efficient task offloading strategy for energy-constrained edge computing environments: A hybrid optimization approach,” IEEE Access, vol. 12, pp. 85 089–85 102, 2024

    2024

  21. [29]

    Laser-powered UA V trajectory and charging optimization for sustainable data-gathering in the Internet of Things,

    Y .-S. Liau, Y .-W. P. Hong, and J.-P. Sheu, “Laser-powered UA V trajectory and charging optimization for sustainable data-gathering in the Internet of Things,” IEEE Trans. Mob. Comput. , 2024

    2024

  22. [30]

    Joint laser charging and DBS place- ment for drone-assisted edge computing,

    W. Liu, S. Zhang, and N. Ansari, “Joint laser charging and DBS place- ment for drone-assisted edge computing,” IEEE Trans. Veh. Technol., vol. 71, no. 1, pp. 780–789, 2022

    2022

  23. [31]

    Laser-powered UA Vs for wireless communication coverage: A large-scale deployment strategy,

    M. Lahmeri, M. A. Kishk, and M. Alouini, “Laser-powered UA Vs for wireless communication coverage: A large-scale deployment strategy,” IEEE Trans. Wirel. Commun. , vol. 22, no. 1, pp. 518–533, 2023

    2023

  24. [32]

    Dynamic optical wireless power transfer for electric vehicles,

    D. H. Nguyen, “Dynamic optical wireless power transfer for electric vehicles,” IEEE Access, vol. 11, pp. 2787–2795, 2023

    2023

  25. [33]

    Privacy-aware laser wireless power transfer for aerial multi-access edge computing: A Colonel Blotto game approach,

    L. Zhang, Y . Wang, M. Min, C. Guo, V . Sharma, and Z. Han, “Privacy-aware laser wireless power transfer for aerial multi-access edge computing: A Colonel Blotto game approach,” IEEE Internet Things J., vol. 10, no. 7, pp. 5923–5939, 2023

    2023

  26. [34]

    Intelligent task offloading and energy allocation in the UA V-aided mobile edge-cloud continuum,

    Z. Cheng, Z. Gao, M. Liwang, L. Huang, X. Du, and M. Guizani, “Intelligent task offloading and energy allocation in the UA V-aided mobile edge-cloud continuum,” IEEE Netw., vol. 35, no. 5, pp. 42–49, 2021

    2021

  27. [35]

    Dynamic trajectory design and bandwidth adjustment for energy-efficient UA V-assisted relaying with deep reinforcement learning in MEC IoT system,

    T. Du, X. Gui, X. Teng, K. Zhang, and D. Ren, “Dynamic trajectory design and bandwidth adjustment for energy-efficient UA V-assisted relaying with deep reinforcement learning in MEC IoT system,” IEEE Internet Things J. , vol. 11, no. 23, pp. 37 463–37 479, 2024

    2024

  28. [36]

    Data collection in laser-powered UA V-assisted IoT networks: Phased scheme design based on improved clustering algorithm,

    D. Li, S. Xu, C. Zhao, Y . Wang, R. Xu, and B. Ai, “Data collection in laser-powered UA V-assisted IoT networks: Phased scheme design based on improved clustering algorithm,” IEEE Trans. Green Commun. Netw., vol. 8, no. 1, pp. 482–497, 2024

    2024

  29. [37]

    Energy optimization of a laser-powered hovering-UA V relay in optical wireless backhaul,

    M. S. Bashir and M. Alouini, “Energy optimization of a laser-powered hovering-UA V relay in optical wireless backhaul,” IEEE Trans. Wirel. Commun., vol. 22, no. 5, pp. 3216–3230, 2023

    2023

  30. [38]

    Laser charging enabled DBS placement for downlink communications,

    W. Liu, L. Zhang, and N. Ansari, “Laser charging enabled DBS placement for downlink communications,” IEEE Trans. Netw. Sci. Eng., vol. 8, no. 4, pp. 3009–3018, 2021

    2021

  31. [39]

    Joint trajectory and charging power optimization for laser-charged UA V relaying networks,

    Y . Park, D. Kim, and J. Lee, “Joint trajectory and charging power optimization for laser-charged UA V relaying networks,” in Proc. IEEE ICTC, 2022, pp. 224–229

    2022

  32. [40]

    Green laser-powered UA V far- field wireless charging and data backhauling for a large-scale sensor network,

    X. Ma, X. Liu, and N. Ansari, “Green laser-powered UA V far- field wireless charging and data backhauling for a large-scale sensor network,” IEEE Internet Things J. , vol. 11, no. 19, pp. 31 932–31 946, 2024

    2024

  33. [41]

    Operation optimization of laser-powered aerial data harvest- ing for passive IoT networks,

    A. M. Abdelhady, A. C ¸ elik, C. Diaz-Vilor, H. Jafarkhani, and A. M. Eltawil, “Operation optimization of laser-powered aerial data harvest- ing for passive IoT networks,” in Proc. IEEE WCNC , 2024, pp. 1–6

    2024

  34. [42]

    Resource allocation strategy for wireless powered communication networks with UA V- assisted edge computing,

    X. Zhang, Y . Zhao, H. You, K. Jian, and L. Liang, “Resource allocation strategy for wireless powered communication networks with UA V- assisted edge computing,” in Proc. IEEE VTC , 2024, pp. 1–6

    2024

  35. [43]

    Air-ground coordinated MEC: Joint task, time allocation and trajectory design,

    L. Wang, Y . Li, Y . Chen, T. Li, and Z. Yin, “Air-ground coordinated MEC: Joint task, time allocation and trajectory design,” IEEE Trans. Veh. Technol., vol. 74, no. 3, pp. 4728–4743, 2025

    2025

  36. [44]

    Laser-powered multi-UA V URLLC systems: Reliability and scheduling performance analysis,

    K. Singh, P. Raut, P. K. Sharma, and C. Li, “Laser-powered multi-UA V URLLC systems: Reliability and scheduling performance analysis,” IEEE Trans. Veh. Technol., vol. 72, no. 11, pp. 14 615–14 630, 2023

    2023

  37. [45]

    On the performance of laser-powered UA V-assisted SWIPT enabled multiuser communication network with hybrid NOMA,

    S. K. Singh, K. Agrawal, K. Singh, A. Bansal, C. Li, and Z. Ding, “On the performance of laser-powered UA V-assisted SWIPT enabled multiuser communication network with hybrid NOMA,” IEEE Trans. Commun., vol. 70, no. 6, pp. 3912–3929, 2022

    2022

  38. [46]

    Wireless powered metaverse: Joint task scheduling and trajectory design for multi-devices and multi-UA Vs,

    X. Wang, J. Li, Z. Ning, Q. Song, L. Guo, and A. Jamalipour, “Wireless powered metaverse: Joint task scheduling and trajectory design for multi-devices and multi-UA Vs,”IEEE J. Sel. Areas Commun. , vol. 42, no. 3, pp. 552–569, 2024

    2024

  39. [47]

    Joint optimization of 3D trajectory and scheduling for solar-powered UA V systems,

    Y . Fu, H. Mei, K. Wang, and K. Yang, “Joint optimization of 3D trajectory and scheduling for solar-powered UA V systems,” IEEE Trans. Veh. Technol., vol. 70, no. 4, pp. 3972–3977, 2021

    2021

  40. [48]

    Backscatter communication based sensor data collection using laser powered UA V,

    A. Goel and S. De, “Backscatter communication based sensor data collection using laser powered UA V,” in Proc. IEEE ICC , 2023, pp. 2896–2901

    2023

  41. [49]

    Dynamic charging and path planning for UA V-powered rechargeable WSNs using multi-agent deep reinforcement learning,

    M. L. Betalo, S. Leng, A. M. Seid, H. N. Abishu, A. Erbad, and X. Bai, “Dynamic charging and path planning for UA V-powered rechargeable WSNs using multi-agent deep reinforcement learning,” IEEE Trans Autom. Sci. Eng. , 2025

    2025

  42. [50]

    AoI minimization based on deep reinforcement learning and matching game for IoT information collection in SAGIN,

    G. Zhang, X. Wei, X. Tan, Z. Han, and G. Zhang, “AoI minimization based on deep reinforcement learning and matching game for IoT information collection in SAGIN,” IEEE Trans. Commun. , 2025

    2025

  43. [51]

    UA V trajectory planning for AoI-minimal data collection in UA V-aided IoT networks by transformer,

    B. Zhu, E. Bedeer, H. H. Nguyen, R. Barton, and Z. Gao, “UA V trajectory planning for AoI-minimal data collection in UA V-aided IoT networks by transformer,” IEEE Trans. Wirel. Commun., vol. 22, no. 2, pp. 1343–1358, 2023

    2023

  44. [52]

    AoI oriented UA V trajectory planning in wireless powered IoT networks,

    Q. Dang, Q. Cui, Z. Gong, X. Zhang, X. Huang, and X. Tao, “AoI oriented UA V trajectory planning in wireless powered IoT networks,” in Proc. IEEE WCNC , 2022, pp. 884–889

    2022

  45. [53]

    Joint AoI-aware UA Vs trajectory planning and data collection in UA V-based IoT systems: A deep reinforcement learning approach,

    X. Xiao, X. Wang, and W. Lin, “Joint AoI-aware UA Vs trajectory planning and data collection in UA V-based IoT systems: A deep reinforcement learning approach,” IEEE Trans. Consumer Electron. , vol. 70, no. 4, pp. 6484–6495, 2024

    2024

  46. [54]

    AoI-aware energy efficiency resource allocation for integrated satellite-terrestrial IoT networks,

    Q. Wang, X. Liang, H. Zhang, and L. Ge, “AoI-aware energy efficiency resource allocation for integrated satellite-terrestrial IoT networks,” IEEE Trans. Green Commun. Netw. , vol. 9, no. 1, pp. 125–139, 2025

    2025

  47. [55]

    Risk-aware and energy-efficient AoI optimization for multi-connectivity WNCS with short packet transmissions,

    J. Cao, X. Zhu, S. Sun, E. Kurniawan, and A. Boonkajay, “Risk-aware and energy-efficient AoI optimization for multi-connectivity WNCS with short packet transmissions,” IEEE Internet Things J. , 2024

    2024

  48. [56]

    AoI and energy tradeoff for aerial-ground collaborative MEC: A multi- objective learning approach,

    F. Song, Q. Yang, M. Deng, H. Xing, Y . Liu, X. Yu, K. Li, and L. Xu, “AoI and energy tradeoff for aerial-ground collaborative MEC: A multi- objective learning approach,” IEEE Trans. Mob. Comput. , vol. 23, no. 12, pp. 11 278–11 294, 2024

    2024

  49. [57]

    Efficient AoI- aware resource management in VLC-V2X networks via multi-agent RL mechanism,

    M. Azizi, F. Zeinali, M. R. Mili, and S. Shokrollahi, “Efficient AoI- aware resource management in VLC-V2X networks via multi-agent RL mechanism,” IEEE Trans. Veh. Technol. , vol. 73, no. 9, pp. 14 009– 14 014, 2024

    2024

  50. [58]

    AoI optimiza- tion in multi-source update network systems under stochastic energy harvesting model,

    S. Sun, W. Wu, C. Fu, X. Qiu, J. Luo, and J. Wang, “AoI optimiza- tion in multi-source update network systems under stochastic energy harvesting model,” IEEE J. Sel. Areas Commun. , vol. 42, no. 11, pp. 3172–3187, 2024

    2024

  51. [59]

    Average AoI minimization with directional charging for wireless-powered network edge,

    Q. Chen, S. Guo, W. Xu, J. Li, T. Shi, H. Gao, and Z. Cai, “Average AoI minimization with directional charging for wireless-powered network edge,” IEEE Transactions on Mobile Computing , 2025

    2025

  52. [60]

    AoI- minimal clustering, transmission and trajectory co-design for UA V- assisted WPCNs,

    X. Liu, H. Liu, K. Zheng, J. Liu, T. Taleb, and N. Shiratori, “AoI- minimal clustering, transmission and trajectory co-design for UA V- assisted WPCNs,” IEEE Trans. Veh. Technol., vol. 74, no. 1, pp. 1035– 1051, 2025. 20

    2025

  53. [61]

    Multitask transfer deep reinforcement learning for timely data collection in rechargeable- UA V-aided IoT networks,

    M. Yi, X. Wang, J. Liu, Y . Zhang, and R. Hou, “Multitask transfer deep reinforcement learning for timely data collection in rechargeable- UA V-aided IoT networks,” IEEE Internet Things J. , vol. 10, no. 23, pp. 20 545–20 559, 2023

    2023

  54. [62]

    AoI-energy tradeoff for data collection in UA V-assisted wireless networks,

    X. Zhang, Z. Chang, T. H ¨am¨al¨ainen, and G. Min, “AoI-energy tradeoff for data collection in UA V-assisted wireless networks,” IEEE Trans. Commun., vol. 72, no. 3, pp. 1849–1861, 2024

    2024

  55. [63]

    Safe DQN-based AoI-minimal task offloading for UA V-aided edge computing system,

    H. Zhao, G. Lu, Y . Liu, Z. Chang, L. Wang, and T. H ¨am¨al¨ainen, “Safe DQN-based AoI-minimal task offloading for UA V-aided edge computing system,” IEEE Internet Things J. , vol. 11, no. 19, pp. 32 012–32 024, 2024

    2024

  56. [64]

    AoI- aware resource allocation with interference avoidance for ultra-dense industrial Internet of Things networks,

    J. Huang, T. Yu, F. Yang, S. Zhang, W. Jiang, and D. Niyato, “AoI- aware resource allocation with interference avoidance for ultra-dense industrial Internet of Things networks,” IEEE Internet Things J. , 2024

    2024

  57. [65]

    An AoI-aware data transmission algorithm in blockchain-based intelligent healthcare systems,

    Y . Liu, X. Wang, G. Zheng, X. Wan, and Z. Ning, “An AoI-aware data transmission algorithm in blockchain-based intelligent healthcare systems,” IEEE Trans. Consumer Electron. , vol. 70, no. 1, pp. 1180– 1190, 2024

    2024

  58. [66]

    AoI-aware interference mitigation for task- oriented multicasting in multi-cell NOMA networks,

    C. Lin and W. Liao, “AoI-aware interference mitigation for task- oriented multicasting in multi-cell NOMA networks,” IEEE Trans. Wirel. Commun., vol. 23, no. 9, pp. 11 341–11 356, 2024

    2024

  59. [67]

    AoI- guaranteed bandit: Information gathering over unreliable channels,

    Z. Huang, W. Wu, C. Fu, V . Chau, X. Liu, J. Wang, and J. Luo, “AoI- guaranteed bandit: Information gathering over unreliable channels,” IEEE Trans. Mob. Comput. , vol. 23, no. 10, pp. 9469–9486, 2024

    2024

  60. [68]

    AoI-aware waveform design for cooperative joint radar-communications systems with online prediction of radar target property,

    Z. Li, F. Hu, Q. Li, Z. Ling, Z. Chang, and T. H ¨am¨al¨ainen, “AoI-aware waveform design for cooperative joint radar-communications systems with online prediction of radar target property,” IEEE Trans. Commun., vol. 72, no. 10, pp. 6029–6043, 2024

    2024

  61. [69]

    Deep-reinforcement-learning-based AoI-aware resource allocation for RIS-aided IoV networks,

    K. Qi, Q. Wu, P. Fan, N. Cheng, W. Chen, J. Wang, and K. B. Letaief, “Deep-reinforcement-learning-based AoI-aware resource allocation for RIS-aided IoV networks,” IEEE Trans. Veh. Technol. , vol. 74, no. 1, pp. 1365–1378, 2025

    2025

  62. [70]

    Minimizing AoI in high-speed railway mobile networks: DQN-based methods,

    X. Zhang, K. Xiong, W. Chen, P. Fan, B. Ai, and K. B. Letaief, “Minimizing AoI in high-speed railway mobile networks: DQN-based methods,” IEEE Trans. Intell. Transp. Syst., vol. 25, no. 12, pp. 20 137– 20 150, 2024

    2024

  63. [71]

    Enhancing the safety of autonomous driving systems via AoI-optimized task scheduling,

    T. Shi, Q. Xu, J. Wang, C. Xu, K. Wu, K. Lu, and C. Qiao, “Enhancing the safety of autonomous driving systems via AoI-optimized task scheduling,” IEEE Trans. Veh. Technol., vol. 74, no. 3, pp. 3804–3819, 2025

    2025

  64. [72]

    Distributed real-time control for minimizing AoI in random access networks,

    H. Xie, S.-W. Jeon, and H. Jin, “Distributed real-time control for minimizing AoI in random access networks,” IEEE Internet Things J., 2024

    2024

  65. [73]

    Velocity-aware statistical analysis of peak AoI for ground and aerial users,

    Y . Qin, M. A. Kishk, and M. Alouini, “Velocity-aware statistical analysis of peak AoI for ground and aerial users,” IEEE Trans. Veh. Technol., 2025

    2025

  66. [74]

    AoI- aware energy-efficient SFC in UA V-aided smart agriculture using asynchronous federated learning,

    M. Akbari, A. Syed, W. S. Kennedy, and M. Erol-Kantarci, “AoI- aware energy-efficient SFC in UA V-aided smart agriculture using asynchronous federated learning,” IEEE Open J. Commun. Soc., vol. 5, pp. 1222–1242, 2024

    2024

  67. [75]

    AoI-minimal task assignment and trajectory optimization in multi-UA V-assisted IoT networks,

    C. Liu, Y . Guo, N. Li, and X. Song, “AoI-minimal task assignment and trajectory optimization in multi-UA V-assisted IoT networks,”IEEE Internet Things J. , vol. 9, no. 21, pp. 21 777–21 791, 2022

    2022

  68. [76]

    UA V-enabled inspection system with no-fly zones: DRL-based joint mobile nest scheduling and UA V trajectory design,

    J. Dai, Y . Gao, C. Cai, W. Xiong, and M. Liu, “UA V-enabled inspection system with no-fly zones: DRL-based joint mobile nest scheduling and UA V trajectory design,”IEEE Access, vol. 13, pp. 10 844–10 856, 2025

    2025

  69. [77]

    Evolution- ary state estimation-based multi-strategy jellyfish search algorithm for multi-UA V cooperative path planning,

    K. Meng, C. Chen, T. Wu, B. Xin, M. Liang, and F. Deng, “Evolution- ary state estimation-based multi-strategy jellyfish search algorithm for multi-UA V cooperative path planning,”IEEE Trans. Intell. Veh., 2024

    2024

  70. [78]

    Constrained multi-objective optimization for UA V-enabled mobile edge computing: Offloading optimization and path planning,

    C. Peng, X. Huang, Y . Wu, and J. Kang, “Constrained multi-objective optimization for UA V-enabled mobile edge computing: Offloading optimization and path planning,” IEEE Wirel. Commun. Lett. , vol. 11, no. 4, pp. 861–865, 2022

    2022

  71. [79]

    Multi-objective optimization for multi-UA V-assisted mobile edge computing,

    G. Sun, Y . Wang, Z. Sun, Q. Wu, J. Kang, D. Niyato, and V . C. M. Leung, “Multi-objective optimization for multi-UA V-assisted mobile edge computing,” IEEE Trans. Mob. Comput. , vol. 23, no. 12, pp. 14 803–14 820, 2024

    2024

  72. [80]

    Optimizing multi-UA V multi-user system through integrated sensing and communi- cation for Age of Information (AoI) analysis,

    Y . Zhou, A. A. Khuwaja, X. Li, N. Zhao, and Y . Chen, “Optimizing multi-UA V multi-user system through integrated sensing and communi- cation for Age of Information (AoI) analysis,” IEEE Open J. Commun. Soc., vol. 5, pp. 6918–6931, 2024

    2024

  73. [81]

    AoI-sensitive data collection in multi- UA V-assisted wireless sensor networks,

    X. Gao, X. Zhu, and L. Zhai, “AoI-sensitive data collection in multi- UA V-assisted wireless sensor networks,”IEEE Trans. Wirel. Commun., vol. 22, no. 8, pp. 5185–5197, 2023

    2023

  74. [82]

    Sum rate maximization in IoT networks with diversity-enhanced energy harvesting: A DRL-guided approach,

    S. A. Ullah, M. A. Sohail, H. Jung, M. O. B. Saeed, and S. A. Hassan, “Sum rate maximization in IoT networks with diversity-enhanced energy harvesting: A DRL-guided approach,” IEEE Internet Things J., vol. 11, no. 18, pp. 30 309–30 322, 2024

    2024

  75. [83]

    Multi-objective trajectory planning for UA V-assisted IoT networks based on DRL approach,

    J. Pan, Y . Li, R. Chai, S. Xia, and L. Zuo, “Multi-objective trajectory planning for UA V-assisted IoT networks based on DRL approach,” IEEE Internet Things J. , 2025

    2025

  76. [84]

    Generative AI agents with large language model for satellite networks via a mixture of experts transmission,

    R. Zhang, H. Du, Y . Liu, D. Niyato, J. Kang, Z. Xiong, A. Jamalipour, and D. I. Kim, “Generative AI agents with large language model for satellite networks via a mixture of experts transmission,” IEEE J. Sel. Areas Commun., vol. 42, no. 12, pp. 3581–3596, 2024

    2024

  77. [85]

    Energy efficiency maximization in RIS-assisted SWIPT networks with RSMA: A PPO-based approach,

    R. Zhang, K. Xiong, Y . Lu, P. Fan, D. W. K. Ng, and K. B. Letaief, “Energy efficiency maximization in RIS-assisted SWIPT networks with RSMA: A PPO-based approach,” IEEE J. Sel. Areas Commun., vol. 41, no. 5, pp. 1413–1430, 2023

    2023

  78. [86]

    A reinforcement learning- based fire warning and suppression system using unmanned aerial vehicles,

    F. H. Panahi, F. H. Panahi, and T. Ohtsuki, “A reinforcement learning- based fire warning and suppression system using unmanned aerial vehicles,” IEEE Trans. Instrum. Meas. , vol. 72, pp. 1–16, 2023

    2023

  79. [87]

    Multiagent deep reinforce- ment learning for wireless-powered UA V networks,

    O. S. Oubbati, A. Lakas, and M. Guizani, “Multiagent deep reinforce- ment learning for wireless-powered UA V networks,” IEEE Internet Things J., vol. 9, no. 17, pp. 16 044–16 059, 2022

    2022

  80. [88]

    Multi-agent DRL-based large-scale heterogeneous task offloading for dynamic IoT systems,

    X. He, S. Pang, H. Gui, K. Zhang, N. Wang, and X. Zhai, “Multi-agent DRL-based large-scale heterogeneous task offloading for dynamic IoT systems,” IEEE Trans. Netw. Sci. Eng. , vol. 12, no. 2, pp. 982–996, 2025

    2025

  81. [89]

    UA V-assisted content caching for human-centric consumer applications in IoV,

    W. Wang, X. Xu, M. Bilal, M. Khan, and Y . Xing, “UA V-assisted content caching for human-centric consumer applications in IoV,”IEEE Trans. Consumer Electron., vol. 70, no. 1, pp. 927–938, 2024

    2024

  82. [90]

    DRL-based resource allocation and trajectory planning for NOMA-enabled multi- UA V collaborative caching 6G network,

    P. Qin, Y . Fu, J. Zhang, S. Geng, J. Liu, and X. Zhao, “DRL-based resource allocation and trajectory planning for NOMA-enabled multi- UA V collaborative caching 6G network,” IEEE Trans. Veh. Technol. , vol. 73, no. 6, pp. 8750–8764, 2024

    2024

  83. [91]

    Joint optimization of trajectory control, resource allocation, and user association based on DRL for multi-fixed- wing UA V networks,

    B. Yin, X. Fang, and X. Wang, “Joint optimization of trajectory control, resource allocation, and user association based on DRL for multi-fixed- wing UA V networks,” IEEE Trans. Wirel. Commun. , vol. 23, no. 10, pp. 13 330–13 343, 2024

    2024

  84. [92]

    DRL-based joint task scheduling and trajectory planning method for UA V-assisted MEC scenarios,

    F. Li, C. Gu, D. Liu, Y . Wu, and H. Wang, “DRL-based joint task scheduling and trajectory planning method for UA V-assisted MEC scenarios,” IEEE Access, vol. 12, pp. 156 224–156 234, 2024

    2024

  85. [93]

    A centralized multi-agent DRL-based trajectory control strategy for unmanned aerial vehicle-enabled wireless communications,

    G. B. Tarekegn, R.-T. Juang, B. A. Tesfaw, H.-P. Lin, H.-C. Hsu, R. B. Tarekegn, and L.-C. Tai, “A centralized multi-agent DRL-based trajectory control strategy for unmanned aerial vehicle-enabled wireless communications,” IEEE Open J. Veh. Technol. , 2024

    2024

  86. [94]

    Minimizing age of information in UA V-assisted data collection with limited charging facilities,

    Y . Wei, Y . Lu, P. Zhao, S. Leng, and K. Yang, “Minimizing age of information in UA V-assisted data collection with limited charging facilities,” IEEE Wirel. Commun. Lett. , vol. 13, no. 5, pp. 1463–1467, 2024

    2024

  87. [95]

    UGV charging stations for UA V-assisted AoI-aware data collection,

    K. Messaoudi, A. Baz, O. S. Oubbati, A. Rachedi, T. Bendouma, and M. Atiquzzaman, “UGV charging stations for UA V-assisted AoI-aware data collection,” IEEE Trans. Cogn. Commun. Netw., vol. 10, no. 6, pp. 2325–2343, 2024

    2024

  88. [96]

    Multi-agent DRL-based energy harvesting for freshness of data in UA V-assisted wireless sensor networks,

    M. L. Betalo, S. Leng, H. N. Abishu, A. M. Seid, M. Fakirah, A. Erbad, and M. Guizani, “Multi-agent DRL-based energy harvesting for freshness of data in UA V-assisted wireless sensor networks,” IEEE Trans. Netw. Serv. Manag., vol. 21, no. 6, pp. 6527–6541, 2024

    2024

  89. [97]

    Joint optimization on trajectory, altitude, velocity, and link scheduling for minimum mission time in UA V-aided data collection,

    J. Li, H. Zhao, H. Wang, F. Gu, J. Wei, H. Yin, and B. Ren, “Joint optimization on trajectory, altitude, velocity, and link scheduling for minimum mission time in UA V-aided data collection,” IEEE Internet Things J., vol. 7, no. 2, pp. 1464–1475, 2020

    2020

  90. [98]

    Route coordination of UA V fleet to track a ground moving target in search and lock (SAL) task over urban airspace,

    Y . Wu and K. H. Low, “Route coordination of UA V fleet to track a ground moving target in search and lock (SAL) task over urban airspace,” IEEE Internet Things J. , vol. 9, no. 20, pp. 20 604–20 619, 2022

    2022

  91. [99]

    Optimal UA V caching and trajectory in aerial-assisted vehicular networks: A learning-based approach,

    H. Wu, F. Lyu, C. Zhou, J. Chen, L. Wang, and X. Shen, “Optimal UA V caching and trajectory in aerial-assisted vehicular networks: A learning-based approach,” IEEE J. Sel. Areas Commun., vol. 38, no. 12, pp. 2783–2797, 2020

    2020

  92. [100]

    Securing the sky: Integrated satellite-UA V physi- cal layer security for low-altitude wireless networks,

    J. Li, G. Sun, X. Sun, F. Mei, J. Wang, X. Hou, D. Tian, and V . C. M. Leung, “Securing the sky: Integrated satellite-UA V physi- cal layer security for low-altitude wireless networks,” arXiv preprint arXiv:2506.23493, 2025

    2025 arXiv

  93. [101]

    Joint wireless charging and data collection for UA V-enabled Internet of Things network,

    S. Zhang, W. Liu, and N. Ansari, “Joint wireless charging and data collection for UA V-enabled Internet of Things network,”IEEE Internet Things J., vol. 9, no. 23, pp. 23 852–23 859, 2022

    2022

  94. [102]

    Energy- efficient data collection and device positioning in UA V-assisted IoT,

    Z. Wang, R. Liu, Q. Liu, J. S. Thompson, and M. Kadoch, “Energy- efficient data collection and device positioning in UA V-assisted IoT,” IEEE Internet Things J. , vol. 7, no. 2, pp. 1122–1139, 2020

    2020

  95. [103]

    CODE++: Fast and accurate inference for compact distributed IoT 21 data collection,

    H. Lu, F. Lyu, J. Ren, H. Wu, C. Zhou, Z. Liu, Y . Zhang, and X. Shen, “CODE++: Fast and accurate inference for compact distributed IoT 21 data collection,” IEEE Trans. Parallel Distributed Syst., vol. 35, no. 11, pp. 2006–2022, 2024

    2006

  96. [104]

    From ground to sky: Architectures, applications, and challenges shaping low-altitude wireless networks,

    W. Yuan, Y . Cui, J. Wang, F. Liu, G. Sun, T. Xiang, J. Xu, S. Jin, D. Niyato, S. Coleri, S. Sun, S. Mao, A. Jamalipour, D. I. Kim, M.-S. Alouini, and X. Shen, “From ground to sky: Architectures, applications, and challenges shaping low-altitude wireless networks,” arXiv prepr...

    2025 arXiv

  97. [105]

    UA V-assisted data collection for Internet of Things: A survey,

    Z. Wei, M. Zhu, N. Zhang, L. Wang, Y . Zou, Z. Meng, H. Wu, and Z. Feng, “UA V-assisted data collection for Internet of Things: A survey,” IEEE Internet Things J. , vol. 9, no. 17, pp. 15 460–15 483, 2022

    2022

  98. [106]

    A blockchain-enabled energy- efficient data collection system for UA V-assisted IoT,

    X. Xu, H. Zhao, H. Yao, and S. Wang, “A blockchain-enabled energy- efficient data collection system for UA V-assisted IoT,” IEEE Internet Things J., vol. 8, no. 4, pp. 2431–2443, 2021

    2021

  99. [107]

    FL-AMM: federated learning augmented map matching with hetero- geneous cellular moving trajectories,

    H. Lu, F. Lyu, H. Wu, J. Zhang, J. Ren, Y . Zhang, and X. Shen, “FL-AMM: federated learning augmented map matching with hetero- geneous cellular moving trajectories,” IEEE J. Sel. Areas Commun. , vol. 41, no. 12, pp. 3878–3892, 2023

    2023

  100. [108]

    MoCo: Urban user mobile contact detection based on cellular signaling trace,

    S. Duan, F. Lyu, J. Zhang, H. Lu, P. Yang, H. Wu, Y . Zhang, and X. Shen, “MoCo: Urban user mobile contact detection based on cellular signaling trace,” IEEE Trans. Mob. Comput. , 2025

    2025

  101. [109]

    Distributed laser charging: A wireless power transfer approach,

    Q. Zhang, W. Fang, Q. Liu, J. Wu, P. Xia, and L. Yang, “Distributed laser charging: A wireless power transfer approach,” IEEE Internet Things J., vol. 5, no. 5, pp. 3853–3864, 2018

    2018

  102. [110]

    Dynamics of laser-charged UA Vs: A battery perspective,

    W. Jaafar and H. Yanikomeroglu, “Dynamics of laser-charged UA Vs: A battery perspective,” IEEE Internet Things J. , vol. 8, no. 13, pp. 10 573–10 582, 2021

    2021

  103. [111]

    Efficiency maximization for UA V- enabled mobile relaying systems with laser charging,

    M. Zhao, Q. Shi, and M. Zhao, “Efficiency maximization for UA V- enabled mobile relaying systems with laser charging,” IEEE Trans. Wirel. Commun., vol. 19, no. 5, pp. 3257–3272, 2020

    2020

  104. [112]

    Deep reinforcement learning for multiagent systems: A review of challenges, solutions, and applications,

    T. T. Nguyen, N. D. Nguyen, and S. Nahavandi, “Deep reinforcement learning for multiagent systems: A review of challenges, solutions, and applications,” IEEE Trans. Cybern., vol. 50, no. 9, pp. 3826–3839, 2020

    2020

  105. [113]

    Real-time optimal energy management of microgrid with uncertainties based on deep reinforcement learning,

    C. Guo, X. Wang, Y . Zheng, and F. Zhang, “Real-time optimal energy management of microgrid with uncertainties based on deep reinforcement learning,” Energy, vol. 238, p. 121873, 2022

    2022

  106. [114]

    MOTO: mobility-aware online task offloading with adaptive load balancing in small-cell MEC,

    S. Duan, F. Lyu, H. Wu, W. Chen, H. Lu, Z. Dong, and X. Shen, “MOTO: mobility-aware online task offloading with adaptive load balancing in small-cell MEC,” IEEE Trans. Mob. Comput. , vol. 23, no. 1, pp. 645–659, 2024

    2024

  107. [115]

    AUCTION: automated and quality-aware client selection framework for efficient federated learning,

    Y . Deng, F. Lyu, J. Ren, H. Wu, Y . Zhou, Y . Zhang, and X. Shen, “AUCTION: automated and quality-aware client selection framework for efficient federated learning,” IEEE Trans. Parallel Distributed Syst., vol. 33, no. 8, pp. 1996–2009, 2022

    1996

  108. [116]

    Exhaustive search, combinatorial optimization and enu- meration: Exploring the potential of raw computing power,

    J. Nievergelt, “Exhaustive search, combinatorial optimization and enu- meration: Exploring the potential of raw computing power,” in Proc. Springer SOFSEM, vol. 1963, 2000, pp. 18–35

    1963

  109. [117]

    S. P. Boyd and L. Vandenberghe, Convex optimization. Cambridge university press, 2004

    2004

  110. [118]

    An evolutionary algorithm approach to link prediction in dynamic social networks,

    C. A. Bliss, M. R. Frank, C. M. Danforth, and P. S. Dodds, “An evolutionary algorithm approach to link prediction in dynamic social networks,” J. Comput. Sci. , vol. 5, no. 5, pp. 750–764, 2014

    2014

  111. [119]

    Evolutionary algorithm based offline/online path planner for UA V navigation,

    I. K. Nikolos, K. P. Valavanis, N. Tsourveloudis, and A. N. Kostaras, “Evolutionary algorithm based offline/online path planner for UA V navigation,” IEEE Trans. Syst. Man Cybern. Part B , vol. 33, no. 6, pp. 898–912, 2003

    2003

  112. [120]

    Three-dimension trajectory design for multi-UA V wireless network with deep reinforce- ment learning,

    W. Zhang, Q. Wang, X. Liu, Y . Liu, and Y . Chen, “Three-dimension trajectory design for multi-UA V wireless network with deep reinforce- ment learning,” IEEE Trans. Veh. Technol., vol. 70, no. 1, pp. 600–612, 2021

    2021

  113. [121]

    3D-trajectory and phase- shift design for RIS-assisted UA V systems using deep reinforcement learning,

    H. Mei, K. Yang, Q. Liu, and K. Wang, “3D-trajectory and phase- shift design for RIS-assisted UA V systems using deep reinforcement learning,” IEEE Trans. Veh. Technol. , vol. 71, no. 3, pp. 3020–3029, 2022

    2022

  114. [122]

    Multi-UA V path planning for wireless data harvesting with deep reinforcement learning,

    H. Bayerlein, M. Theile, M. Caccamo, and D. Gesbert, “Multi-UA V path planning for wireless data harvesting with deep reinforcement learning,” IEEE Open J. Commun. Soc. , vol. 2, pp. 1171–1187, 2021

    2021

  115. [123]

    Path planning for UA V ground target tracking via deep reinforcement learning,

    B. Li and Y . Wu, “Path planning for UA V ground target tracking via deep reinforcement learning,” IEEE Access, vol. 8, pp. 29 064–29 074, 2020

    2020

  116. [124]

    The surprising effectiveness of PPO in cooperative multi-agent games,

    C. Yu, A. Velu, E. Vinitsky, J. Gao, Y . Wang, A. M. Bayen, and Y . Wu, “The surprising effectiveness of PPO in cooperative multi-agent games,” in Proc. NeurIPS, 2022, pp. 24 611–24 624

    2022

  117. [125]

    Reducing overestimation bias in multi-agent domains using double centralized critics,

    J. Ackermann, V . Gabler, T. Osa, and M. Sugiyama, “Reducing overestimation bias in multi-agent domains using double centralized critics,” arXiv preprint arXiv:1910.01465 , 2019

    1910 arXiv

  118. [126]

    Multi- agent actor-critic for mixed cooperative-competitive environments,

    R. Lowe, Y . Wu, A. Tamar, J. Harb, P. Abbeel, and I. Mordatch, “Multi- agent actor-critic for mixed cooperative-competitive environments,” in Proc. NeurIPS, 2017, pp. 6379–6390

    2017

  119. [127]

    Reliable real-time operating system for IoT devices,

    S. Hahm, J. Kim, A. Jeong, H. Yi, S. Chang, S. N. Kishore, A. Chauhan, and S. P. Cherian, “Reliable real-time operating system for IoT devices,” IEEE Internet Things J., vol. 8, no. 5, pp. 3705–3716, 2021

    2021

  120. [128]

    An energy-aware, highly available, and fault-tolerant method for reliable IoT systems,

    M. Bukhsh, S. Abdullah, A. Rahman, M. N. Asghar, H. Arshad, and A. Alabdulatif, “An energy-aware, highly available, and fault-tolerant method for reliable IoT systems,” IEEE Access , vol. 9, pp. 145 363– 145 381, 2021

    2021

  121. [129]

    Multi- agent reinforcement learning aided intelligent UA V swarm for target tracking,

    Z. Xia, J. Du, J. Wang, C. Jiang, Y . Ren, G. Li, and Z. Han, “Multi- agent reinforcement learning aided intelligent UA V swarm for target tracking,” IEEE Trans. Veh. Technol., vol. 71, no. 1, pp. 931–945, 2022

    2022

  122. [130]

    Multi-UA V task allocation with communication faults,

    P. B. Sujit and J. B. de Sousa, “Multi-UA V task allocation with communication faults,” in Proc. IEEE ACC , 2012, pp. 3724–3729

    2012

  123. [131]

    Energy- efficient post-failure reconfiguration of swarms of unmanned aerial vehicles,

    A. Tahir, M. H. Haghbayan, J. M. B ¨oling, and J. Plosila, “Energy- efficient post-failure reconfiguration of swarms of unmanned aerial vehicles,” IEEE Access, vol. 11, pp. 24 768–24 779, 2023

    2023

  124. [132]

    Reliability theory and practice for unmanned aerial vehicles,

    L. Xing and B. W. Johnson, “Reliability theory and practice for unmanned aerial vehicles,” IEEE Internet Things J. , vol. 10, no. 4, pp. 3548–3566, 2023

    2023

  125. [133]

    A survey of transfer learning,

    K. R. Weiss, T. M. Khoshgoftaar, and D. Wang, “A survey of transfer learning,” J. Big Data , vol. 3, p. 9, 2016

    2016

  126. [134]

    MEDIA: an incremental DNN based computation offloading for collaborative cloud-edge computing,

    L. Zhao, Y . Han, A. Hawbani, S. Wan, Z. Guo, and M. Guizani, “MEDIA: an incremental DNN based computation offloading for collaborative cloud-edge computing,” IEEE Trans. Netw. Sci. Eng. , vol. 11, no. 2, pp. 1986–1998, 2024

    1986

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.