REVIEW 3 major objections 5 minor 31 references
Scheduling to Minimize Age of Information in Multi-State Time-Varying Networks with Power Constraints
T0 review · 3 major / 5 minor · reviewed 2026-08-14 · deepseek-v4-flash
Pith's one-line read This paper proves that a simple truncated scheduling policy — transmit when a user's age exceeds a per-channel threshold, and cap simultaneous transmissions at M — achieves average Age of Information within O(1/√N) of the optimal value as…
desk verdict A genuinely useful LP-based framework for AoI scheduling with power constraints, but the advertised O(1/sqrt(N)) optimality is not yet rigorously backed because the threshold-structure theorem is deferred and the proof gaps are non-trivial. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the threshold-structured stationary randomized policy for the decoupled single-user CMDP, together with the truncated multi-user policy built from it. In the single-user problem the state is (x, q), the current age and channel state; the threshold property says transmission is optimal exactly when age x is at least τ_q, with τ_1 ≤ ⋯ ≤ τ_Q, and at most one state randomizes. This structure turns the Markov decision process into a finite linear program whose variables y_{x,q} = μ_x η_q ξ_{x,q} are the stationary probabilities of being in each state and transmitting. The multi-user policy then schedules all eager users when at most M qualify and otherwise selects M eager users uniformly; the proof of asymptotic optimality bounds the AoI loss from these truncation events by a concentration bound on the number of eager users, giving the O(1/√N) gap.
What would settle it
Simulate the truncated policy with M/N = 1/5 on the paper's four-state i.i.d. channel model for N = 100, 400, and 1600, measuring (J(π̃) − AoI_LB)/AoI_LB; Theorem 3 predicts this normalized gap decays like 1/√N, so a plateau or growth in the gap would refute asymptotic optimality.
Extended reading notes
Core claim
The central claim is Theorem 3: for a network of N users with M = θN schedulable slots per time step, the expected average Age of Information under the proposed truncated policy — schedule every user whose individual policy says 'transmit', and if too many qualify, pick M of them uniformly at random — differs from the optimal value of the original bandwidth- and power-constrained problem by at most O(1/√N). Hence, as N grows, the truncated policy is asymptotically optimal. The path to this result is a chain of reductions: relax the hard bandwidth constraint to a time-average constraint, decouple the users through a Lagrange multiplier W, show the single-user constrained Markov decision process has an optimal stationary randomized policy with threshold structure (for each channel state q there is a threshold τ_q such that the user transmits whenever its age is at least τ_q, and τ_q is smaller for better channels), solve the single-user problem exactly as a linear program, and then use concentration of the number of 'eager' users to control the loss from truncation.
Load-bearing premise
The entire chain — decoupling, threshold structure, and the O(1/√N) concentration bound — assumes each user's channel state is independent and identically distributed from slot to slot with a known distribution; if channels are temporally correlated, the age-and-channel state no longer summarizes the user and the theorem's scope ends.
Editorial extensions
If this is right
- For large N with fixed bandwidth fraction θ, network operators can implement the truncated policy and be guaranteed average AoI within O(1/√N) of the relaxed-problem lower bound.
- Per-user thresholds can be computed offline by solving a small linear program for each distinct channel-distribution and power-budget type, so the online scheduler is simple: compare current age to a precomputed threshold and pick a subset of eager users.
- The scheduler automatically differentiates users: power-limited users transmit mainly in good channel states, while power-rich users transmit often and at low age, filling the bandwidth.
- The asymptotic-optimality result holds for heterogeneous users because the decoupling is per-user; the proof does not require identical channel distributions or power budgets across users.
Reading between the lines
- Beyond the paper: if the channel process is Markovian rather than i.i.d., the same decomposition could in principle be carried out with the age augmented by channel memory, but the thresholds would become functions of the channel-state history and the O(1/√N) concentration argument would need a new bound; the paper's result does not cover this case.
- Beyond the paper: the proof of Theorem 3 bounds the gap using the worst-case threshold span and the worst-case channel probability; a tighter bound is likely available by exploiting the actual distribution of the eager set, which would shrink the constant while preserving the 1/√N rate.
- Beyond the paper: the threshold-based policy suggests a natural online-learning extension when channel distributions are unknown — estimate η and adapt the LP thresholds periodically; this paper assumes known distributions.
- Beyond the paper: the same LP-with-truncation construction should apply to other freshness metrics, such as peak age, as long as the single-user Bellman equation retains monotonic structure; the paper only treats average AoI.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper considers a slotted wireless network in which a central controller collects status updates from N users over multi-state fading channels. Each user has an average power constraint, and at most M users can be scheduled per slot. The objective is to minimize the long-term average Age of Information per user. The authors relax the hard per-slot bandwidth constraint to a time-average constraint, form a Lagrangian with multiplier W, and decouple the problem into N single-user constrained Markov decision processes. They claim a dual threshold structure for the optimal single-user policy, reformulate each single-user CMDP as a linear program, and then construct a truncated scheduling policy that respects the hard bandwidth constraint. The main theoretical result is Theorem 3: with M/N = θ held constant, the per-user AoI gap between the truncated policy and the relaxed lower bound is O(1/√N), so the truncated policy is asymptotically optimal. Simulation results compare the proposed policy with a greedy baseline and illustrate threshold-type scheduling behavior.
Significance. If the main claims are correct, the paper offers a tractable LP-based solution to a meaningful cross-layer AoI problem and an asymptotically optimal scheduling rule under a hard bandwidth constraint. The LP reformulation in Theorem 1 and the steady-state balance equations appear sound, and the asymptotic optimality statement is concrete and falsifiable. The simulations support the qualitative claims about channel-aware scheduling for power-limited users. The main weakness is the incomplete proof of the threshold structure used in the asymptotic argument: Theorem 2 is not established for the tight-power case, and Appendix C relies on that structure in several places. The paper also contains a repairable algebraic error in the proof of Lemma 1. The central idea is promising, but the current version is not self-contained enough for the claimed Theorem 3.
major comments (3)
- [Appendix A, Eq. (37)] The displayed inequality chain in Eq. (37) is algebraically inconsistent. From Eq. (36) the correct implication for x′ > x is α Σ η_{q′} V_α(x′+1,q′) ≥ α Σ η_{q′} V_α(x+1,q′) ≥ α(λω(q)+W)+α Σ η_{q′} V_α(1,q′). The printed line omits the discount factor from parts of the right-hand side and asserts α Σ η_{q′} V_α(x′+1,q′) > Σ η_{q′} V_α(x+1,q′), which is not a consequence of monotonicity because α<1. Since Lemma 1 is the basis for the threshold-structure claims, this step must be corrected.
- [Section III-D, Theorem 2] The proof of Theorem 2 does not establish the claimed single-threshold structure. Corollary 2 supplies only monotonicity of ξ*_{x,q} in x and q. By Corollary 1, the optimal stationary randomized policy is a mixture of two deterministic threshold policies; if those two policies have different threshold vectors, then ξ*_{x,q} takes a constant fractional value on an interval of x, so the assertion that randomization occurs only at a single x per channel state does not follow. The tight-power case is deferred to [21, Theorem 5] without verifying that the queueing and arrival assumptions of [21] transfer to the AoI CMDP in Eqs. (11)-(12). This matters because Appendix C uses the threshold structure both to bound x_n(t) ≤ τ_{n,Q} and to control the probability that an eager user remains eager in subsequent slots.
- [Appendix C, Eqs. (44)-(46)] The O(1/√N) bound contains several unproved assertions that are load-bearing for Theorem 3. First, the quantity p in the paragraph before Eq. (42) is never defined, and the subsequent construction of z = (N-M)/N + (M/N)(1-η_{n,1}) is not derived from a precise conditional probability over the event that the relaxed policy would schedule the user. Second, Eq. (46) asserts that τ_{n,Q} and Γ_n do not grow with N for users with fixed power constraints; this is not proved and depends on the behavior of the Lagrange multiplier W as N grows. Third, the concentration bound [31] is applied to ||Ω(t)|−Ω|, but the independence assumptions underlying that bound should be stated explicitly. The asymptotic optimality claim therefore needs a more rigorous proof or clearly stated extra conditions.
minor comments (5)
- [Eq. (27)] The subgradient formula d_W g(W(k)) should contain the factor 1/N if g(W) is defined as in Eq. (25); the printed formula (1/N)Σ A_n(W(k)) - M is missing the 1/N. This does not change the zero set but it affects the step-size interpretation in the subgradient update.
- [Eq. (16b)] The definition of β_x should be Σ_{q=1}^Q η_q ξ_{x,q}; the subscript x on ξ is missing in the displayed equation.
- [Eq. (9) and Fig. 4] The notation WMN in Eq. (9) should be written as W M/N, and in Fig. 4 the caption appears to have a typo: “ρ = {0.2, 0.4.1.4, 1.6}” should be “ρ = {0.2, 0.4, 1.4, 1.6}”.
- [Eq. (44c)] The expressions for z and 1/(1-z) should be reconciled: from the displayed z one obtains z = 1 - θ η_{n,1}, whereas the text writes 1/(1-z) = 1/(min_n η_{n,q}(1-(N-M)/N)). The current notation is confusing and should be cleaned up.
- [Reference [31]] The concentration step in Eq. (45) would be clearer if it used a standard Berry-Esseen or Lyapunov CLT statement for sums of independent bounded variables, and if the independence of the indicators s_n(t) across users were stated explicitly.
Circularity Check
No circularity: the relaxed lower bound is computed independently via LP and the truncated-policy gap is measured against that bound, not fitted or self-referentially defined.
full rationale
The central derivation is self-contained against external benchmarks. The relaxed RB&P-Constrained AoI problem (Problem 2) is obtained by replacing the per-slot hard bandwidth constraint (7b) with a time-average constraint (8b), and its decoupled per-user CMDP (Problem 3) is solved as an LP (Theorem 1). The lower bound AoILB in Eq. (32) is therefore an independent computed benchmark, not a fitted parameter renamed as a prediction. The truncated policy is then compared with that lower bound in Theorem 3/Appendix C; the O(1/sqrt(N)) gap is derived from a concentration argument in [31], which is external to this paper. The threshold-structure results (Lemma 1, Corollary 2, Theorem 2) are established in the paper for the deterministic case and, for the tight-power randomized case, are delegated to the external result [21, Theorem 5]; even if that delegation is a proof gap (monotone xi matrices alone do not obviously force a single randomized threshold), reliance on an external theorem is not circularity. No parameter is fit to the AoI curve being 'predicted,' and no load-bearing self-citation is used. The proof gap in Appendix C is a correctness risk, not a circularity.
Assumptions & free parameters
free parameters (2)
- Xmax (AoI truncation bound) =
unspecified (stated as chosen large enough to contain thresholds)
- Subgradient stepsize gamma_k =
not given (chosen similar to [7])
assumptions (6)
- standard math For the decoupled CMDP, an optimal stationary randomized policy exists and is a mixture of no more than two stationary deterministic policies (Corollary 1 via [28, Theorem 4.4]).
- domain assumption The threshold structure for the tight-power-constraint case follows by 'a similar manner' to [21, Lemma 2 and Theorem 5].
- standard math Averaging over the alpha-discounted optimal policies and taking a sequence alpha_k to 1 recovers the average-cost optimal policy ([30]).
- standard math The number of eager users |Omega(t)| concentrates as E[1/N ||Omega(t)|-E[|Omega(t)|]|] = O(1/sqrt(N)) ([31]), which requires the per-user scheduling decisions to be nearly independent.
- domain assumption Each user's channel state is i.i.d. over slots with known distribution eta_{n,q}, independent across users.
- domain assumption Transmissions are always successful when a scheduled user spends omega(q) power; there is no packet loss or estimate error.
Cite this review
Pith. "Pith review of Scheduling to Minimize Age of Information in Multi-State Time-Varying Networks with Power Constraints." pith.science (2026). https://pith.science/paper/WZYS3IS7
@misc{pith2026190801334,
author = {Pith},
title = {Pith review of: Scheduling to Minimize Age of Information in Multi-State Time-Varying Networks with Power Constraints},
year = {2026},
howpublished = {\url{https://pith.science/paper/WZYS3IS7}},
note = {Machine review of arXiv:1908.01334}
}
read the original abstract
In this paper, we study how to collect fresh data in time-varying networks with power constrained users. We measure data freshness from the perspective of the central controller by using the metric Age of Information, namely the time elapsed since the generation time-stamp of the freshest information. We wonder what is the minimum AoI performance the network can achieve and how to design scheduling algorithms to approach it. To answer these questions when scheduling decisions are restricted to bandwidth constraint, we first decouple the multi-user scheduling problem into a single user constrained Markov decision process (CMDP) through relaxation of the hard bandwidth constraint. Next we exploit the threshold structure of the optimal policy for the decoupled single user CMDP and obtain the optimum solution through linear programming (LP). Finally, an asymptotic optimal truncated policy that can satisfy the hard bandwidth constraint is built upon the optimal solution to each of the decoupled single-user sub-problem. The performance is verified through simulations. Our investigation shows that to obtain a small AoI performance, the scheduler exploits good channels to schedule users supported by limited power. Users equipped with enough transmission power are updated in a timely manner such that the bandwidth constraint can be satisfied.
Figures
Reference graph
Works this paper leans on
-
[21]
——, “Joint queue-aware and channel-aware delay optimal scheduling of arbitrarily bursty traffic over multi-state time-varying channels,” IEEE Transactions on Communications, vol. 67, no. 1, pp. 503–517, Jan 2019
work page 2019
-
[31]
Closed form summation for classical distributions: variations on a theme of de moivre,
P. Diaconis and S. Zabell, “Closed form summation for classical distributions: variations on a theme of de moivre,” Statistical Science , pp. 284–302, 1991
work page 1991
-
[1]
Real-time status: How often should one update?
S. Kaul, R. Yates, and M. Gruteser, “Real-time status: How often should one update?” in 2012 Proceedings IEEE INFOCOM , March 2012, pp. 2731–2735
work page 2012
-
[2]
Lazy is timely: Status updates by an energy harvesting source,
R. D. Yates, “Lazy is timely: Status updates by an energy harvesting source,” in 2015 IEEE International Symposium on Information Theory (ISIT), June 2015, pp. 3008–3012
work page 2015
-
[3]
Update or wait: How to keep your data fresh,
Y . Sun, E. Uysal-Biyikoglu, R. Yates, C. E. Koksal, and N. B. Shroff, “Update or wait: How to keep your data fresh,” in IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications, April 2016, pp. 1–9
work page 2016
-
[4]
Update or wait: How to keep your data fresh,
Y . Sun, E. Uysal-Biyikoglu, R. D. Yates, C. E. Koksal, and N. B. Shroff, “Update or wait: How to keep your data fresh,” IEEE Transactions on Information Theory, vol. 63, no. 11, pp. 7492–7508, Nov 2017
2017
-
[5]
Age-minimal online policies for energy harvesting sensors with random battery recharges,
A. Arafa, J. Yang, and S. Ulukus, “Age-minimal online policies for energy harvesting sensors with random battery recharges,” in 2018 IEEE International Conference on Communications (ICC) , May 2018, pp. 1– 6
work page 2018
-
[6]
Optimal transmission for energy harvesting nodes under battery size and usage constraints,
J. Yang and J. Wu, “Optimal transmission for energy harvesting nodes under battery size and usage constraints,” in 2017 IEEE International Symposium on Information Theory (ISIT) , June 2017, pp. 819–823
work page 2017
Show all 31 references
-
[7]
Average age of information with hybrid arq under a resource constraint,
E. T. Ceran, D. Gndz, and A. Gyrgy, “Average age of information with hybrid arq under a resource constraint,” in 2018 IEEE Wireless Communications and Networking Conference (WCNC) , April 2018, pp. 1–6
2018
-
[8]
Sening infor- mation through status updates,
A. Baknina, S. Ulukus, O. Oze, J. Yang, and A. Yener, “Sening infor- mation through status updates,” in 2018 IEEE International Symposium on Information Theory (ISIT) , June 2018, pp. 2271–2275
2018
-
[9]
Minimizing the age of information in broadcast wireless networks,
I. Kadota, E. Uysal-Biyikoglu, R. Singh, and E. Modiano, “Minimizing the age of information in broadcast wireless networks,” in 2016 54th An- nual Allerton Conference on Communication, Control, and Computing (Allerton), Sept 2016, pp. 844–851
2016
-
[10]
Scheduling policies for minimizing age of information in broadcast wireless networks,
I. Kadota, A. Sinha, E. Uysal-Biyikoglu, R. Singh, and E. Modiano, “Scheduling policies for minimizing age of information in broadcast wireless networks,” IEEE/ACM Transactions on Networking , vol. 26, no. 6, pp. 2637–2650, Dec 2018
2018
-
[11]
Minimizing age-of-information in multi-hop wireless networks,
R. Talak, S. Karaman, and E. Modiano, “Minimizing age-of-information in multi-hop wireless networks,” in 2017 55th Annual Allerton Confer- ence on Communication, Control, and Computing (Allerton) , Oct 2017, pp. 486–493
2017
-
[12]
Scheduling policies for age minimization in wireless networks with unknown channel state,
R. Talak, I. Kadota, S. Karaman, and E. Modiano, “Scheduling policies for age minimization in wireless networks with unknown channel state,” in 2018 IEEE International Symposium on Information Theory (ISIT) , June 2018, pp. 2564–2568
2018
-
[13]
Optimizing age of information in wireless networks with perfect channel state information,
R. Talak, S. Karaman, and E. Modiano, “Optimizing age of information in wireless networks with perfect channel state information,” in 2018 16th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt) , May 2018, pp. 1–8
2018
-
[14]
Age of information: Design and analysis of optimal scheduling algorithms,
Y . Hsu, E. Modiano, and L. Duan, “Age of information: Design and analysis of optimal scheduling algorithms,” in 2017 IEEE International Symposium on Information Theory (ISIT) , June 2017, pp. 561–565
2017
-
[15]
Decen- tralized status update for age-of-information optimization in wireless multiaccess channels,
Z. Jiang, B. Krishnamachari, X. Zheng, S. Zhou, and Z. Niu, “Decen- tralized status update for age-of-information optimization in wireless multiaccess channels,” in 2018 IEEE International Symposium on Infor- mation Theory (ISIT) , June 2018, pp. 2276–2280
2018
-
[16]
Age-based scheduling: Improving data freshness for wireless real-time traffic,
N. Lu, B. Ji, and B. Li, “Age-based scheduling: Improving data freshness for wireless real-time traffic,” in Proceedings of the Eighteenth ACM International Symposium on Mobile Ad Hoc Networking and Computing, ser. Mobihoc ’18. New York, NY , USA: ACM, 2018, pp. 191–200
2018
-
[17]
Optimizing age of information in wireless networks with throughput constraints,
I. Kadota, A. Sinha, and E. Modiano, “Optimizing age of information in wireless networks with throughput constraints,” in IEEE INFOCOM 2018 - IEEE Conference on Computer Communications , April 2018, pp. 1–9
2018
-
[18]
Oppor- tunistic scheduling as restless bandits,
V . S. Borkar, G. S. Kasbekar, S. Pattathil, and P. Y . Shetty, “Oppor- tunistic scheduling as restless bandits,” IEEE Transactions on Control of Network Systems , vol. 5, no. 4, pp. 1952–1961, Dec 2018
1952
-
[19]
Timely-throughput optimal scheduling with prediction,
K. Chen and L. Huang, “Timely-throughput optimal scheduling with prediction,” IEEE/ACM Transactions on Networking , vol. 26, no. 6, pp. 2457–2470, Dec 2018
2018
-
[20]
On delay-power tradeoff of rate adaptive wireless communications with random arrivals,
M. Wang, J. Liu, W. Chen, and A. Ephremides, “On delay-power tradeoff of rate adaptive wireless communications with random arrivals,” in GLOBECOM 2017 - 2017 IEEE Global Communications Conference , Dec 2017, pp. 1–6
2017
-
[22]
Delay-minimal transmission for average power constrained multi-access communications,
J. Yang and S. Ulukus, “Delay-minimal transmission for average power constrained multi-access communications,” IEEE Transactions on Wire- less Communications, vol. 9, no. 9, pp. 2754–2767, Sep. 2010
2010
-
[23]
Energy-efficient packet transmission over a wireless link,
E. Uysal-Biyikoglu, B. Prabhakar, and A. El Gamal, “Energy-efficient packet transmission over a wireless link,” IEEE/ACM Transactions on Networking, vol. 10, no. 4, pp. 487–499, Aug 2002
2002
-
[24]
Communication over fading channels with delay constraints,
R. A. Berry and R. G. Gallager, “Communication over fading channels with delay constraints,” IEEE Transactions on Information Theory , vol. 48, no. 5, pp. 1135–1149, May 2002
2002
-
[25]
Throughput optimal decentralized schedul- ing of multihop networks with end-to-end deadline constraints: Unreli- able links,
R. Singh and P. R. Kumar, “Throughput optimal decentralized schedul- ing of multihop networks with end-to-end deadline constraints: Unreli- able links,” IEEE Transactions on Automatic Control, vol. 64, no. 1, pp. 127–142, Jan 2019
2019
-
[26]
Transmission policies for time varying channels with average delay constraints,
B. Collins and R. L. Cruz, “Transmission policies for time varying channels with average delay constraints,” in Proceedings of the Annual Allerton Conference on Communication Control and Computing, vol. 37. The University; 1998, 1999, pp. 709–717
1998
-
[27]
Age-optimal con- strained cache updating,
R. D. Yates, P. Ciblat, A. Yener, and M. Wigger, “Age-optimal con- strained cache updating,” in 2017 IEEE International Symposium on Information Theory (ISIT) , June 2017, pp. 141–145
2017
-
[28]
Altman, Constrained Markov decision processes
E. Altman, Constrained Markov decision processes. CRC Press, 1999, vol. 7
1999
-
[29]
D. P. Bertsekas and A. Scientific, Convex optimization algorithms . Athena Scientific Belmont, 2015
2015
-
[30]
Average cost optimal stationary policies in infinite state markov decision processes with unbounded costs,
L. I. Sennott, “Average cost optimal stationary policies in infinite state markov decision processes with unbounded costs,”Operations Research, vol. 37, no. 4, pp. 626–633, 1989
1989
Reviewed August 14, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.