REVIEW 3 major objections 4 minor 1 cited by
Ergodic control of diffusions with compound Poisson jumps under a general structural hypothesis
T0 review · 3 major / 4 minor · reviewed 2026-08-14 · deepseek-v4-flash
Pith's one-line read The ergodic control problem for jump diffusions is fully characterized by one HJB equation under broad structural hypotheses.
desk verdict A credible, useful extension of ergodic HJB theory to non-near-monotone costs, with honest caveats; the abstract overstates pathwise optimality and Assumption 2.2 carries real weight. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the ergodic Hamilton-Jacobi-Bellman (HJB) equation governed by the integro-differential generator $A^u\phi(x)=a_{ij}(x)\partial_{ij}\phi(x)+\tilde b_i(x,u)\partial_i\phi(x)+\int_{\mathbb{R}^d}(\phi(x+y)-\phi(x))\,\nu(dy)$, where $\nu$ is the finite measure recording the sizes and rates of the compound Poisson jumps. The argument runs through the vanishing-discount method: the $\alpha$-discounted value functions solve $\min_u[A^u V_\alpha+R]=\alpha V_\alpha$, and two Lyapunov inequalities (Assumptions 2.1 and 2.2) provide the oscillation bound and the control of the negative part of $V_\alpha$ needed to extract a locally $C^{1,\rho}$ limit $V_*$. A scaling-based gradient estimate upgrades solutions to $C^{2,r}$ regularity under polynomial-growth hypotheses, and a concave-transform trick on the Lyapunov function turns the ergodic HJB estimate into tightness of the random empirical measures, which is the step that yields pathwise optimality.
What would settle it
Construct a controlled jump diffusion with a finite non-compactly supported jump measure that satisfies Assumption 2.1 and has some stabilizing control with finite ergodic cost, but violates Assumption 2.2, and check whether the normalized discounted value functions $V_\alpha(x)-V_\alpha(0)$ remain uniformly bounded in oscillation on a fixed ball as $\alpha\downarrow 0$. If their oscillation diverges, Lemma 5.2 fails and the HJB convergence theorem cannot hold; alternatively, if a limiting $V_*$ exists but $V_*^-\notin o(V_\circ)$, the uniqueness and stochastic-representation part of Theorem 5.2 is refuted.
Extended reading notes
Core claim
Under Assumptions 2.1 and 2.2, the ergodic control problem for the jump diffusion admits an optimal stationary Markov control, the optimal value $\rho^*$ is constant in the initial state, and the normalized $\alpha$-discounted value functions $V_\alpha(x)-V_\alpha(0)$ converge to a function $V_*$ that solves the ergodic HJB equation $\min_{u\in U}[A^u V_*(x)+R(x,u)]=\rho^*$ almost everywhere, with $V_*^-\in o(V_\circ)$ and $V_*(0)=0$. A stationary Markov control is optimal if and only if it selects the minimizer in this equation almost everywhere, and $V_*$ is the unique solution up to an additive constant in that class. Under Assumption 6.1 every average-cost optimal stationary Markov control is also optimal for the pathwise ergodic criterion, meaning it minimizes the almost-sure limsup of the average running cost. Under Assumption 7.1, fixing a stable control outside a large ball and solving the HJB equation on the ball yields controls whose ergodic cost is within any prescribed tolerance of $\rho^*$ once the ball is large enough.
Load-bearing premise
The load-bearing premise is Assumption 2.2: there exists a stable control $\hat v$ and a coercive $C^2$ function $V$ such that $A^{\hat v}V(x)\le \kappa\mathbf 1_{B_\circ}(x)-R_{\hat v}(x)$ on all of $\mathbb{R}^d$. This Lyapunov stability hypothesis is what makes the derivation of the ergodic HJB equation work when the jump measure has non-compact support; the paper's Remark 2.1 concedes it is not needed for existence, where the weaker condition that some control has finite ergodic cost already suffices.
Editorial extensions
If this is right
- Solving the ergodic HJB equation gives both the optimal value and an if-and-only-if verification criterion for stationary Markov controls, so optimal scheduling policies can be certified by one PDE.
- Every average-cost optimal stationary Markov control is pathwise optimal under Assumption 6.1, so policies that minimize expected long-run cost also minimize almost-sure long-run cost.
- Near-optimal policies can be computed by solving the HJB equation on a large bounded ball with a fixed stable control outside; the cost gap shrinks to zero as the ball grows.
- Under polynomial growth of the data, solutions of both the discounted and the ergodic HJB equations are $C^{2,r}$ on all of $\mathbb{R}^d$, so classical elliptic regularity applies to the value functions.
- The results recover the earlier near-monotone theory as a special case and also cover uniformly stable dynamics and dynamics that are transient under some controls.
Reading between the lines
- The bounded-domain approximation suggests a concrete numerical scheme: solve the semilinear HJB equation on a ball with an exterior stabilizing control fixed, then take the radius large; the paper proves near-optimality but does not quantify the needed radius.
- The scaling gradient estimate appears portable: any second-order integro-differential equation with finite jump measure and polynomial data should inherit the same gradient growth, which may simplify regularity proofs in other jump-process control problems.
- The negative-part bound $V_*^-\in o(V_\circ)$ is a natural replacement for near-monotonicity; one could test whether the same condition yields uniqueness of ergodic HJB solutions for other non-coercive cost structures, such as costs that vanish on lower-dimensional sets.
- Because the structural assumptions are abstracted from heavily loaded many-server queueing networks, pathwise optimality implies that scheduling policies chosen by HJB minimizers are optimal along almost every sample path of the limiting diffusion, strengthening the usual expectation-based guarantees.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper studies the ergodic control problem for d-dimensional controlled jump diffusions with compound Poisson jumps and nonnegative running costs, relaxing the near-monotone cost and uniform stability assumptions of earlier work. The model is set under two structural hypotheses: a Lyapunov inequality for V0 with a coercive comparison function F (Assumption 2.1) and a stabilizing stationary Markov control vhat with a coercive C^2 solution V to A^vhat V <= kappa 1_B0 - R_vhat (Assumption 2.2). The main results are: existence and x-independence of the optimal ergodic value rho* and an optimal stationary Markov control (Theorem 4.1); the alpha-discounted HJB equation with minimal nonnegative solutions (Theorem 5.1); the ergodic HJB equation min_u [A^u V* + R] = rho* a.e., with V*- in o(V0), obtained by vanishing discount, together with a characterization of optimal controls via pointwise minimization (Theorem 5.2); C^{2,r} regularity under polynomial growth Assumption 5.1 (Theorem 5.3); pathwise optimality under an additional structural Assumption 6.1 (Theorem 6.1); and an approximate HJB construction yielding near-optimal controls that fix a stable control outside a large ball (Theorem 7.1, Corollary 7.1). The paper includes queueing-network examples, including W and V models, that satisfy the hypotheses.
Significance. The paper makes a solid contribution to ergodic control of jump diffusions by removing the near-monotonicity restriction on the running cost, which is essential for many-server queueing applications. The hypotheses are explicit, the main theorems are carefully stated, and the proof strategy, based on perturbing the running cost by a coercive term and passing to the vanishing-discount limit, is coherent. The paper is also honest about the role of its assumptions: Remark 2.1 explicitly states that Assumption 2.2 is not needed for existence but is crucial for the HJB derivation when the Levy measure is not compactly supported, and the examples verify the assumptions in nontrivial queueing models. The main limitations are presentation-level: the abstract's pathwise-optimality assertion omits Assumption 6.1, and the genuinely primitive character of Assumption 2.2 for unbounded Levy measures deserves more prominence. If the stated hypotheses are accepted, the central claims appear sound.
major comments (3)
- [Abstract and Section 6] The abstract states that 'optimal stationary Markov controls are a.s. pathwise optimal' without the qualification that this requires Assumption 6.1 in addition to Assumptions 2.1 and 2.2. Theorem 6.1 is explicitly conditional on Assumption 6.1, which requires F = phi composed with V0 with concave increasing phi and boundedness of sigma and nabla V0/(1+phi composed with V0). As written, the abstract promises a result that is not proved under the hypotheses used for Theorems 4.1 and 5.2. Please qualify the pathwise-optimality statement in the abstract and in the introduction.
- [Remark 2.1 and Section 5] Remark 2.1 correctly notes that for non-compactly supported nu, Assumption 2.2 cannot be replaced by the stabilizability hypothesis (2.10) and is crucial in Section 5. Because Lemma 5.1 and Lemma 5.2 use (2.9) to obtain the bounds (5.5), (5.6) and the local boundedness of ~I(V0+3V), the HJB characterization in Theorem 5.2 rests on (2.9) as an additional primitive Lyapunov condition rather than as a consequence of stabilizability. The Section 3 examples are polynomial with finite m-th moments and verify (2.9), but they do not settle the general non-compact case. Please state this limitation more prominently in the abstract and introduction, and either prove or clearly delineate a class of primitive conditions on (b, sigma, nu, R) that imply (2.9).
- [Theorem 5.2(c)] The statement of Theorem 5.2(c) is ambiguous: it says V* is the unique solution (up to additive constant) to the equation min_u [A^u V + R] = rho a.e. with rho <= rho*. If rho is allowed to vary, the uniqueness statement is not literally true unless all such solutions have the same constant; if rho is meant to be a fixed constant, the inequality should be removed or explained. The proof only explicitly treats solutions of (5.22) with the constant rho*, and the comparison argument for solutions with smaller rho is not supplied. Please clarify the quantifier over rho and provide the argument or a reference.
minor comments (4)
- [Lemma 5.2] The proof of Lemma 5.2 twice references an equation '(5.7)', but no display with that number appears in the text; the intended target is the oscillation bound asserted in the lemma. Please renumber the displays or correct the references.
- [Section 6, proof of Theorem 6.1] The phrase 'tight when restricted to B(K x U)' is confusing; since K x U is not compact, the meaning should be 'tight when restricted to the Borel sigma-algebra of K x U' or, more simply, 'tight on compact subsets of K x U'. Please rephrase.
- [Abstract] The abstract contains a small typo, 'full characterizations', which should be 'full characterization'.
- [Section 7, proof of Theorem 7.1] The phrase 'evaluating (7.2) at v^epsilon_*' is imprecise; it should say 'applying Ito's formula to (7.2) under the control v^epsilon_*' or similar.
Circularity Check
No significant circularity: the HJB and pathwise-optimality results are derived from explicit external structural hypotheses, and self-citations are prior independent theorems rather than restatements of the target claims.
full rationale
I walked the derivation chain from Assumptions 2.1/2.2 through Theorem 4.1, Lemma 5.1, Theorem 5.2, Theorem 6.1, and Theorem 7.1. The existence result (Theorem 4.1) uses the convex-analytic technique of [4] and [7], but proves a new fact under an explicit stabilizability hypothesis (2.10); no fitted parameter is later renamed as a prediction. The HJB derivation in Theorem 5.2 uses Assumption 2.2 only as an external Lyapunov hypothesis (2.9), and the key lower/upper bounds (5.5)-(5.6) are proved in Lemma 5.1 rather than assumed. Remark 2.1 is a candid limitation statement: it says Assumption 2.2 is not needed for existence but is crucial for the HJB derivation when the Levy measure is non-compactly supported, and that the compact-support case reduces to (2.10) via [3, Theorem 3.7]. That is a scope limitation, not a circular reduction. The uniqueness and stochastic representation in Theorem 5.2(c) are argued in the paper, with [7] supplying a standard technical step whose assumptions do not include the target result; pathwise optimality in Theorem 6.1 adds the genuinely new nonlocal estimates (6.2)-(6.4) to the diffusion method of [10]. I found no equation or definition that equals its own input, and no claim whose conclusion is identical to a hypothesis by construction. The paper is not fully self-contained, but reliance on published prior theorems, including several by the same authors, does not make the derivation circular under the stated criteria.
Assumptions & free parameters
assumptions (8)
- standard math The controlled SDE (2.1) has a unique strong solution under admissible controls (Gihman-Skorohod [16], Gyongy-Krylov [17], Skorokhod [18]).
- standard math Krylov extension of Ito's formula (2.5) applies to f in W^{2,d}_loc(R^d) with I|f| in L^d_loc(R^d).
- standard math Existence of an optimal stationary Markov control for coercive costs via convex analysis ([7, Theorem 3.4.5 and Lemma 3.2.3]).
- standard math Strong maximum principle, Harnack inequality, ABP and local maximum principles for elliptic integro-differential operators (Gilbarg-Trudinger [25], Arapostathis et al. [26]).
- domain assumption Assumption 2.2: existence of a stabilizing control vhat and coercive V in C^2(R^d) with A^vhat V <= kappa 1_{B0} - R_vhat.
- ad hoc to paper Assumption 6.1: F = phi composed with V0 with smooth concave increasing phi, and boundedness of sigma and nabla V0/(1+phi composed with V0).
- ad hoc to paper Assumption 5.1: polynomial growth of R, V, V0 of degree m0 and finite (m0+1) moment of nu.
- ad hoc to paper Assumption 7.1: C^2 growth of ~F, existence of stabilizing ~v with A^~v ~V <= ~C - ~F, and finite ~m moment of nu.
Cite this review
Pith. "Pith review of Ergodic control of diffusions with compound Poisson jumps under a general structural hypothesis." pith.science (2026). https://pith.science/paper/QGY2GF4P
@misc{pith2026190801068,
author = {Pith},
title = {Pith review of: Ergodic control of diffusions with compound Poisson jumps under a general structural hypothesis},
year = {2026},
howpublished = {\url{https://pith.science/paper/QGY2GF4P}},
note = {Machine review of arXiv:1908.01068}
}
read the original abstract
We study the ergodic control problem for a class of controlled jump diffusions driven by a compound Poisson process. This extends the results of [SIAM J. Control Optim. 57 (2019), no. 2, 1516-1540] to running costs that are not near-monotone. This generality is needed in applications such as optimal scheduling of large-scale parallel server networks. We provide a full characterization of optimality via the Hamilton-Jacobi-Bellman (HJB) equation, for which we additionally exhibit regularity of solutions under mild hypotheses. In addition, we show that optimal stationary Markov controls are a.s. pathwise optimal. Lastly, we show that one can fix a stable control outside a compact set and obtain near-optimal solutions by solving the HJB on a sufficiently large bounded domain. This is useful for constructing asymptotically optimal scheduling policies for multiclass parallel server networks.
Forward citations
Cited by 1 Pith paper
-
Optimal scheduling of critically loaded multiclass GI/M/n+M queues in an alternating renewal environment
For multiclass many-server queues with alternating service interruptions and renewal arrivals in the Halfin-Whitt regime, the paper proves that the optimal diffusion-scale costs converge to the optimal costs of a limi...
Reference graph
Works this paper leans on
-
[3]
A. Arapostathis, L. Caffarelli, G. Pang, and Y. Zheng, Ergodic control of a class of jump diffusions with finite L´ evy measures and rough kernels, SIAM J. Control Optim. 57 (2019), no. 2, 1516–1540. MR 3942851 20 ARI ARAPOSTATHIS, GUODONG PANG, AND YI ZHENG
work page 2019
-
[5]
A. Arapostathis and G. Pang, Ergodic diffusion control of multiclass multi-pool networks in the Halfin-Whitt regime, Ann. Appl. Probab. 26 (2016), no. 5, 3110–3153. MR 3563203
work page 2016
-
[7]
Arapostathis, V
A. Arapostathis, V. S. Borkar, and M. K. Ghosh, Ergodic control of diffusion processes , Encyclopedia of Math- ematics and its Applications, vol. 143, Cambridge Universi ty Press, Cambridge, 2012. MR 2884272
2012
-
[1]
A. Bensoussan and J.-L. Lions, Impulse control and quasivariational inequalities , µ , Gauthier-Villars, Montrouge; Heyden & Son, Inc., Philadelphia, PA, 1984. Translated from the French by J. M. Cole. MR 756234
work page 1984
-
[2]
J.-L. Menaldi and M. Robin, On optimal ergodic control of diffusions with jumps , Stochastic analysis, control, optimization and applications, 1999, pp. 439–456. MR 1702974
work page 1999
-
[4]
Arapostathis, A
A. Arapostathis, A. Biswas, and G. Pang, Ergodic control of multi-class M/M/N + M queues in the Halfin-Whitt regime, Ann. Appl. Probab. 25 (2015), no. 6, 3511–3570. MR 3404643
2015
-
[6]
Arapostathis, G
A. Arapostathis, G. Pang, and N. Sandri´ c, Ergodicity of a L´ evy-driven SDE arising from multiclass ma ny-server queues, Ann. Appl. Probab. 29 (2019), no. 2, 1070–1126. MR 3910024
2019
-
[8]
P. Dai Pra, G. B. Di Masi, and B. Trivellato, Pathwise optimality in stochastic control , SIAM J. Control Optim. 39 (2000), no. 5, 1540–1557. MR 1825592
work page 2000
Show all 27 references
-
[9]
Dai Pra, W
P. Dai Pra, W. J. Runggaldier, and M. Tolotti, Pathwise optimality for benchmark tracking , IEEE Trans. Au- tomat. Control 49 (2004), no. 3, 386–395. MR 2062251
2004
-
[10]
Arapostathis, Some new results on sample path optimality in ergodic contro l of diffusions , IEEE Trans
A. Arapostathis, Some new results on sample path optimality in ergodic contro l of diffusions , IEEE Trans. Automat. Control 62 (2017), no. 10, 5351–5356. MR 3708911
2017
-
[11]
M. K. Ghosh, A. Arapostathis, and S. I. Marcus, Ergodic control of switching diffusions , SIAM J. Control Optim. 35 (1997), no. 6, 1952–1988. MR 1478649
1997
-
[12]
Arapostathis and G
A. Arapostathis and G. Pang, Infinite-horizon average optimality of the N-network in the Halfin-Whitt regime , Math. Oper. Res. 43 (2018), no. 3, 838–866. MR 3846075
2018
-
[13]
Arapostathis and G
A. Arapostathis and G. Pang, Infinite horizon asymptotic average optimality for large-s cale parallel server net- works, Stochastic Process. Appl. 129 (2019), no. 1, 283–322. MR 3906999
2019
-
[14]
Arapostathis, A
A. Arapostathis, A. Das, G. Pang, and Y. Zheng, Optimal control of Markov-modulated multiclass many-serv er queues, Stochastic Systems 9 (2019), no. 2, 155–181
2019
-
[15]
Arapostathis, G
A. Arapostathis, G. Pang, and Y. Zheng, Optimal scheduling of critically loaded multiclass many-s erver queues with service interruptions , ArXiv e-prints (to appear)
-
[16]
˘I. ¯I. G¯ihman and A. V. Skorohod, Stochastic differential equations , Springer-Verlag, New York-Heidelberg, 1972. Translated from the Russian by Kenneth Wickwire, Ergebniss e der Mathematik und ihrer Grenzgebiete, Band
1972
-
[17]
Gy¨ ongy and N
I. Gy¨ ongy and N. Krylov, Existence of strong solutions for Itˆ o’s stochastic equations via approximations , Probab. Theory Related Fields 105 (1996), no. 2, 143–158. MR 1392450
1996
-
[18]
A. V. Skorokhod, Asymptotic methods in the theory of stochastic differential e quations, Translations of Mathe- matical Monographs, vol. 78, American Mathematical Societ y, Providence, RI, 1989. Translated from the Russian by H. H. McFaden. MR 1020057
1989
-
[19]
Hmedi, A
H. Hmedi, A. Arapostathis, and G. Pang, On uniform stability of certain parallel server networks with no abandonment in the Halfin–Whitt regime , ArXiv e-prints 1907.04793 (2019), available at https://arxiv.org/abs/1907.04793
2019 arXiv
-
[20]
Arapostathis, H
A. Arapostathis, H. Hmedi, and G. Pang, On uniform exponential ergodicity of Markovian multi- class many-server queues in the Halfin-Whitt regime , ArXiv e-prints 1812.03528v1 (2018), available at https://arxiv.org/abs/1812.03528v1
2018 arXiv
-
[21]
Arapostathis, H
A. Arapostathis, H. Hmedi, G. Pang, and N. Sandri´ c, Uniform polynomial rates of convergence for a class of L´ evy-driven controlled SDEs arising in multiclass many-s erver queues (G. Yin and Q. Zhang, eds.), Modeling, Stochastic Control, Optimization, and Applications. The I...
2019
-
[22]
Echeverr ´ ıa,A criterion for invariant measures of Markov processes , Z
P. Echeverr ´ ıa,A criterion for invariant measures of Markov processes , Z. Wahrsch. Verw. Gebiete 61 (1982), no. 1, 1–16. MR 671239
1982
-
[23]
M. G. Garroni and J. L. Menaldi, Second order elliptic integro-differential problems , Chapman & Hall/CRC Research Notes in Mathematics, vol. 430, Chapman & Hall/CRC , Boca Raton, FL, 2002. MR 1911531
2002
-
[24]
C. W. Li, Lyapunov exponents of nonlinear stochastic differential equ ations with jumps , Stochastic inequalities and applications, 2003, pp. 339–351. MR 2073440
2003
-
[25]
Gilbarg and N
D. Gilbarg and N. S. Trudinger, Elliptic partial differential equations of second order , Second, Grundlehren der Mathematischen Wissenschaften, vol. 224, Springer-Verla g, Berlin, 1983. MR 737190
1983
-
[26]
Arapostathis, M
A. Arapostathis, M. K. Ghosh, and S. I. Marcus, Harnack’s inequality for cooperative weakly coupled ellip tic systems, Comm. Partial Differential Equations 24 (1999), no. 9-10, 1555–1571. MR 1708101
1999
-
[27]
Ichihara and S.-J
N. Ichihara and S.-J. Sheu, Large time behavior of solutions of Hamilton-Jacobi-Bellm an equations with quadratic nonlinearity in gradients , SIAM J. Math. Anal. 45 (2013), no. 1, 279–306. MR 3032978
2013
Reviewed August 14, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.