Infinite Horizon Optimal Control Problems with Discount Factors
Pith reviewed 2026-05-09 21:27 UTC · model grok-4.3
The pith
Allowing different discount factors for the cost and state enables first- and second-order optimality conditions for infinite-horizon control of semilinear parabolic equations.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The paper derives first-order optimality conditions using the adjoint equation and a variational inequality. For second-order conditions, it shows that the quadratic form in the second variation must account for the differing discounts to ensure positivity under the given nonlinearities. Additionally, the infinite-horizon problem is shown to be the limit of finite-horizon problems as the horizon tends to infinity, with a proven rate of convergence for the optimal values and controls.
What carries the argument
The objective functional with independently chosen exponential discount factors for the running cost and the state penalty term.
Load-bearing premise
The nonlinearities in the semilinear parabolic state equation are of a form that requires the discount factor on the state to differ from the one on the cost in order for second-order sufficient conditions to hold.
What would settle it
A concrete example of the semilinear parabolic equation and cost where equal discount factors are used and the second variation of the cost at a first-order stationary point is found to be negative.
read the original abstract
This paper is dedicated to the analysis of infinite horizon optimal control problems subject to semilinear parabolic equations with constraints on the controls and discounted cost functionals. The discount factors on the cost and the state components are allowed to differ from each other. First-order as well as second-order optimality conditions are derived and the importance of allowing different discount factors for the second-order analysis for the class of nonlinearities under consideration is demonstrated. Finally convergence and rate of convergence for the approximation of the infinite horizon problem by a family of finite horizon problems is proven.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript analyzes infinite-horizon optimal control problems governed by semilinear parabolic PDEs subject to control constraints and discounted cost functionals, where distinct discount factors are permitted for the cost and state components. It derives first-order and second-order optimality conditions, demonstrates that equal discount factors are insufficient for valid second-order conditions under the considered class of nonlinearities, and proves convergence together with convergence rates for the approximation of the infinite-horizon problem by a family of finite-horizon truncations.
Significance. If the derivations hold, the work supplies a technically sound extension of optimality theory for infinite-horizon parabolic control problems. The explicit allowance for unequal discount factors addresses a concrete obstruction in the second variation for the given nonlinearities, while the convergence result with rates furnishes a rigorous justification for numerical truncation. These elements strengthen the applicability of infinite-horizon formulations in PDE-constrained optimization.
minor comments (2)
- [§3] The statement of the admissible control set and the precise growth conditions on the nonlinearity (presumably in §2 or §3) should be cross-referenced explicitly when the second-order remainder term is estimated, to make the necessity of distinct discount factors fully transparent without backtracking.
- [§5] In the convergence proof, the dependence of the rate constant on the discount factors should be stated explicitly (e.g., in the final estimate of Theorem 5.3 or its analogue) rather than left implicit in the stability constants.
Simulated Author's Rebuttal
We thank the referee for the careful reading of our manuscript and the positive assessment, including the recommendation for minor revision. The summary accurately captures the main contributions regarding first- and second-order optimality conditions for infinite-horizon problems with possibly distinct discount factors, as well as the convergence analysis for finite-horizon approximations.
Circularity Check
No significant circularity
full rationale
The derivation proceeds from standard first- and second-order optimality conditions for semilinear parabolic control problems, with the allowance for distinct discount factors introduced explicitly as a modeling choice to control quadratic remainders in the second variation. The convergence result for finite-horizon approximations follows from stability estimates once the optimality conditions are established. No step reduces by construction to a fitted parameter, self-definition, or self-citation chain; the central claims remain independent of the paper's own inputs.
Axiom & Free-Parameter Ledger
axioms (2)
- domain assumption The semilinear parabolic state equation admits unique solutions in appropriate function spaces under the given control constraints.
- domain assumption The discount factors are positive real numbers so that the infinite-horizon cost integrals converge.
Reference graph
Works this paper leans on
-
[1]
S. M. Aseev and A. V. Kryazhimskiy. The Pontryagin maximum principle and transver- sality conditions for a class of optimal control problems with infinite time horizons.SIAM J. Control Optim., 43(3):1094–1119, 2004
work page 2004
-
[2]
S. M. Aseev and V. M. Veliov. Maximum principle for infinite-horizon optimal control problems with dominating discount.Dynamics of Continuous, Discrete and Impulsive Systems, Series B, 19(1–2):43–63, 2012
work page 2012
-
[3]
V. Basco. Control problems on infinite horizon subject to time-dependent pure state constraints.Mathematics of Control, Signals, and Systems, 36:423–450, 2024. Published online 2023
work page 2024
- [4]
-
[5]
F. Bonnans. Second-order analysis for control constrained optimal control problems of semilinear elliptic systems.Appl. Math. Optim., 38:305–325, 1998
work page 1998
-
[6]
F. Boyer and P. Fabrie.Mathematical Tools for the Study of the Incompressible Navier- Stokes Equations and Related Models. Springer, New York, 2013
work page 2013
-
[7]
T. Breiten, K. Kunisch, and L. Pfeiffer. Taylor expansions of the value function associated with a bilinear optimal control problem.Ann. Inst. H. Poincar´ e Anal. Non Lin´ eaire, 36(5):1361–1399, 2019
work page 2019
-
[8]
D.A. Carlson, A.B. Haurie, and A. Leizarowitz.Infinite horizon optimal control. De- terministic and stochastic systems. Springer-Verlag, Berlin, 1991. Second revised and enlarged edition of the 1987 original
work page 1991
-
[9]
E. Casas and K. Kunisch. Stabilization by sparse controls for a class of semilinear parabolic equations.SIAM J. Control Optim., 55(1):512–532, 2017
work page 2017
-
[10]
E. Casas and K. Kunisch. Infinite horizon optimal control problems for a class of semilinear parabolic equations.SIAM J. Control Optim., 60(4):2070–2094, 2022
work page 2070
-
[11]
E. Casas and K. Kunisch. Infinite horizon optimal control for a general class of semilinear parabolic equations.Appl. Math. Optim., 88, Paper No. 47:36, 2023
work page 2023
-
[12]
E. Casas and K. Kunisch. Infinite horizon optimal control problems with discount factor on the state. Part II: Analysis of the control problem.SIAM J. Control Optim., 61(3):1438– 1459, 2023
work page 2023
-
[13]
E. Casas and K. Kunisch. Space-timeL ∞-estimates for solutions of infinite horizon semi- linear parabolic equations.Commun. Pure Appl. Annal., 24(4):482–506, 2025
work page 2025
-
[14]
E. Casas and K. Kunisch. Optimality conditions for infinite horizon control problems under detectability and stabilizability assumptions.SIAM Journal on Control and Optimization, 64(1):472–495, 2026
work page 2026
-
[15]
E. Casas and F. Tr¨ oltzsch. Second order analysis for optimal control problems: Improving results expected from abstract theory.SIAM J. Optim., 22(1):261–279, 2012. Infinite Horizon Optimal Control Problems40
work page 2012
-
[16]
E. Casas and D. Wachsmuth. A note on existence of solutions to control problems of semilinear partial differential equations.SIAM J. Control Optim., 61(3):1095–1112, 2023
work page 2023
-
[17]
R. Dautray and J.L. Lions.Mathematical Analysis and Numerical Methods for Science and Technology, volume 5. Springer-Verlag, Berlin-Heidelberg-New York, 2000
work page 2000
-
[18]
H. Halkin. Necessary conditions for optimal control problems with infinite horizons. Econometrica, 42(2):267–272, 1974
work page 1974
-
[19]
O.A. Ladyzhenskaya, V.A. Solonnikov, and N.N. Ural’tseva.Linear and Quasilinear Equa- tions of Parabolic Type. American Mathematical Society, Providence, 1988
work page 1988
-
[20]
Lions.Optimal control of systems governed by partial differential equations
J.-L. Lions.Optimal control of systems governed by partial differential equations. Die Grundlehren der mathematischen Wissenschaften, Band 170. Springer-Verlag, New York- Berlin, 1971. Translated from the French by S. K. Mitter
work page 1971
-
[21]
S. S. Rodrigues. Semiglobal exponential stabilization of nonautonomous semilinear parabolic-like systems.Evolution Equations and Control Theory, 9(4):1111–1143, 2020
work page 2020
-
[22]
R. E. Showalter.Monotone Operators in Banach Space and Nonlinear Partial Differen- tial Equations, volume 49 ofMath. Surv. and Monogr.American Mathematical Society, Providence, RI, 1997
work page 1997
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.