Sensing-Limited Control Under Non-Designable Observation Mechanisms
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel 2026-07-01 04:18 UTCgrok-4.3pith:SCFBZOP2record.jsonopen to challenge →
The pith
For linear systems with fixed sensing, the directed information rate from unstable states to observations must exceed the open-loop expansion rate of unstable modes to achieve mean-square observability and stabilizability.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central claim is that mean-square observability and stabilizability of noiseless linear systems under non-designable observations are possible only when the directed information rate from the unstable state process to the observation process is at least as large as the open-loop expansion rate of the unstable modes; the same lower bound holds with additive disturbances, and an entropy-to-error relation converts a strict surplus into vanishing estimation-error covariance, thereby giving sufficient conditions via certainty equivalence.
What carries the argument
The directed information rate from the unstable state process to the observation process, which must dominate the open-loop expansion rate of the unstable modes and, via an entropy-to-error bridge, forces posterior uncertainty to collapse when the surplus is strict.
If this is right
- The lower bound on the unstable-state directed information rate is necessary for mean-square observability even when process noise is present.
- The full-state directed information rate supplies an exact, computable upper bound that yields necessary conditions in the linear-Gaussian setting.
- Under posterior regularity, a strict information surplus plus certainty-equivalence control yields asymptotic mean-square stabilizability.
- Classical communication-constrained limits must be reinterpreted when the sensing interface itself cannot be designed.
Where Pith is reading between the lines
- The same information-rate threshold may serve as a quick feasibility check for any linear plant whose sensor map is fixed in advance rather than optimized.
- Because the bound survives additive disturbances, it could be used to decide whether a given sensor suite is adequate before controller design begins.
- The entropy-to-error bridge suggests that similar collapse arguments might apply to other performance metrics once a suitable information measure is identified.
Load-bearing premise
A strict surplus of directed information over the expansion rate forces the posterior uncertainty to collapse and the estimation error covariance to zero.
What would settle it
A linear system and observation mechanism where the directed information rate from the unstable state exceeds the expansion rate yet the estimation error covariance fails to converge to zero, or where the rate is strictly below the expansion rate yet the covariance converges to zero.
Figures
read the original abstract
We study the information-theoretic limits of controlling unstable linear systems through non-designable observation mechanisms. Unlike classical communication-constrained control, the information bottleneck lies in the observation mechanism rather than in a designable encoder-channel interface. For noiseless linear dynamics, we derive necessary conditions for mean-square observability and stabilizability, showing that the directed information rate from the unstable state process to the observation process must dominate the open-loop expansion rate of the unstable modes. We further show that this lower bound persists under additive process disturbances. In the Linear-Gaussian setting, although the unstable-state directed information rate remains intractable in closed form, we obtain an exact characterization of the full-state directed information rate, which upper-bounds the unstable-state quantity and yields computable necessary conditions. Under suitable posterior regularity conditions, we also establish sufficient conditions for asymptotic mean-square observability and, via certainty-equivalence control, asymptotic mean-square stabilizability. The key step is an entropy-to-error bridge: a strict surplus in directed information over the expansion rate forces posterior uncertainty to collapse and thereby drives the estimation error covariance to zero. These results identify a fundamental feasibility boundary for sensing-limited control and clarify how classical communication-based limits must be reinterpreted when the sensing interface is non-designable.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper claims that for noiseless linear dynamics under non-designable observation mechanisms, the directed information rate from the unstable state process to the observation process must dominate the open-loop expansion rate of the unstable modes to achieve mean-square observability and stabilizability. This lower bound persists under additive process disturbances. In the linear-Gaussian case, an exact characterization of the full-state directed information rate is obtained as an upper bound yielding computable necessary conditions. Under posterior regularity conditions, sufficient conditions for asymptotic mean-square observability and stabilizability (via certainty equivalence) are established through an entropy-to-error bridge asserting that a strict information surplus forces posterior uncertainty collapse and error covariance to zero.
Significance. If the central claims hold, the work would identify a fundamental feasibility boundary for sensing-limited control of unstable systems, extending classical directed-information results to settings where the observation map is fixed and non-designable rather than a designable encoder-channel pair. The persistence of the bound under disturbances and the intrinsic (non-fitted) nature of the open-loop expansion rate as the lower bound are notable strengths. The linear-Gaussian upper-bound characterization also supplies a concrete computational pathway for necessary conditions.
major comments (1)
- [sufficient conditions / entropy-to-error bridge paragraph] The entropy-to-error bridge (invoked for the sufficient conditions) is load-bearing: the manuscript states that a strict surplus of directed information over the expansion rate forces posterior uncertainty to collapse, driving the estimation error covariance to zero under the stated posterior regularity conditions. Because the observation mechanism is non-designable and fixed, it is not immediate that these regularity conditions convert the surplus into covariance collapse for every admissible mechanism; any gap here would invalidate the certainty-equivalence stabilizability claim. Derivation details of this step are unavailable for verification.
Simulated Author's Rebuttal
We thank the referee for the careful reading, positive summary, and identification of the entropy-to-error bridge as central to the sufficient conditions. We address the major comment below.
read point-by-point responses
-
Referee: [sufficient conditions / entropy-to-error bridge paragraph] The entropy-to-error bridge (invoked for the sufficient conditions) is load-bearing: the manuscript states that a strict surplus of directed information over the expansion rate forces posterior uncertainty to collapse, driving the estimation error covariance to zero under the stated posterior regularity conditions. Because the observation mechanism is non-designable and fixed, it is not immediate that these regularity conditions convert the surplus into covariance collapse for every admissible mechanism; any gap here would invalidate the certainty-equivalence stabilizability claim. Derivation details of this step are unavailable for verification.
Authors: We agree that the entropy-to-error bridge is load-bearing for the sufficient conditions and that its justification must hold uniformly for non-designable mechanisms. The derivation (Section 4) proceeds by showing that a strict directed-information surplus implies that the conditional entropy rate of the state given observations is strictly negative relative to the open-loop expansion rate. Under the stated posterior regularity conditions (absolute continuity of the posterior with uniformly bounded second moments of the log-density), standard entropy-to-variance inequalities then force the posterior covariance to decay to zero. These regularity conditions are formulated as properties of the posterior process and are required to hold for every admissible observation map; the proof does not rely on designability. That said, the referee is correct that the explicit chaining of the rate inequality to covariance collapse is not expanded in full detail. We will revise the manuscript to insert an expanded lemma (with all intermediate inequalities) in the appendix, making the uniform applicability explicit and thereby supporting the certainty-equivalence stabilizability claim. revision: yes
Circularity Check
No circularity; derivation uses intrinsic dynamics and standard information rates without reduction to inputs
full rationale
The necessary conditions follow from directed-information inequalities exceeding the open-loop sum of unstable log-eigenvalues, an intrinsic property of the linear dynamics matrix rather than any fitted or self-defined quantity. The linear-Gaussian full-state directed information rate is characterized exactly and used only as an upper bound on the unstable-state rate. The entropy-to-error bridge for sufficient conditions is stated as a derived implication under explicit posterior regularity assumptions, with no evidence of self-citation chains, ansatz smuggling, or renaming of known results as new predictions. The paper remains self-contained against external benchmarks.
Axiom & Free-Parameter Ledger
axioms (3)
- domain assumption System dynamics are linear (noiseless or with additive process noise)
- standard math Directed information rate is well-defined and comparable to the open-loop expansion rate
- domain assumption Posterior regularity conditions hold
Reference graph
Works this paper leans on
-
[1]
W. S. Wong and R. W. Brockett, “Systems with finite communication bandwidth constraints. ii. stabilization with limited information feed- back,”IEEE Trans. Autom. Control, vol. 44, no. 5, pp. 1049–1053, 1999
work page 1999
-
[2]
Quantized feedback stabilization of linear systems,
R. W. Brockett and D. Liberzon, “Quantized feedback stabilization of linear systems,”IEEE Trans. Autom. Control, vol. 45, no. 7, pp. 1279– 1289, 2000
work page 2000
-
[3]
Stabilization of linear systems with limited information,
N. Elia and S. K. Mitter, “Stabilization of linear systems with limited information,”IEEE Trans. Autom. Control, vol. 46, no. 9, pp. 1384– 1400, 2001
work page 2001
-
[4]
On stabilization of linear systems with limited informa- tion,
D. Liberzon, “On stabilization of linear systems with limited informa- tion,”IEEE Trans. Autom. Control, vol. 48, no. 2, pp. 304–307, Mar. 2003
work page 2003
-
[5]
Control under communication constraints,
S. Tatikonda and S. Mitter, “Control under communication constraints,” IEEE Trans. Autom. Control, vol. 49, no. 7, pp. 1056–1068, July 2004
work page 2004
-
[6]
——, “Control over noisy channels,”IEEE Trans. Autom. Control, vol. 49, no. 7, pp. 1196–1201, July 2004
work page 2004
-
[7]
Stabilizability of stochastic linear systems with finite feedback data rates,
G. N. Nair and R. J. Evans, “Stabilizability of stochastic linear systems with finite feedback data rates,”SIAM J. Control Optim., vol. 43, pp. 413–436, July 2004
work page 2004
-
[8]
Stochastic stabilization of noisy linear systems with fixed- rate limited feedback,
S. Y ¨uksel, “Stochastic stabilization of noisy linear systems with fixed- rate limited feedback,”IEEE Trans. Autom. Control, vol. 55, no. 12, pp. 2847–2853, 2010
work page 2010
-
[9]
Stochastic linear control over a communication channel,
S. Tatikonda, A. Sahai, and S. Mitter, “Stochastic linear control over a communication channel,”IEEE Trans. Autom. Control, vol. 49, no. 9, pp. 1549–1561, Sept. 2004
work page 2004
-
[10]
Evaluating channels for control: Capacity reconsidered,
A. Sahai, “Evaluating channels for control: Capacity reconsidered,” in Proc. Amer. Control Conf., June 2000, pp. 2358–2362
work page 2000
-
[11]
——, “Anytime information theory,” Ph.D. dissertation, Massachusetts Institute of Technology, Cambridge, MA, Feb. 2001
work page 2001
-
[12]
Feedback sta- bilization over signal-to-noise ratio constrained channels,
J. H. Braslavsky, R. H. Middleton, and J. S. Freudenberg, “Feedback sta- bilization over signal-to-noise ratio constrained channels,”IEEE Trans. Autom. Control, vol. 52, no. 8, pp. 1391–1403, Aug. 2007
work page 2007
-
[13]
Feedback control under data rate constraints: An overview,
G. N. Nair, F. Fagnani, S. Zampieri, and R. J. Evans, “Feedback control under data rate constraints: An overview,”Proc. IEEE, vol. 95, no. 1, pp. 108–137, Jan. 2007
work page 2007
-
[14]
Control with limited information,
S. K. Mitter, “Control with limited information,”European Journal of Control, vol. 7, no. 2–3, pp. 122–131, 2001
work page 2001
-
[15]
S. Y ¨uksel and T. Bas ¸ar,Stochastic Networked Control Systems: Stabi- lization and Optimization under Information Constraints. Boston, MA: Birkh¨auser, 2013
work page 2013
-
[16]
Rate-cost tradeoffs in control,
V . Kostina and B. Hassibi, “Rate-cost tradeoffs in control,”IEEE Trans. Autom. Control, vol. 64, no. 11, pp. 4525–4540, Nov. 2019
work page 2019
-
[17]
Causality, feedback and directed information,
J. L. Massey, “Causality, feedback and directed information,” inProc. Int. Symp. Inf. Theory Appl. (ISITA), Hawaii, USA, Nov. 1990
work page 1990
-
[18]
Directed information on abstract spaces: Properties and variational equalities,
C. D. Charalambous and P. A. Stavrou, “Directed information on abstract spaces: Properties and variational equalities,”IEEE Trans. Inf. Theory, vol. 62, no. 11, pp. 6019–6052, Nov. 2016
work page 2016
-
[19]
On the structure of real-time source coders,
H. S. Witsenhausen, “On the structure of real-time source coders,”Bell Syst. Tech. J., vol. 58, no. 6, pp. 1437–1451, July–Aug. 1979
work page 1979
-
[20]
Optimal causal coding-decoding prob- lems,
J. C. Walrand and P. Varaiya, “Optimal causal coding-decoding prob- lems,”IEEE Trans. Inf. Theory, vol. 29, no. 6, pp. 814–820, Nov. 1983
work page 1983
-
[21]
Nonanticipative rate distortion function and relations to filtering theory,
C. D. Charalambous, P. A. Stavrou, and N. U. Ahmed, “Nonanticipative rate distortion function and relations to filtering theory,”IEEE Trans. Autom. Control, vol. 59, no. 4, pp. 937–952, Apr. 2014
work page 2014
-
[22]
M. S. Derpich and J. Østergaard, “Improved upper bounds to the causal quadratic rate-distortion function for gaussian stationary sources,”IEEE Trans. Inf. Theory, vol. 58, no. 5, pp. 3131–3152, May 2012
work page 2012
-
[23]
The entropy per coordinate of a random vector is highly constrained under convexity conditions,
S. Bobkov and M. Madiman, “The entropy per coordinate of a random vector is highly constrained under convexity conditions,”IEEE Trans. Inf. Theory, vol. 57, no. 8, pp. 4940–4954, Aug. 2011. 16
work page 2011
-
[24]
Reverse Brunn–Minkowski and reverse entropy power inequal- ities for convex measures,
——, “Reverse Brunn–Minkowski and reverse entropy power inequal- ities for convex measures,”J. Funct. Anal., vol. 262, no. 7, pp. 3309– 3339, Apr. 2012
work page 2012
-
[25]
Sensing-Limited Control of Noiseless Linear Systems Under Nonlinear Observations
M. Li, F. Liu, Y . Xiong, J. Xu, and T. Liu, “Sensing-limited control of noiseless linear systems under nonlinear observations,”arXiv preprint arXiv:2601.12782, 2026
work page internal anchor Pith review Pith/arXiv arXiv 2026
-
[26]
E. F. Beckenbach and R. Bellman,Inequalities, ser. Ergebnisse der Mathematik und ihrer Grenzgebiete. 2. Folge. Berlin, Heidelberg: Springer, 1961
work page 1961
-
[27]
B. D. O. Anderson and J. B. Moore,Optimal filtering. Courier Corporation, 2005
work page 2005
-
[28]
Noise estimation from a single image,
C. Liu, R. Szeliski, S. B. Kang, C. L. Zitnick, and W. T. Freeman, “Noise estimation from a single image,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2006, pp. 901–908
work page 2006
-
[29]
Nonlinear camera response functions and image deblurring: Theoretical analysis and practice,
Y .-W. Tai, X. Chen, S. Kim, S. J. Kim, F. Li, J. Yang, J. Yu, Y . Mat- sushita, and M. S. Brown, “Nonlinear camera response functions and image deblurring: Theoretical analysis and practice,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 10, pp. 2498– 2512, 2013
work page 2013
-
[30]
Recovering high dynamic range radiance maps from photographs,
P. E. Debevec and J. Malik, “Recovering high dynamic range radiance maps from photographs,” inProceedings of SIGGRAPH, 1997, pp. 369– 378
work page 1997
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.