REVIEW 3 major objections 6 minor 46 references
Expressivity of bisimulation pseudometrics over analytic state spaces
T0 review · 3 major / 6 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read For continuous Markov decision processes, behavioral distance is exactly logical distance: the paper proves a quantitative Hennessy–Milner theorem for MDPs over analytic state spaces.
desk verdict A substantial new expressivity result for bisimulation pseudometrics on continuous MDPs, slowed by one unproved coupling-lifting step in Theorem 28. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The machinery has three load-bearing pieces. First, a fibration of predicates over analytic spaces: $\mathrm{Pred}(X)$ is the set of universally measurable functions $X\to[0,1]$, and $\mathrm{lsPred}(X)$ is the subfibration of lower semi-measurable functions; the direct-image left adjoint exists for Suslin-level predicates, which is what makes the coupling-based lifting possible. Second, the distance lifting $\sigma_{\mathrm{MDP}}$ built from the Wasserstein lifting of the Giry functor, $\hat\sigma(d)(m,n)=\inf_{c\in K(m,n)}\int d\,dc$, composed with reward differences by a convex combination with parameter $c$. Third, the theory map $qTh:X\to [0,1]^L$ sending each state to its vector of formula values; topologisability of $qTh$ lets the proof restrict attention to a standard subspace $A\subseteq [0,1]^L$ and apply Stone–Weierstrass to approximate short predicates by formulas. The chain is: push the logical distance along the theory map, apply Kantorovich–Rubinstein duality to rewrite the Wasserstein cost as a supremum over short predicates, then approximate those predicates by modal formulas.
What would settle it
To refute the expressivity half, one would exhibit an analytic-space MDP, two states $x$ and $y$, an action $a$, and a discount $c$ for which the pushforward measures $qTh_*(m_{x,a})$ and $qTh_*(m_{y,a})$ admit a coupling that is not the image of any coupling of $m_{x,a}$ and $m_{y,a}$; then the step equating equations (14) and (15) collapses, and one can check directly whether $\mathrm{bd}_c(x,y)>dL_c(x,y)$. Equivalently, a pair of states with identical values on every formula of $L$ but with positive bisimulation distance would refute Corollary 31.
Extended reading notes
Core claim
The paper's central claim is that the behavioral distance on a continuous MDP is fully captured by a quantitative modal logic. Concretely, for an MDP coalgebra $\gamma:(X,\mathcal{A})\to B_{\mathrm{MDP}}(X,\mathcal{A})$ in the category of analytic spaces, with language $L$ generated by truth, negation, conjunction, scalar addition and subtraction $\_+r$, $\_-r$ with $r\in[0,1]$, and a diamond modality $\Diamond_a$ for each action $a$, the bisimulation pseudometric $\mathrm{bd}_c$, defined as the least fixed point of $\gamma\circ\sigma_{\mathrm{MDP}}$ with discount $c$, equals the logical distance $dL_c(x,y)=\sup_{\varphi\in L}|\varphi(x)-\varphi(y)|$. Adequacy ($\mathrm{bd}\ge dL$) holds whenever the function symbols are interpreted as nonexpansive functions; expressivity ($\mathrm{bd}\le dL$) requires perfect transition measures, a topologisable theory map, and scalar addition in the signature. The proof combines Kantorovich–Rubinstein duality for perfect measures with a Stone–Weierstrass lemma over the compact-open topology on the space of formulas.
Load-bearing premise
The equality between the bisimulation distance and the logical distance relies on a lifting step: it assumes that whenever the formula-profiles of two states' transition probabilities are paired, that paired profile really comes from pairing the two original random transitions; the paper cites a regularity theorem for this step but gives no proof.
Editorial extensions
If this is right
- If Corollary 31 is correct, the bisimulation pseudometric on continuous MDPs is determined by formula evaluations: two states are $\varepsilon$-close behaviorally exactly when no formula of $L$ separates them by more than $\varepsilon$.
- Because the equality holds for every $c\in[0,1]$, the discount factor may be set to $0$ or $1$, covering purely reward-based and purely transition-based comparisons, which the contraction-based definition of the earlier bisimulation metric could not handle.
- Adequacy holds for any language whose function symbols are nonexpansive, so adding operators such as scalar multiplication or convex combination preserves $\mathrm{bd}\ge dL$; expressivity then follows whenever the theory map is topologisable.
- The alternative language with a separate reward modality and expected-transition modality is shown to be expressive but not adequate, because truncated addition is not nonexpansive; this explains why the paper's single diamond modality, which mixes the transition expectation and the reward, is needed.
- Since the least fixed point is obtained by Kleene iteration, the definition of $\mathrm{bd}_c$ does not rely on the transition kernel being a contraction, which broadens the class of MDPs for which the metric is defined.
Reading between the lines
- Beyond the paper's claims: if $\mathrm{bd}_c=dL_c$ is stable under Lipschitz embeddings, then representation-learning pipelines that map states to formula-value vectors preserve behavioral distances up to the Lipschitz constant; this would give a formal justification for using logical features as state encodings in continuous MDPs.
- The unproved disintegration step suggests a targeted stress test: exhibit two perfect measures on an analytic space whose theory-pushforwards admit a coupling that is not the image of any coupling of the original measures; such an example would isolate where the Stone–Weierstrass approximation argument needs a regularity condition beyond analyticity.
- A natural extension, which the authors list as future work, would be to replace the compact-open topology on the formula space with a measurable Stone–Weierstrass theorem; if such a theorem existed, the topologisability assumption could likely be dropped from Theorem 28.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper develops bisimulation pseudometrics for Markov reward processes and Markov decision processes whose state spaces are analytic measurable spaces, viewed as coalgebras in the category Ana. The metric is defined as the least fixed point of a functional built from a coupling-based Wasserstein lifting, formalized through a fibration of universally measurable predicates. The paper then introduces a quantitative modal logic with truth, conjunction, negation, scalar addition and subtraction, and one diamond per action; the diamond semantics is a convex combination of the expected value of the formula and the action reward. The main claim, Corollary 31, is that for every MDP in Ana and every discount factor c in [0,1], the bisimulation pseudometric equals the logical distance induced by this language, i.e. a quantitative Hennessy-Milner theorem. Adequacy is proved in Theorem 22, and expressivity is attacked through a general theorem (Theorem 28) assuming topologisability of the theory map and perfectness of the transition measures.
Significance. If the main theorem is correct, this is a valuable contribution to the quantitative coalgebraic semantics of continuous-state MDPs: it replaces Polish-space assumptions with analytic measurable spaces, works with universally measurable predicates rather than lower semi-continuous ones, and provides an expressive quantitative modal logic. The categorical framework, based on two fibrations and a coupling-based lifting, is original, and the adequacy proof is clean and well structured. The paper also gives a self-contained treatment of Kantorovich-Rubinstein duality for perfect measures, which is of independent interest. However, the expressivity proof contains a load-bearing unproved equality of coupling infima and a separate algebraic inconsistency with the discount factor, and the proof of Theorem 13 uses a semicontinuity claim that is not correct as written. These issues are substantial but appear repairable within the manuscript's scope.
major comments (3)
- [Theorem 28, Eq. (14) to Eq. (15)] The equality of the infimum over couplings of m_{x,a}, m_{y,a} of the integral of dL with the infimum over couplings of their pushforwards along qTh of the integral of d~L is asserted without proof. One inequality is immediate: every coupling of the original measures pushes forward to a coupling of the pushforward measures with the same cost. The reverse direction requires a coupling-lifting lemma: every coupling of qTh_*m_{x,a} and qTh_*m_{y,a} must be obtainable as the pushforward of some coupling of m_{x,a} and m_{y,a}. This is equivalent to the existence of regular conditional distributions of the transition measures along qTh. The parenthetical citation of [18, Thm. 6] does not by itself establish this lifting, and no such lemma is stated or proved in the paper. Since the subsequent argument bounds the pushforward infimum, the direction bd <= dL depends on this step. Please add a complete proof of the equality (or of the needed inequality direction) and verify the required measurability and regularity conditions.
- [Theorem 13, proof using Sion's minimax theorem] In the proof of Theorem 13, the function f(x,c) = c(d~_x), with d~_x = d_i for x in [i,i+1), is claimed to be upper semicontinuous in x. With the usual topology on [0,Infinity), the preimage f(.,c)^{-1}([0,r)) is a union of half-open intervals of the form [i,i+1), which is not open in general. For example, if c(d_0) >= r and c(d_1) < r, then the point 1 belongs to the preimage but no neighbourhood of 1 is contained in it. Thus the hypotheses of Sion's minimax theorem (Lemma 44) are not satisfied as written. Since Theorem 13 is used both for the existence of the least fixed point (Corollary 16) and in the reduction at the start of the proof of Theorem 28, this proof needs to be repaired or replaced by a valid argument.
- [Theorem 28, Eqs. (14) and (18), discount-factor algebra] The discount factor is handled inconsistently in the proof of Theorem 28. Lemma 11 gives sigmaMRP_X(d)((m,r),(n,s)) = c * inf_{kappa in K(m,n)} integral d dkappa + (1-c)|r-s|, but Eq. (14) writes the expression as inf over couplings of integral dL dc + c r^a_xy, dropping the leading factor c on the coupling term and replacing the reward coefficient 1-c by c. Moreover, the manipulation in Eq. (18), from sup_phi integral JphiK d(m_{x,a}-m_{y,a}) + c r^a_xy to sup_phi (integral JphiK dm_{x,a} + c r^x_a) - (integral JphiK dm_{y,a} + c r^y_a), is not algebraically valid when r^a_xy = |r^x_a - r^y_a|; the right-hand side can be smaller by 2c|r^x_a - r^y_a|. This makes the chain of inequalities leading to (13) impossible to follow as written and must be corrected.
minor comments (6)
- [Theorem 28, Eq. (15)] The second pushforward measure is written as qTh(m_{y,a}); it should be qTh_*(m_{y,a}).
- [Theorem 28, notation] The same symbol c is used both for the discount factor and for an arbitrary coupling in Eqs. (14) and (15); please use different letters, e.g. kappa for couplings, to avoid ambiguity.
- [Reference [4]] The companion paper [4] is cited for the fact that the predicate lifting improves universally measurable predicates to Borel predicates, but it is listed as an unpublished manuscript with a placeholder arXiv number. Since this fact is used in the main development, the proof should be included in the appendix or the companion should be made publicly available.
- [Lemma 30] The sentence 'Recalling that [0,1] is compact, thus the assumptions of Theorem 29 are fulfilled' is terse; it would be clearer to state explicitly that the relevant index sets are [0,1] with the usual topology and the countable set Sigma with the discrete topology, both second countable Hausdorff.
- [Appendix G.2, proof of Lemma 27] The measurability argument for the function h defined as an infimum over y is compressed into the sentence 'g is nothing but exists_{pr1}(lambda xy. d(x,y)-g(y))'; a few more details or a reference would help the reader verify this step.
- [Reference [4] title] The title of reference [4] contains a typo: 'Henneysey-milner' should be 'Hennessy-Milner'.
Circularity Check
No significant circularity: bd_c and dL are independently defined; the equality is a proved least-fixpoint/Stone-Weierstrass theorem, and the only self-citation [4] is redundant with Appendix Corollary 43.
full rationale
The derivation is not circular. bd_c is the least fixed point of gamma o sigma_MDP (Corollary 16), while dL is the supremum over formulae (Definition 17, Eq. 9); the diamond clause (Eq. 7) reuses the same discount c and the transition/reward data, but that shared syntax is exactly what adequacy requires and does not define bd in terms of dL. The main equality bd = dL (Corollary 31) is obtained by showing dL is a fixed point (Theorem 28) and invoking the least-fixed-point property, a substantive argument using Kantorovich-Rubinstein duality and Stone-Weierstrass. There are no fitted parameters and no data-driven predictions, and c appears symmetrically on both sides. The only self-citation is [4] for the fact that predicate lifting sends universally measurable predicates to Borel predicates; the same fact is proved in the appendix (Corollary 43), so the citation is redundant and not load-bearing. The reviewer-flagged gap at Eqs. (14)-(15) — replacing inf over couplings of m_{x,a}, m_{y,a} by inf over couplings of their pushforwards along qTh — is a missing disintegration lemma (the parenthetical '[18, Thm. 6]' is not a proof of lifting arbitrary pushforward couplings), and is a correctness concern, not a circularity: it does not presuppose bd <= dL or the equality to be proved. Hence no circular step can be exhibited; score 2 only for the minor redundant self-citation.
Assumptions & free parameters
assumptions (5)
- domain assumption The working state spaces are analytic spaces, i.e., the category Ana is used instead of all measurable spaces.
- domain assumption Probability measures on analytic spaces are perfect.
- domain assumption Regular conditional distributions exist for perfect measures on analytic spaces along countably generated maps, and every coupling of pushforward measures can be lifted to a coupling of the original measures.
- standard math Sion's minimax theorem, Banach-Alaoglu theorem, and the Riesz-Markov-Kakutani representation theorem for finitely additive measures.
- standard math Stone-Weierstraß theorem for compact R2 spaces.
Cite this review
Pith. "Pith review of Expressivity of bisimulation pseudometrics over analytic state spaces." pith.science (2026). https://pith.science/paper/GISTROAV
@misc{pith2026250523635,
author = {Pith},
title = {Pith review of: Expressivity of bisimulation pseudometrics over analytic state spaces},
year = {2026},
howpublished = {\url{https://pith.science/paper/GISTROAV}},
note = {Machine review of arXiv:2505.23635}
}
read the original abstract
A Markov decision process (MDP) is a state-based dynamical system capable of describing probabilistic behaviour with rewards. In this paper, we view MDPs as coalgebras living in the category of analytic spaces, a very general class of measurable spaces. Note that analytic spaces were already studied in the literature on labelled Markov processes and bisimulation relations. Our results are twofold. First, we define bisimulation pseudometrics over such coalgebras using the framework of fibrations. Second, we develop a quantitative modal logic for such coalgebras and prove a quantitative form of Hennessy-Milner theorem in this new setting stating that the bisimulation pseudometric corresponds to the logical distance induced by modal formulae.
Reference graph
Works this paper leans on
-
[1]
Abstract and concrete categories: The joy of cats, 2004
Ji r \' Ad \'a mek, Horst Herrlich, and George Strecker. Abstract and concrete categories: The joy of cats, 2004. URL: http://katmat.math.uni-bremen.de/acc/
work page 2004
-
[2]
Robert B. Ash. Real analysis and probability , volume 11 of Probability and Mathematical Statistics . Academic Press, London, 2014
work page 2014
-
[3]
o nig, Karla Messing, Jonas Forster, Lutz Schr\
Harsh Beohar, Sebastian Gurke, Barbara K\" o nig, Karla Messing, Jonas Forster, Lutz Schr\" o der, and Paul Wild. Expressive quantale-valued logics for coalgebras: An adjunction-based approach. In Olaf Beyersdorff, Mamadou Moustapha Kant\' e , Orna Kupferman, and Daniel Lokshtanov, editors, 41st International Symposium on Theoretical Aspects of Computer S...
work page 2024
-
[4]
Henneysey-milner type theorem for measurable pseudometrics, 2025
Harsh Beohar, Clemens Kupke, and Daniel Luckhardt. Henneysey-milner type theorem for measurable pseudometrics, 2025. arXiv:????.????
work page 2025
- [5]
-
[6]
Up-to techniques for behavioural metrics via fibrations
Filippo Bonchi, Barbara K\" o nig, and Daniela Petrisan. Up-to techniques for behavioural metrics via fibrations. In Sven Schewe and Lijun Zhang, editors, 29th International Conference on Concurrency Theory (CONCUR 2018) , volume 118 of Leibniz International Proceedings in Informatics (LIPIcs) , pages 17:1--17:17, Dagstuhl, Germany, 2018. Schloss Dagstuhl...
-
[7]
Decision-theoretic planning: structural assumptions and computational leverage
Craig Boutilier, Thomas Dean, and Steve Hanks. Decision-theoretic planning: structural assumptions and computational leverage. J. Artif. Int. Res. , 11(1):1–94, July 1999
work page 1999
-
[8]
D. W. Bressler and M. Sion. The current theory of analytic sets. Canadian Journal of Mathematics , 16:207--230, 1964. https://doi.org/10.4153/CJM-1964-021-7 doi:10.4153/CJM-1964-021-7
Show all 46 references
-
[9]
A behavioural pseudometrics for continuous-time M arkov processes
Linan Chen, Florence Clerc, and Prakash Panangaden. A behavioural pseudometrics for continuous-time M arkov processes. In Foundations of Software Science and Computation Structures , Lecture Notes in Computer Science, 2025. Accepted; arXiv:2501.13008 [cs.LO]; Event: FoSSaCS, H...
2025 arXiv
-
[10]
Metrics for labeled M arkov systems
Jos \'e e Desharnais, Vineet Gupta, Radha Jagadeesan, and Prakash Panangaden. Metrics for labeled M arkov systems. In Jos C. M. Baeten and Sjouke Mauw, editors, CONCUR'99 Concurrency Theory , pages 258--273, Berlin, Heidelberg, 1999. Springer
1999
-
[11]
Bisimulation for labelled M arkov processes
Josée Desharnais, Abbas Edalat, and Prakash Panangaden. Bisimulation for labelled M arkov processes. Information and Computation , 179(2):163--193, 2002. URL: https://www.sciencedirect.com/science/article/pii/S0890540101929621, https://doi.org/10.1006/inco.2001.2962 doi:10.100...
2002
-
[12]
Metrics for labelled M arkov processes
Josée Desharnais, Vineet Gupta, Radha Jagadeesan, and Prakash Panangaden. Metrics for labelled M arkov processes. Theoretical Computer Science , 318(3):323--354, 2004. URL: https://www.sciencedirect.com/science/article/pii/S0304397503006042, https://doi.org/10.1016/j.tcs.2003....
2004 doi
-
[13]
Stochastic Relations: Foundations for M arkov Transition Systems
Ernst-Erich Doberkat. Stochastic Relations: Foundations for M arkov Transition Systems . CRC Press, 2007
2007
-
[14]
Measures and all that --- a tutorial, 2014
Ernst-Erich Doberkat. Measures and all that --- a tutorial, 2014. arXiv:1409.2662 [math.FA], Version 3
2014 arXiv
-
[15]
R. M. Dudley. Real Analysis and Probability . Number 74 in Cambridge Studies in Advanced Mathematics. Cambridge University Press, 2002
2002
-
[16]
Linear Operators , volume 3 of Pure and Applied Mathematics
Nelson Dunford and Jacob Schwartz. Linear Operators , volume 3 of Pure and Applied Mathematics . Wiley-InterScience, 1958/1971
1958
-
[17]
General topology , volume 6 of Sigma series in pure mathematics
Ryszard Engelking. General topology , volume 6 of Sigma series in pure mathematics . Heldermann Verlag, revised and completed edition edition, 1989
1989
-
[18]
Arnold M. Faden. The existence of regular conditional probabilities: Necessary and sufficient conditions. The Annals of Probability , 13(1):288--298, 1985
1985
-
[19]
Generalizations of analytic and standard measurable spaces
Neil Falkner. Generalizations of analytic and standard measurable spaces. Mathematica Scandinavica , pages 283--301, 1981
1981
-
[20]
Metrics for finite M arkov decision processes
Norm Ferns, Prakash Panangaden, and Doina Precup. Metrics for finite M arkov decision processes. In Proceedings of the 20th Conference on Uncertainty in Artificial Intelligence (UAI 2004) , pages 162--169, 2004. arXiv:1207.4114 [cs.AI]
2004 arXiv
-
[21]
Bisimulation metrics for continuous M arkov decision processes
Norm Ferns, Prakash Panangaden, and Doina Precup. Bisimulation metrics for continuous M arkov decision processes. SIAM Journal on Computing , 40(6):1662--1714, 2011
2011
-
[22]
Quantitative H ennessy- M ilner theorems via notions of density
Jonas Forster, Sergey Goncharov, Dirk Hofmann, Pedro Nora, Lutz Schr\" o der, and Paul Wild. Quantitative H ennessy- M ilner theorems via notions of density. In Bartek Klin and Elaine Pimentel, editors, 31st EACSL Annual Conference on Computer Science Logic (CSL 2023) , volume...
2023 doi
-
[23]
D.H. Fremlin. Measure Theory , volume 5. Torres Fremlin, 2000/2008
2000
-
[24]
Bellemare
Carles Gelada, Saurabh Kumar, Jacob Buckman, Ofir Nachum, and Marc G. Bellemare. D eep MDP : Learning continuous latent space models for representation learning. In Kamalika Chaudhuri and Ruslan Salakhutdinov, editors, Proceedings of the 36th International Conference on Machin...
2019
-
[25]
A categorical approach to probability
Mich \`e le Giry. A categorical approach to probability. In B. Banaschewski, editor, Categorical Aspects of Topology and Analysis , volume 915 of Lecture Notes in Mathematics , pages 68--85. Springer, 1982
1982
-
[26]
Equivalence notions and model minimization in M arkov decision processes
Robert Givan, Thomas Dean, and Matthew Greig. Equivalence notions and model minimization in M arkov decision processes. Artificial Intelligence , 147(1):163--223, 2003. Planning with Uncertainty and Incomplete Information. URL: https://www.sciencedirect.com/science/article/pii...
2003 doi
-
[27]
Predelnye raspredeleniya dlya summ ne\-za\-vi\-si\-mykh sluchaynykh velichin
Boris Vladimirovich Gnedenko and Andrey Nikolaevich Kolmogoroff. Predelnye raspredeleniya dlya summ ne\-za\-vi\-si\-mykh sluchaynykh velichin . GITTL, 1949
1949
-
[28]
On observing nondeterminism and concurrency
Matthew Hennessy and Robin Milner. On observing nondeterminism and concurrency. In Jaco de Bakker and Jan van Leeuwen, editors, Automata, Languages and Programming , pages 299--309, Berlin, Heidelberg, 1980. Springer Berlin Heidelberg
1980
-
[29]
B. P. F. Jacobs. Categorical Logic and Type Theory . Number 141 in Studies in Logic and the Foundations of Mathematics. North Holland, Amsterdam, 1999
1999
-
[30]
Classical descriptive set theory , volume 156 of Graduate Texts in Mathematics
Alexander Kechris. Classical descriptive set theory , volume 156 of Graduate Texts in Mathematics . Springer Science & Business Media, 2012
2012
-
[31]
Coalgebraic Behavior Analysis: From Qualitative To Quantitative Analyses
Henning Kerstan. Coalgebraic Behavior Analysis: From Qualitative To Quantitative Analyses . PhD thesis, Universität Duisburg-Essen, May 2016. Submitted on 2016-05-09. URL: https://duepublico2.uni-due.de/receive/duepublico_mods_00041220
2016
-
[32]
Expressivity of quantitative modal logics: Categorical foundations via codensity and approximation
Yuichi Komorida, Shin-ya Katsumata, Clemens Kupke, Jurriaan Rot, and Ichiro Hasuo. Expressivity of quantitative modal logics: Categorical foundations via codensity and approximation. In Proceedings of the Thirty Sixth Annual IEEE Symposium on Logic in Computer Science (LICS 20...
2021
-
[33]
Expressive Logics for Coinductive Predicates
Clemens Kupke and Jurriaan Rot. Expressive Logics for Coinductive Predicates . In Maribel Fern\' a ndez and Anca Muscholl, editors, 28th EACSL Annual Conference on Computer Science Logic (CSL 2020) , volume 152 of Leibniz International Proceedings in Informatics (LIPIcs) , pag...
2020 doi
-
[34]
Two classes of measures
Jan K Pachl. Two classes of measures. Colloquium Mathematicum , 42(1):331--340, 1979. Erratum in Vol. 45.2 (1981), pp. 331--333
1981
-
[35]
Ramachandran and L
D. Ramachandran and L. Rüschendorf. On the monge–kantorovich duality theorem. Teoriya veroyatnostey i ee primeneniya , 45(2), 2000
2000
-
[36]
A general duality theorem for marginal problems
Doraiswamy Ramachandran and Ludger R \"u schendorf. A general duality theorem for marginal problems. Probability Theory and Related Fields , 101:311--319, 1995
1995
-
[37]
On quasi-compact measures
Czes aw Ryll-Nardzewski. On quasi-compact measures. Fundamenta Mathematicae , 40:125--130, 1953
1953
-
[38]
Minimax Theorems and Their Proofs , chapter 1
Stephen Simons. Minimax Theorems and Their Proofs , chapter 1. Number 5 in Nonconvex Optimization and Its Applications. Springer, 1995. https://doi.org/10.1007/978-1-4613-3557-3 doi:10.1007/978-1-4613-3557-3
1995 doi
-
[39]
M. Ya. Suslin. Sur une d \'e finition des ensembles mesurables B sans nombres transfinis. Comptes Rendus Math\'ematique. Acad\'emie des Sciences. Paris. , 164(2):88--91, 1917
1917
-
[40]
Sutton and Andrew G
Richard S. Sutton and Andrew G. Barto. Reinforcement Learning: An Introduction . A Bradford Book, Cambridge, MA, USA, 2018
2018
-
[41]
An algorithm for quantitative verification of probabilistic transition systems
Franck van Breugel and James Worrell. An algorithm for quantitative verification of probabilistic transition systems. In Kim G. Larsen and Mogens Nielsen, editors, CONCUR 2001 --- Concurrency Theory , pages 336--350, Berlin, Heidelberg, 2001. Springer Berlin Heidelberg
2001
-
[42]
Towards quantitative verification of probabilistic transition systems
Franck van Breugel and James Worrell. Towards quantitative verification of probabilistic transition systems. In Fernando Orejas, Paul G. Spirakis, and Jan van Leeuwen, editors, Automata, Languages and Programming , pages 421--432, Berlin, Heidelberg, 2001. Springer Berlin Heidelberg
2001
-
[43]
van Douwen
Eric K. van Douwen. The integers and topology. In Handbook of set-theoretic topology , pages 111--167. Elsevier, 1984
1984
-
[44]
Viglizzo
Ignacio D. Viglizzo. Final sequences and final coalgebras for measurable spaces. In Algebra and Coalgebra in Computer Science , pages 395--407, Berlin, Heidelberg, 2005. Springer
2005
-
[45]
Ward Henson, and Alexander Usvyatsov
Itaï Ben Yaacov, Alexander Berenstein, C. Ward Henson, and Alexander Usvyatsov. Model theory for metric structures. In Zoé Chatzidakis, Dugald Macpherson, Anand Pillay, and Alex Wilkie, editors, Model Theory with Applications to Algebra and Analysis , volume 350 of London Math...
2008
-
[46]
Learning invariant representations for reinforcement learning without reconstruction
Amy Zhang, Rowan Thomas McAllister, Roberto Calandra, Yarin Gal, and Sergey Levine. Learning invariant representations for reinforcement learning without reconstruction. In International Conference on Learning Representations , 2021. URL: https://openreview.net/forum?id=-2FCwDKRREu
2021
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.