The reviewed record of science sign in
Pith

arxiv: 2303.07397 · v4 · pith:SRVXB5QX · submitted 2023-03-13 · cs.LG · cs.AI

Fast exploration and learning of latent graphs with aliased observations

Reviewed by Pithpith:SRVXB5QXopen to challenge →

classification cs.LG cs.AI
keywords observationsagentaliasedgraphlatentexplorationnodeobservation
0
0 comments X
read the original abstract

We consider the problem of recovering a latent graph where the observations at each node are \emph{aliased}, and transitions are stochastic. Observations are gathered by an agent traversing the graph. Aliasing means that multiple nodes emit the same observation, so the agent can not know in which node it is located. The agent needs to uncover the hidden topology as accurately as possible and in as few steps as possible. This is equivalent to efficient recovery of the transition probabilities of a partially observable Markov decision process (POMDP) in which the observation probabilities are known. An algorithm for efficiently exploring (and ultimately recovering) the latent graph is provided. Our approach is exponentially faster than naive exploration in a variety of challenging topologies with aliased observations while remaining competitive with existing baselines in the unaliased regime.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.