REVIEW 4 cited by
A Generalist Dynamics Model for Control
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We investigate the use of transformer sequence models as dynamics models (TDMs) for control. We find that TDMs exhibit strong generalization capabilities to unseen environments, both in a few-shot setting, where a generalist TDM is fine-tuned with small amounts of data from the target environment, and in a zero-shot setting, where a generalist TDM is applied to an unseen environment without any further training. Here, we demonstrate that generalizing system dynamics can work much better than generalizing optimal behavior directly as a policy. Additional results show that TDMs also perform well in a single-environment learning setting when compared to a number of baseline models. These properties make TDMs a promising ingredient for a foundation model of control.
Forward citations
Cited by 4 Pith papers
-
Not a Monolith: Lab-Level Divergence in the Cooperative Equilibria of Chinese Frontier LLM Agents
Four Chinese frontier LLMs show lab-level divergence in aggressive-equilibrium rates (P_A 1% to 9%), with within-ecosystem spread exceeding the East-West mean difference.
-
Trajectory World Models for Heterogeneous Environments
A pre-trained trajectory world model with interleaved temporal and variate attention achieves positive transfer across heterogeneous control environments, improving transition prediction, off-policy evaluation, and mo...
-
Meta-Controller: Few-Shot Imitation of Unseen Embodiments and Tasks in Continuous Control
Meta-Controller achieves few-shot imitation on unseen robot embodiments and tasks in continuous control, beating dedicated baselines on eight DeepMind Control tasks with five demonstrations.
-
On Foundation Models for Dynamical Systems from Purely Synthetic Data
Pretraining a transformer purely on synthetic dynamics sampled from a reproducing kernel Hilbert space yields zero-shot and fine-tuned state predictors that beat non-pretrained baselines on cart-pole and Furuta systems.
Discussion (0). Continue with ORCID to comment.