Pith. sign in

REVIEW 6 cited by

TorchRL: A data-driven decision-making library for PyTorch

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2306.00577 v2 pith:PC3K3FGC submitted 2023-06-01 cs.LG cs.AI

TorchRL: A data-driven decision-making library for PyTorch

classification cs.LG cs.AI
keywords librarypytorchcontroltorchrlacrossdemonstratedevelopmentgithub
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
Share X Bluesky LinkedIn Reddit HN
read the original abstract

PyTorch has ascended as a premier machine learning framework, yet it lacks a native and comprehensive library for decision and control tasks suitable for large development teams dealing with complex real-world data and environments. To address this issue, we propose TorchRL, a generalistic control library for PyTorch that provides well-integrated, yet standalone components. We introduce a new and flexible PyTorch primitive, the TensorDict, which facilitates streamlined algorithm development across the many branches of Reinforcement Learning (RL) and control. We provide a detailed description of the building blocks and an extensive overview of the library across domains and tasks. Finally, we experimentally demonstrate its reliability and flexibility and show comparative benchmarks to demonstrate its computational efficiency. TorchRL fosters long-term support and is publicly available on GitHub for greater reproducibility and collaboration within the research community. The code is open-sourced on GitHub.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 6 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Your GFlowNet Secretly Learns an Optimal Transport Plan

    cs.LG 2026-06 unverdicted novelty 7.0

    Minimum-flow GFlowNets on graphs encode optimal transport plans, with the learned policy recovering the optimal coupling between source and target distributions.

  2. Social-spatial dependencies for learning visual navigation

    cs.NE 2026-07 conditional novelty 6.0

    Neural-network agents trained in social environments learn hybrid navigation strategies that combine individual landmark use with social following, with strategy shifts driven by the ratio of skilled to unskilled soci...

  3. Scalable Production Scheduling: Linear Complexity via Unified Homogeneous Graphs

    cs.LG 2026-04 unverdicted novelty 6.0

    A unified homogeneous graph framework with feature homogenization enables linear-complexity RL policies for job shop scheduling that generalize zero-shot via structural saturation at balanced job-machine ratios.

  4. Latent Spherical Flow Policy for Reinforcement Learning with Combinatorial Actions

    cs.LG 2026-01 conditional novelty 6.0

    A spherical flow-matching policy over latent cost directions, mapped to feasible actions by a combinatorial solver with a vMF-smoothed value critic, beats prior combinatorial-RL baselines by 20.6% on four benchmark tasks.

  5. Plug-and-Play Benchmarking of Reinforcement Learning Algorithms for Large-Scale Flow Control

    cs.LG 2026-01 conditional novelty 6.0

    FluidGym is a PyTorch-only, fully differentiable benchmark with 13 flow-control environments, MARL support, and public baselines.

  6. IR-SIM: A Lightweight Skill-Native Simulator for Navigation, Learning, and Benchmarking

    cs.RO 2026-06 unverdicted novelty 5.0

    IR-SIM is a YAML-defined simulator for mobile robot navigation that supports text-prompt scenario creation, policy training, benchmarking, and bridging to higher-fidelity or real-world settings.