LocoFormer (wip)
LocoFormer - Generalist Locomotion via Long-Context Adaptation
The gist is they trained a simple Transformer-XL in simulation on robots with many different bodies (cross-embodiment) and extreme domain randomization. When transferring to the real-world, they noticed the robot now gains the ability to adapt to insults. The XL memories span across multiple trials, which allowed the robot to learn in-context adaptation.
Install
$ pip install locoformer
Usage
import torch
from locoformer.locoformer import Locoformer
# mock robot embodied with some state dimensions and action dimensions
locoformer = Locoformer(
embedder = dict(
dim = 512,
dim_state = [32, 16], # support multiple bodies / robots
),
unembedder = dict(
num_continuous = 12 + 6,
selectors = [
list(range(12)),
list(range(12, 12 + 6))
]
),
transformer = dict(
dim = 512,
depth = 6,
heads = 8,
window_size = 32
)
)
# mock state from one of the robots (0th one)
state = torch.randn(1, 1, 32)
# forward to get action logits
action_logits, _ = locoformer(
state,
state_embed_kwargs = dict(state_type = 'raw'),
state_id_kwarg = dict(state_id = 0),
action_select_kwargs = dict(selector_index = 0)
)
# sample action using the internal distribution
action = locoformer.unembedder.sample(action_logits, selector_index = 0) # (1, 1, 12)
Sponsors
This open sourced work is sponsored by Safe Sentinel
Citations
@article{liu2025locoformer,
title = {LocoFormer: Generalist Locomotion via Long-Context Adaptation},
author = {Liu, Min and Pathak, Deepak and Agarwal, Ananye},
journal = {Conference on Robot Learning ({CoRL})},
year = {2025}
}
@inproceedings{anonymous2025flow,
title = {Flow Policy Gradients for Legged Robots},
author = {Anonymous},
booktitle = {Submitted to The Fourteenth International Conference on Learning Representations},
year = {2025},
url = {https://openreview.net/forum?id=BA6n0nmagi},
note = {under review}
}
@misc{ashlag2025stateentropyregularizationrobust,
title = {State Entropy Regularization for Robust Reinforcement Learning},
author = {Yonatan Ashlag and Uri Koren and Mirco Mutti and Esther Derman and Pierre-Luc Bacon and Shie Mannor},
year = {2025},
eprint = {2506.07085},
archivePrefix = {arXiv},
primaryClass = {cs.LG},
url = {https://arxiv.org/abs/2506.07085},
}
@misc{osband2026delightfulpolicygradient,
title = {Delightful Policy Gradient},
author = {Ian Osband},
year = {2026},
eprint = {2603.14608},
archivePrefix = {arXiv},
primaryClass = {cs.LG},
url = {https://arxiv.org/abs/2603.14608},
}
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file locoformer-0.2.6.tar.gz.
File metadata
- Download URL: locoformer-0.2.6.tar.gz
- Upload date:
- Size: 23.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.8.17
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1feb42b4ff457e9c3e077077dbb3b32969da3836ed921b09a10a5b2b00145d15
|
|
| MD5 |
9b8d792214d65f7367cc69e23af53b20
|
|
| BLAKE2b-256 |
fb3d452a2fc3f88c3400df3d3ee4ff4ceebde3b0059b33844ff5cea6706deab7
|
File details
Details for the file locoformer-0.2.6-py3-none-any.whl.
File metadata
- Download URL: locoformer-0.2.6-py3-none-any.whl
- Upload date:
- Size: 23.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.8.17
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
24f9e09a1c0df20fd423bfd46184b98055dd1349dd084423c93fae4d4253eed8
|
|
| MD5 |
cea41615ba0be0a2a5927c2627ee71b4
|
|
| BLAKE2b-256 |
bc4d71e90cbca480a50318fb56e89a2608e34fd846e90a1d8ace0c2d7aac92f4
|
