Skip to main content

HoST - Pytorch (wip)

Implementation of Humanoid Standing Up, from the paper Learning Humanoid Standing-up Control across Diverse Postures out of Shanghai, in Pytorch

Besides for the set of reward functions, the other contribution is validating an approach using multiple critics out of Boston University

Install

$ pip install HoST-pytorch

Usage

import torch
from host_pytorch import Agent
from host_pytorch.mock_env import Env, mock_hparams

env = Env()

agent = Agent(
    num_actions = (10, 10, 20),
    actor = dict(
        dims = (env.dim_state, 256, 128),
    ),
    critics = dict(
        dims = (env.dim_state, 256),
    ),
    reward_hparams = mock_hparams()
)

memories = agent(env)

agent.learn(memories)

agent.save('./standing-up-policy.pt', overwrite = True)

Citations

@article{huang2025host,
  title     = {Learning Humanoid Standing-up Control across Diverse Postures},
  author    = {Huang, Tao and Ren, Junli and Wang, Huayi and Wang, Zirui and Ben, Qingwei and Wen, Muning and Chen, Xiao and Li, Jianan and Pang, Jiangmiao},
  journal   = {arXiv preprint arXiv:2502.08378},
  year      = {2025},
}
@article{Farebrother2024StopRT,
    title   = {Stop Regressing: Training Value Functions via Classification for Scalable Deep RL},
    author  = {Jesse Farebrother and Jordi Orbay and Quan Ho Vuong and Adrien Ali Taiga and Yevgen Chebotar and Ted Xiao and Alex Irpan and Sergey Levine and Pablo Samuel Castro and Aleksandra Faust and Aviral Kumar and Rishabh Agarwal},
    journal = {ArXiv},
    year   = {2024},
    volume = {abs/2403.03950},
    url    = {https://api.semanticscholar.org/CorpusID:268253088}
}
@article{Tao2022LearningTG,
    title  = {Learning to Get Up},
    author = {Tianxin Tao and Matthew Wilson and Ruiyu Gou and Michiel van de Panne},
    journal = {ACM SIGGRAPH 2022 Conference Proceedings},
    year   = {2022},
    url    = {https://api.semanticscholar.org/CorpusID:248496244}
}

Metadata

Release files for HoST-pytorch 0.0.50

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for HoST-pytorch 0.0.50
File Size Uploaded
host_pytorch-0.0.50.tar.gz 4.5 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for HoST-pytorch 0.0.50
File Interpreter ABI Platform
host_pytorch-0.0.50-py3-none-any.whl Python 3 none any Details

Total release size: 8.3 kB

Release files / host_pytorch-0.0.50.tar.gz

Download URL host_pytorch-0.0.50.tar.gz
Size 4.5 kB
Tags Source
SHA-256 checksum
How to use checksums
37b18a048e8401c6c736d3d6aa11dd14ee9ad453f4b78f93210dea0b18ac1b3e
BLAKE2b-256 checksum
How to use checksums
7a608ff1004ac598096969c4f8fb2adf958bbc5de5a3f5a0d23f9bbc59fcf59e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.8.17

Release files / host_pytorch-0.0.50-py3-none-any.whl

Download URL host_pytorch-0.0.50-py3-none-any.whl
Size 3.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
2a47b1faf429a227ba4e7341c654470469184410e566d04ddbf7c58db3c13894
BLAKE2b-256 checksum
How to use checksums
33f8160274bf6a7e683d46c94a354cb156f6182d5e7e7bf8eb2eca8f65709b14
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.8.17

Release history Release notifications | RSS feed

This release

0.0.50 This release

2 release files

0.0.47

2 release files

0.0.46

2 release files

0.0.45

2 release files

0.0.44

2 release files

0.0.43

2 release files

0.0.42

2 release files

0.0.41

2 release files

0.0.40

2 release files

0.0.39

2 release files

0.0.38

2 release files

0.0.37

2 release files

0.0.36

2 release files

0.0.35

2 release files

0.0.34

2 release files

0.0.33

2 release files

0.0.32

2 release files

0.0.31

2 release files

0.0.30

2 release files

0.0.29

2 release files

0.0.28

2 release files

0.0.26

2 release files

0.0.25

2 release files

0.0.24

2 release files

0.0.23

2 release files

0.0.22

2 release files

0.0.21

2 release files

0.0.20

2 release files

0.0.19

2 release files

0.0.18

2 release files

0.0.9

2 release files

0.0.8

2 release files

0.0.7

2 release files

0.0.5

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page