Skip to main content

Simulator for vision-based tactile sensors.

Project description

TACTO: A Fast, Flexible and Open-source Simulator for High-Resolution Vision-based Tactile Sensors

License: MIT PyPI CircleCI Code style: black DIGIT-logo

TACTO Simulator

This package provides a simulator for vision-based tactile sensors, such as DIGIT. It provides models for the integration with PyBullet, as well as a renderer of touch readings.

NOTE: the simulator is not meant to provide a physically accurate dynamics of the contacts (e.g., deformation, friction), but rather relies on existing physics engines.

For updates and discussions please join the #TACTO channel at the www.touch-sensing.org community.

Installation

The preferred way of installation is through PyPi:

pip install tacto

Alternatively, you can manually clone the repository and install the package using:

git clone https://github.com/facebookresearch/tacto.git
cd tacto
pip install -e .

Content

This package contain several components:

  1. A renderer to simulate readings from vision-based tactile sensors.
  2. An API to simulate vision-based tactile sensors in PyBullet.
  3. Mesh models and configuration files for the DIGIT and Omnitact sensors.

Usage

Additional packages (torch, gym, pybulletX) are required to run the following examples. You can install them by pip install -r requirements/examples.txt.

For a basic example on how to use TACTO in conjunction with PyBullet look at [TBD],

For an example of how to use just the renderer engine look at examples/demo_render.py.

For advanced examples of how to use the simulator with PyBullet look at the examples folder.

Demo DIGIT Demo Allegro Demo OmniTact Demo Grasp Demo Rolling Demo Shadow

NOTE: the renderer requires a screen. For rendering headless, use the "EGL" mode with GPU and CUDA driver or "OSMESA" with CPU. See PyRender for more details.

Operating System

We recommend to conduct experiments on Ubuntu.

For macOS, there exists some visualization problem between pybullet.GUI and pyrender as we know of. Please let us know if it can be resolved, and we will share the information at the repo!

License

This project is licensed under MIT license, as found in the LICENSE file.

Citing

If you use this project in your research, please cite:

@Article{Wang2020TACTO,
  author  = {Wang, Shaoxiong and Lambeta, Mike and Chou, Lambeta and Calandra, Roberto},
  title   = {TACTO: A Fast, Flexible and Open-source Simulator for High-Resolution Vision-based Tactile Sensors},
  journal = {Arxiv},
  year    = {2020},
  url     = {https://arxiv.org/abs/2012.08456},
}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tacto-0.0.3.tar.gz (15.6 kB view hashes)

Uploaded Source

Built Distribution

tacto-0.0.3-py3-none-any.whl (16.6 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page