Skip to main content

Python API for interfacing with SAILenv

Project description

SAILenv Client - SAILab Virtual Environment

SAILenv is a Virtual Environment powered by Unity3D, developed by SAILab in Siena. This repository contains a Python client for SAILenv.

Have a look at the project page - SAILenv for more details.

Technical report here - accepted at ICPR2020.

Agent API

SAILenv is accessible through an instance of the Agent class, which acts as the API between Python scripts and the environment. The API is designed to be as easy as possible to integrate with most known computer vision frameworks.

Through the API, a Python script can access many views of the environment with configurable resolution scaling (aspect ratio is fixed, at the moment):

  • Realistic rendering of the environment
  • Pixel-wise segmentation at category level
  • Pixel-wise segmentation at instance level
  • Pixel-wise depth
  • Pixel-wise optical flow

A script can also:

  • Obtain the list of object categories available in the scene
  • Obtain the list of available scenes
  • Transfer the Agent in one of the available scenes
  • Manually set the Agent position and orientation
  • Enable automatic movement through a predetermined track inside the scene

Optical Flow

The optical flow is obtained directly from the Unity Physics Engine, meaning that it is both highly accurate while still achieving greats speed.

Agent and Environment communication

The Agent and the Environment communicate through low-level sockets, allowing highly performant exchange of information.

Cite

@article{meloni2020sailenv,
  title={SAILenv: Learning in Virtual Visual Environments Made Simple},
  author={Meloni, Enrico and Pasqualini, Luca and Tiezzi, Matteo and Gori, Marco and Melacci, Stefano},
  journal={arXiv preprint arXiv:2007.08224},
  year={2020}
}

Download

PyPI version

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for sailenv, version 0.5b0
Filename, size File type Python version Upload date Hashes
Filename, size sailenv-0.5b0.tar.gz (10.4 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page