Skip to main content

RayNet implements an end to end trainable 3D reconstruction system

Project description

This python pachage provides the code that accompanies our CVPR 2018 paper with title RayNet: Learning Volumetric 3D Reconstruction with Ray Potentials.

Dependencies & Installation

Normally, a pip install raynet should suffice to use our code.

If you already have a functional Keras installation there are not much left to install :-)

  • Keras > 2
  • Tensorflow
  • Cython
  • PyCuda
  • backports.functools_lru_cache
  • imageio
  • googleapiclient
  • numpy
  • matplotlib

Depending on how you want to use our code, there are two alternatives regarding installation. You can either use a package manager or download and install the library manually. For those who just want to use the library we recommend to directly install the latest version from PyPI, whereas for those who want to be able to edit the code we recommend to install the library manually.

  • Install from Pypi with:
pip install --user raynet
  • Install manually:

Clone the latest version of the library and run

# Clone the repository
git clone
cd raynet
# Local installation in development mode
pip install --user -e .


The dedicated documentation page can be found in our documentation site but you can also read the source code to get an idea of how our code can be used. If you have any question regarding the code please contact Despoina Paschalidou.


Contributions such as bug fixes, bug reports, suggestions etc. are more than welcome and should be submitted in the form of new issues and/or pull requests on Github.

Relevant Research

Below we list some papers that are relevant to the provided code.


  • RayNet: Learning Volumetric 3D Reconstruction with Ray Potentials [pdf]

By Others

  • Towards Probabilistic Volumetric Reconstruction using Ray Potentials [pdf]
  • Patches, Planes and Probabilities: A Non-local Prior for Volumetric 3D Reconstruction [pdf]
  • Semantic Multi-view Stereo: Jointly Estimating Objects and Voxels [pdf]
  • Learned Multi Patch Similarity [pdf]
  • SurfaceNet: An End-to-end 3D Neural Network for Multiview Stereopsis [pdf]


If you are using our code, please cite our paper.The BibTeX reference is:

   author = {Paschalidou, Despoina and Ulusoy, Osman and Schmitt, Carolin and Van Gool, Luc and Geiger, Andreas},
   title = {RayNet: Learning Volumetric 3D Reconstruction With Ray Potentials},
   booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
   month = {June},
   year = {2018}

Project details

Release history Release notifications | RSS feed

This version


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for raynet, version 0.2
Filename, size File type Python version Upload date Hashes
Filename, size raynet-0.2.tar.gz (85.4 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page