Skip to main content

A collection of inference modules

Project description

fastinference

A collection of inference modules for fastai2 including inference speedup and interpretability

Install

We have 4 modules you can install, depending on your usecase:

Base Library (Just inference stuff): pip install fastinference ONNX Inference: pip install fastinference[onnxcpu] or fastinference[onnxgpu] Interperatability (Class Confusion + SHAP): pip install fastinference[interp] Everything: pip install fastinference[all]

Wonderful Contributors:

Directions for Contributing:

  1. Fork this repository into your GitHub Account
  2. Ensure that nbdev is installed on your system
  3. Make any changes and ensure that you run the following before commiting:
  • nbdev_build_lib
  • nbdev_clean_nbs
  1. Open a Pull Request with the library, and choose "From fork" to open one with the main repository.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fastinference-0.0.20.tar.gz (29.2 kB view hashes)

Uploaded Source

Built Distribution

fastinference-0.0.20-py3-none-any.whl (35.3 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page