Skip to main content

Lightweight pipelining with Python functions

Project description

Joblib version CI status Documentation Status Codecov coverage

The homepage of joblib with user documentation is located on:

https://joblib.readthedocs.io

Getting the latest code

To get the latest code using git, simply type:

git clone https://github.com/joblib/joblib.git

If you don’t have git installed, you can download a zip of the latest code: https://github.com/joblib/joblib/archive/refs/heads/main.zip

Installing

You can use pip to install joblib from any directory:

pip install joblib

or install it in editable mode from the source directory:

pip install -e .

Dependencies

  • Joblib has no mandatory dependencies besides Python (supported versions are 3.9+).

  • Joblib has an optional dependency on Numpy (at least version 1.6.1) for array manipulation.

  • Joblib includes its own vendored copy of loky for process management.

  • Joblib can efficiently dump and load numpy arrays but does not require numpy to be installed.

  • Joblib has an optional dependency on python-lz4 as a faster alternative to zlib and gzip for compressed serialization.

  • Joblib has an optional dependency on psutil to mitigate memory leaks in parallel worker processes.

  • Some examples require external dependencies such as pandas. See the instructions in the Building the docs section for details.

Workflow to contribute

To contribute to joblib, first create an account on github. Once this is done, fork the joblib repository to have your own repository, clone it using git clone. Make your changes in a branch of your clone, push them to your github account, test them locally, and when you are happy with them, send a pull request to the main repository.

You can use pre-commit to run code style checks before each commit:

pip install pre-commit
pre-commit install

pre-commit checks can be disabled for a single commit with:

git commit -n

Running the test suite

To run the test suite, you need the pytest (version >= 3) and coverage modules. Run the test suite using:

pytest joblib

from the root of the project.

Building the docs

To build the docs you need to have sphinx (>=1.4) and some dependencies installed:

pip install -U -r .readthedocs-requirements.txt

The docs can then be built with the following command:

make doc

The html docs are located in the doc/_build/html directory.

Making a source tarball

To create a source tarball, eg for packaging or distributing, run the following command:

pip install build
python -m build --sdist

The tarball will be created in the dist directory. This command will create the resulting tarball that can be installed with no extra dependencies than the Python standard library.

Making a release and uploading it to PyPI

This command is only run by project manager, to make a release, and upload in to PyPI:

pip install build
python -m build --sdist --wheel
twine upload dist/*

Note that the documentation should automatically get updated at each git push. If that is not the case, try building th doc locally and resolve any doc build error (in particular when running the examples).

Updating the changelog

Changes are listed in the CHANGES.rst file. They must be manually updated but, the following git command may be used to generate the lines:

git log --abbrev-commit --date=short --no-merges --sparse

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

joblib-1.5.1.tar.gz (330.5 kB view details)

Uploaded Source

Built Distribution

joblib-1.5.1-py3-none-any.whl (307.7 kB view details)

Uploaded Python 3

File details

Details for the file joblib-1.5.1.tar.gz.

File metadata

  • Download URL: joblib-1.5.1.tar.gz
  • Upload date:
  • Size: 330.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for joblib-1.5.1.tar.gz
Algorithm Hash digest
SHA256 f4f86e351f39fe3d0d32a9f2c3d8af1ee4cec285aafcb27003dda5205576b444
MD5 c053323d570ab3c69fda0627a5c22872
BLAKE2b-256 dcfe0f5a938c54105553436dbff7a61dc4fed4b1b2c98852f8833beaf4d5968f

See more details on using hashes here.

Provenance

The following attestation bundles were made for joblib-1.5.1.tar.gz:

Publisher: publish-to-pypi.yml on joblib/joblib

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file joblib-1.5.1-py3-none-any.whl.

File metadata

  • Download URL: joblib-1.5.1-py3-none-any.whl
  • Upload date:
  • Size: 307.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for joblib-1.5.1-py3-none-any.whl
Algorithm Hash digest
SHA256 4719a31f054c7d766948dcd83e9613686b27114f190f717cec7eaa2084f8a74a
MD5 eb1308df55d4767e6313e2002dc7f9d0
BLAKE2b-256 7d4f1195bbac8e0c2acc5f740661631d8d750dc38d4a32b23ee5df3cde6f4e0d

See more details on using hashes here.

Provenance

The following attestation bundles were made for joblib-1.5.1-py3-none-any.whl:

Publisher: publish-to-pypi.yml on joblib/joblib

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page