Codeflare-SDK
An intuitive, easy-to-use python interface for batch resource requesting, access, job submission, and observation. Simplifying the developer's life while enabling access to high-performance compute resources, either in the cloud or on-prem.
Tutorial and basics walkthrough coming soon!
Full documentation can be found here
Installation
Can be installed via pip: pip install codeflare-sdk
Development
Prerequisites
We recommend using Python 3.9 for development.
Install development specific dependencies:
$ pip install -r requirements-dev.txt
Additional dependencies can be found in requirements.txt: $ pip install -r requirements.txt
Pre-commit
We use pre-commit to make sure the code is consistently formatted. To make sure that pre-commit is run every time you commit changes, simply run pre-commit install
Testing
- To install codeflare-sdk in editable mode, run
pip install -e .from the repo root. - To run the unit tests, run
pytest -v tests/unit_test.py - Any new test functions/scripts can be added into the
testsfolder - NOTE: Functional tests coming soon, will live in
tests/func_test.py
Code Coverage
- Run tests with the following command:
coverage run -m --source=src pytest tests/unit_test.py - To then view a code coverage report w/ missing lines, run
coverage report -m
Code Formatting
- To check file formatting, in top-level dir run
black --check . - To auto-reformat all files, remove the
--checkflag - To reformat an individual file, run
black <filename>
Package Build
To build the python package: $ poetry build
Release Instructions
The following instructions apply when doing release manually.
- Check and update the version in "pyproject.toml" file.
- Generate new documentation.
pdoc --html -o docs src/codeflare_sdk && pushd docs && rm -rf cluster job utils && mv codeflare_sdk/* . && rm -rf codeflare_sdk && popd(it is possible to install pdoc using the following commandpoetry install --with docs) - Commit all the changes to the repository.
- Create Github release (https://docs.github.com/en/repositories/releasing-projects-on-github/managing-releases-in-a-repository#creating-a-release).
- Build the Python package.
poetry build - If not present already, add the API token to Poetry.
poetry config pypi-token.pypi API_TOKEN - Publish the Python package.
poetry publish - Check and update the version in "custom-nb-image/VERSION" file.
- Update the codeflare-sdk version in "custom-nb-image/Dockerfile".
- Commit all the changes to the repository.
- The Github "Image" workflow should take care about the building and publishing of the new image. If not you can use the following instructions to build and publish image manually.
- Change directory to custom-nb-image.
cd custom-nb-image - Get tag
export tag=$(cat VERSION) - Build the Docker image.
docker build -t quay.io/project-codeflare/notebook:${tag} . - Tag the image as latest.
docker tag quay.io/project-codeflare/notebook:${tag} quay.io/project-codeflare/notebook:latest - Login to quay.io.
docker login quay.io - Push the image.
docker push quay.io/project-codeflare/notebook:${tag} - Push the image.
docker push quay.io/project-codeflare/notebook:latest
10 maintainers
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file codeflare_sdk-0.4.5.tar.gz.
File metadata
- Download URL: codeflare_sdk-0.4.5.tar.gz
- Upload date:
- Size: 22.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
poetry/1.4.1 CPython/3.8.13 Linux/4.18.0-425.10.1.el8_7.x86_64
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
55a64ff62a2b74a59d438037a0b67806ed7591a2a66dbfd864f8ab933b4a55ec
|
|
| MD5 |
3c7db92bb3767e96f520bd87e6cc6bd3
|
|
| BLAKE2b-256 |
bacdb25d3644392124af7550540e19d212fa185c77ca8c54e5619eb25e7393d5
|
File details
Details for the file codeflare_sdk-0.4.5-py3-none-any.whl.
File metadata
- Download URL: codeflare_sdk-0.4.5-py3-none-any.whl
- Upload date:
- Size: 27.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
poetry/1.4.1 CPython/3.8.13 Linux/4.18.0-425.10.1.el8_7.x86_64
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
402196bd5c1468f04b97ee9c2038f209c3f4dc6ce74d650788ee1e2240b294a5
|
|
| MD5 |
67d04d59ac7e344aa605f23ca67d0cb7
|
|
| BLAKE2b-256 |
e6c43b698805521419022b13c7124ef4cb238dc7780397a556c247b7943c7e1c
|
