Welcome on SmartJob Python Library!
What is it?
SmartJob is a thin Python 3.11+ job library for dealing with GCP/Cloud Run Jobs, GCP/Cloud Batch Jobs and GCP/VertexAI CustomJobs and (local) Docker (jobs):
- in a very simple way
- in a unified way (with as little difference as possible between the 4 providers)
- in an async way (not with
asynciobut withconcurrent.futures.Futureobjects; in most cases, this is enough for dealing with complex parallel workflows (including parralelism, chaining, conditionals...) and you don't need to learn another pipeline workflow or switching your whole codebase toasyncio) - in a reactive way (when you're in the experimentation phase, you can pass the main Python script without rebuilding/pushing a whole docker image at each attempt)
- in a production ready way (with retries, timeouts...)
Non-features
SmartJob is a thin library and not a whole pipeline framework. He tries to be as un-opinionated as possible.
Quickstart
Documentation
1 maintainer
Metadata
1 maintainer
Release files for smartjob 0.0.34
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| smartjob-0.0.34.tar.gz | 20.7 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| smartjob-0.0.34-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 51.2 kB
Release files / smartjob-0.0.34.tar.gz
| Download URL | smartjob-0.0.34.tar.gz |
|---|---|
| Size | 20.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
6bf04eaeebc55f42aafe30943920c609c9a969ecce3fca6f23c9e461b5e8f37a
|
|
BLAKE2b-256 checksum How to use checksums |
f27b3c8bb78fe580c2eb98efc55694c662ac3b9cd4ebe214bbfcdbe501504990
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.2.1 CPython/3.11.14 Linux/6.11.0-1018-azure
|
Release files / smartjob-0.0.34-py3-none-any.whl
| Download URL | smartjob-0.0.34-py3-none-any.whl |
|---|---|
| Size | 30.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
b4c74e4ec166d47b206989b306d0f49d02d99f833794140582201be31fecf740
|
|
BLAKE2b-256 checksum How to use checksums |
3a36a314bd2a63c8d829289dab01ee1aafd486935ab168d6c777e730835c9965
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.2.1 CPython/3.11.14 Linux/6.11.0-1018-azure
|
