Welcome on SmartJob Python Library!

What is it?

SmartJob is a thin Python 3.11+ job library for dealing with GCP/Cloud Run Jobs, GCP/Cloud Batch Jobs and GCP/VertexAI CustomJobs and (local) Docker (jobs):

  • in a very simple way
  • in a unified way (with as little difference as possible between the 4 providers)
  • in an async way (not with asyncio but with concurrent.futures.Future objects; in most cases, this is enough for dealing with complex parallel workflows (including parralelism, chaining, conditionals...) and you don't need to learn another pipeline workflow or switching your whole codebase to asyncio)
  • in a reactive way (when you're in the experimentation phase, you can pass the main Python script without rebuilding/pushing a whole docker image at each attempt)
  • in a production ready way (with retries, timeouts...)

Non-features

SmartJob is a thin library and not a whole pipeline framework. He tries to be as un-opinionated as possible.

Quickstart

Let's go 🚀

Documentation

https://fabien-marty.github.io/smartjob/

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for fabienmarty from gravatar.com fabienmarty

Credits

Author: Fabien MARTY

Requires

Python <4.0, >=3.11

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

smartjob-0.0.34.tar.gz (20.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

smartjob-0.0.34-py3-none-any.whl (30.5 kB view details)

Uploaded Python 3

File details

Details for the file smartjob-0.0.34.tar.gz.

File metadata

  • Download URL: smartjob-0.0.34.tar.gz
  • Upload date:
  • Size: 20.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.2.1 CPython/3.11.14 Linux/6.11.0-1018-azure

File hashes

Hashes for smartjob-0.0.34.tar.gz
Algorithm Hash digest
SHA256 6bf04eaeebc55f42aafe30943920c609c9a969ecce3fca6f23c9e461b5e8f37a
MD5 70e85984436ab6019dd77f7c4b3c3a51
BLAKE2b-256 f27b3c8bb78fe580c2eb98efc55694c662ac3b9cd4ebe214bbfcdbe501504990

See more details on using hashes here.

File details

Details for the file smartjob-0.0.34-py3-none-any.whl.

File metadata

  • Download URL: smartjob-0.0.34-py3-none-any.whl
  • Upload date:
  • Size: 30.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.2.1 CPython/3.11.14 Linux/6.11.0-1018-azure

File hashes

Hashes for smartjob-0.0.34-py3-none-any.whl
Algorithm Hash digest
SHA256 b4c74e4ec166d47b206989b306d0f49d02d99f833794140582201be31fecf740
MD5 ee1b1ec23d28fab105681417d9db7c6e
BLAKE2b-256 3a36a314bd2a63c8d829289dab01ee1aafd486935ab168d6c777e730835c9965

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page