Skip to main content

A tool for building processing pipelines in Python and executing them locally or in the cloud.

Project description

cloud-submit

A tool for packaging Python code with Docker and executing it in local and cloud environments.

Installation

$ pip install cloud-submit

Documentation

This package provides a Python module called cloud_submit as well as a command-line tool called csub.

Have a look at the examples to see how to set up a project directory. To run any of the examples you will have to copy userconfig/template.yaml to userconfig/default.yaml and fill in the blanks.

To run the AWS example you need to have the AWS CLI (v2) installed locally and you need an AWS account. The comments in userconfig/template.yaml tell you how you need to configure your AWS account so that the example can run.

Run csub --help to explore the functionality of csub and its subcommands.

Proper documentation will be added as soon as I have the time. (Promise!)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cloud_submit-0.1.2.tar.gz (28.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

cloud_submit-0.1.2-py3-none-any.whl (32.1 kB view details)

Uploaded Python 3

File details

Details for the file cloud_submit-0.1.2.tar.gz.

File metadata

  • Download URL: cloud_submit-0.1.2.tar.gz
  • Upload date:
  • Size: 28.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for cloud_submit-0.1.2.tar.gz
Algorithm Hash digest
SHA256 34f9a7928515c4e60d8cb58e2bf2a55b2dc5a68c1710009b1172321ae1d21a11
MD5 0139652aa0c1724a6cd8615c258c41ec
BLAKE2b-256 27ce20282dcbe6a354011f86c170b8a49ea0b2dfd2c61ee712e3ec8a2b938fca

See more details on using hashes here.

File details

Details for the file cloud_submit-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: cloud_submit-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 32.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for cloud_submit-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 41d0541df25a3dd9003dfca315b29da2d8e6a6b2c82a6a5acad40d090bbfcc10
MD5 d9b4f78232fd2b1c6a3db98bf17222b4
BLAKE2b-256 5ad1bf9299659dca8fad074f4a815765a38ac221f5436654d57d7df5ef7ed373

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page