Skip to main content

A tool for building processing pipelines in Python and executing them locally or in the cloud.

Project description

cloud-submit

A tool for packaging Python code with Docker and executing it in local and cloud environments.

Installation

$ pip install cloud-submit

Documentation

This package provides a Python module called cloud_submit as well as a command-line tool called csub.

Have a look at the examples to see how to set up a project directory. To run any of the examples you will have to copy userconfig/template.yaml to userconfig/default.yaml and fill in the blanks.

To run the AWS example you need to have the AWS CLI (v2) installed locally and you need an AWS account. The comments in userconfig/template.yaml tell you how you need to configure your AWS account so that the example can run.

Run csub --help to explore the functionality of csub and its subcommands.

Proper documentation will be added as soon as I have the time. (Promise!)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cloud_submit-0.1.1.tar.gz (27.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

cloud_submit-0.1.1-py3-none-any.whl (32.0 kB view details)

Uploaded Python 3

File details

Details for the file cloud_submit-0.1.1.tar.gz.

File metadata

  • Download URL: cloud_submit-0.1.1.tar.gz
  • Upload date:
  • Size: 27.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for cloud_submit-0.1.1.tar.gz
Algorithm Hash digest
SHA256 2074151613182ccb0d12068610906ce32a87369799f8b43c6bfc8932e615b07f
MD5 5213bf53f9a870347381b3ddc13fa4da
BLAKE2b-256 91d0de9096a5f3a7ceca1ec3c7acae4b6b04798cbe46e4abc6f5a11086be6fe2

See more details on using hashes here.

File details

Details for the file cloud_submit-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: cloud_submit-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 32.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for cloud_submit-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 b74e6d615ad2d76b7e126d1e909183d31e18483c1ede5500f6dba2b4b1c9a687
MD5 f119ce449074d22c0c505400b3fbd4b1
BLAKE2b-256 20344c3942ea4c992a0a4336137fb21a9e0c3dce5bfa3b081ad66dffd6fefb7c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page