Run Python jobs on the cloud using DISCO
Project description
Dis.co Python SDK
This package lets you run jobs on Dis.co platform from a Python program.
Using the SDK, you can create computing jobs, run them on Dis.co, and get their results to your local machine. It is possible to offload any kind of Python program to be run on Dis.co.
Prerequisites
-
An Dis.co account.
-
Python version 3.6 and up.
-
Dis.co Python SDK installed:
$ pip install disco
Example
import disco
import pathlib
disco.set_credentials('john@example.com', 'my_password', save_to_config=True)
my_file_id = disco.upload_file('my_file.py', pathlib.Path('/home/bob/my_file.py'))
job = disco.Job.create(my_file_id)
job.start()
(task_result,) = job.get_results(block=True)
task_result.write_files('/home/bob/my_result')
The code above uploads the file /home/bob/my_file.py
, runs it on Dis.co cloud, waits for the job to finish,
and writes the results to /home/bob/my_result
.
When the job has been created, you can see it listed in list_jobs()
:
>>> import disco
>>> disco.Job.list_jobs())
[{'id': '5d650d25179854000d72b8cc', 'archived': False, 'name': 'd08e3e029bfc412ebc316e21f1a7dae0', 'status': 'Done', 'taskStates': ['Success']}]
This functions returns an instance of Job
, which gives access to many useful operations on a job
(see the API documentation).
Environment variables
The disco
package supports these environment variables:
DISCO_BASE_URL
- base URL of the Dis.co server. Default:https://app.dis.co
DISCO_EMAIL
- user's email to for authenticating with the Dis.co server.DISCO_PASSWORD
- password for authenticating with the Dis.co server.DISCO_LIVE_TESTS
- set true to run our live tests.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file disco-1.40.4.tar.gz
.
File metadata
- Download URL: disco-1.40.4.tar.gz
- Upload date:
- Size: 70.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.46.0 CPython/3.7.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 112a9ee4af9bece072456b0d9ec8f2b10b0d16799ae2c7d3e946f50c8035a6ff |
|
MD5 | 4324b14ebabaa55e30b2314f32961c56 |
|
BLAKE2b-256 | 3160756ea150918dc6aa77d3148650e459596cc640a47cc98dde272051892f06 |
File details
Details for the file disco-1.40.4-py3-none-any.whl
.
File metadata
- Download URL: disco-1.40.4-py3-none-any.whl
- Upload date:
- Size: 102.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.46.0 CPython/3.7.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 195e2c11bd0d18361ace11307e6546713aab277e406f989112b8d3d387873fc9 |
|
MD5 | 9cbe0497686c8bd93f4a9bf30da0b4aa |
|
BLAKE2b-256 | 6123433d4835d02b14af4ee78f18510f045c4b5dc813b9e344543c402d379171 |