Skip to main content

Official Python SDK for DataCrunch Public API

Project description

DataCrunch Python SDK

The official DataCrunch.io python SDK.

DataCrunch's Public API documentation is available here.

Getting Started - Using the SDK:

  • Install via pip:

    pip3 install datacrunch
    
  • Add the client secret to an environment variable (don't want it to be hardcoded):

    Linux (bash):

    export DATACRUNCH_CLIENT_SECRET=Z4CZq02rdwdB7ISV0k4Z2gtwAFKiyvr2U1l0KDIeYi
    

    Other platforms: https://en.wikipedia.org/wiki/Environment_variable

  • Example for creating a new instance:

    import os
    from datacrunch import DataCrunchClient
    
    # Get client secret from environment variable
    CLIENT_SECRET = os.environ['DATACRUNCH_CLIENT_SECRET']
    CLIENT_ID = 'Ibk5bdxV64lKAWOqYnvSi'
    
    # Create datcrunch client
    datacrunch = DataCrunchClient(CLIENT_ID, CLIENT_SECRET)
    
    # Get all SSH keys
    ssh_keys = datacrunch.ssh_keys.get()
    
    # Create a new instance
    instance = datacrunch.instances.create(instance_type='1V100.6V',
                                          image='fastai',
                                          ssh_key_ids=ssh_keys,
                                          hostname='example',
                                          description='example instance')
    
    # Delete instance
    datacrunch.instances.action(instance.id, datacrunch.actions.DELETE)
    

    More examples can be found in the /examples folder or in the documentation.

Development

Setting up the local development environment

  • Clone the repository:

    git clone
    
  • Create local virtual environment:

    python3 -m venv datacrunch_env && source .datacrunch_env/bin/activate
    

    or if using fish shell:

    python3 -m venv datacrunch_env && source .datacrunch_env/bin/activate.fish
    
  • Install Dependencies:

    pip3 install -e
    

Running Tests

We use pytest for testing.

  • To execute all tests

    pytest
    
  • To execute a single test file

    pytest ./tests/unit_tests/test_file.py
    

Generating the documentation

cd docs
make html

Style Guide

Use autopep8 for auto code formatting:

# Install
pip3 install autopep8

# Apply to an entire directory
autopep8 directory_name --recursive --in-place --pep8-passes 2000 --verbose

# Or a single file
autopep8 file.py --in-place

Contact

You can contact us here, or send a message / open an issue in the repo.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

datacrunch-0.1.0.tar.gz (18.4 kB view details)

Uploaded Source

Built Distribution

datacrunch-0.1.0-py3-none-any.whl (38.9 kB view details)

Uploaded Python 3

File details

Details for the file datacrunch-0.1.0.tar.gz.

File metadata

  • Download URL: datacrunch-0.1.0.tar.gz
  • Upload date:
  • Size: 18.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.6.1 requests/2.24.0 setuptools/51.1.1 requests-toolbelt/0.9.1 tqdm/4.55.1 CPython/3.8.5

File hashes

Hashes for datacrunch-0.1.0.tar.gz
Algorithm Hash digest
SHA256 8bb637544a304daa4462acfb531ae130ee535497544cbf0c853e7a47ef6a9795
MD5 fc3d2e77d8485f47279bf30f8b241bfd
BLAKE2b-256 46515f9fc3891bc69508ef58adb07b7329460be4ad453135c82249ee9fc4b830

See more details on using hashes here.

File details

Details for the file datacrunch-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: datacrunch-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 38.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.6.1 requests/2.24.0 setuptools/51.1.1 requests-toolbelt/0.9.1 tqdm/4.55.1 CPython/3.8.5

File hashes

Hashes for datacrunch-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 8373d2cc9b4b3453c1b5a560b49a750138e810329d1d54cb62e6c90e94764eb9
MD5 432f18eb10630fb1ab7c2ce644500410
BLAKE2b-256 dd63e8066dfe53c2faee2f6daeeddaa3f79aab5a3aa4163d01ad89d7a37af32d

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page