Skip to main content

Versatile Data Kit SDK plugin exposing CLI commands for managing the lifecycle of a Data Jobs.

Project description

monthly download count for vdk-plugin-control-cli

This plugin allows vdk-core to access vdk-control-cli functionality.

Upon installing it enhances vdk with CLI commands for data job lifecycle management available from vdk-control-cli package

It will also install properties plugin and switch Properties in vdk to use Control Service Properties API. By default no Properties backend is used otherwise.

Usage

pip install vdk-plugin-control-cli

New CLI commands

Then on the vdk CLI you should be able to see the new commands. Run

vdk --help

and you will see extra commands being added:

Commands:
  ...
  login                  Authentication against the Control Service.
  logout                 Logout the user from the Data Jobs Service by...
  create                 Creates a new data job in cloud and locally.
  delete                 Deletes a data job from the cloud.
  deploy                 Deploys a data job.
  ...

And you can use them from the same CLI vdk

New properties backend client registered

You can now access remote properties from Control Service Properties API Store state, configuration or secrets there using CLI or Python JobInput API

For example, let's store some api-uri

vdk properties --set 'api-uri' 'http://cool.cool.api.com'

and then we can use it in our data job

def run(job_input: IJobInput):
    uri = job_input.get_property('api-uri')
    print(requests.get(uri))

Build

The easiest way is to use the ../build-plugin.sh helper script

../build-plugin.sh

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vdk-plugin-control-cli-0.1.1220499344.tar.gz (13.4 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page