Versatile Data Kit SDK plugin exposing CLI commands for managing the lifecycle of a Data Jobs.
Project description
This plugin allows vdk-core to access vdk-control-cli functionality.
Upon installing it enhances vdk with CLI commands for data job lifecycle management available from vdk-control-cli package
It will also install properties plugin and switch Properties in vdk to use Control Service Properties API. By default no Properties backend is used otherwise.
Usage
pip install vdk-plugin-control-cli
New CLI commands
Then on the vdk CLI you should be able to see the new commands. Run
vdk --help
and you will see extra commands being added:
Commands:
...
login Authentication against the Control Service.
logout Logout the user from the Data Jobs Service by...
create Creates a new data job in cloud and locally.
delete Deletes a data job from the cloud.
deploy Deploys a data job.
...
And you can use them from the same CLI vdk
New properties backend client registered
You can now access remote properties from Control Service Properties API Store state, configuration or secrets there using CLI or Python JobInput API
For example, let's store some api-uri
vdk properties --set 'api-uri' 'http://cool.cool.api.com'
and then we can use it in our data job
def run(job_input: IJobInput):
uri = job_input.get_property('api-uri')
print(requests.get(uri))
Build
The easiest way is to use the ../build-plugin.sh helper script
../build-plugin.sh
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Hashes for vdk_plugin_control_cli-0.1.1431637373.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | ce596fbaa29eb16cdd44d94afa62c914c4a34fb1b6aa281c08c011d520e7c29b |
|
MD5 | eac53dfd94bbdd3008d67849064567e9 |
|
BLAKE2b-256 | 9c866f63016df34d99d3810dd982822df97405428d9efde1740cff99c673778a |