Versatile Data Kit SDK plugin provides support for Properties API client that uses local FS storage.
Project description
This plugin allows vdk-core to read/write properties on the local FS. Mainly for development purposes, to simplify a use-case with local Properties API usage, that would otherwise require a Control Service instance prerequisite. For example, to quickly demo a data job that uses a secret, so that secret is quickly stored on the presenter's local FS.
Usage
Run
pip install vdk-properties-fs
After this, data jobs will be able to read and write properties stored on the local file system.
For example
def run(job_input: IJobInput):
my_props = {"key": "value"}
job_input.set_all_properties(my_props)
assert job_input.get_all_properties() == my_props
assert job_input.get_property("key") == "value"
Configuration
To enable the plugin, set "PROPERTIES_DEFAULT_TYPE" to "fs-properties-client". Run vdk config-help - search for those prefixed with "FS_PROPERTIES_" to see what configuration options are available.
Testing
Testing this plugin locally requires installing the dependencies listed in vdk-plugins/vdk-properties-fs/requirements.txt
Run
pip install -r requirements.txt
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Hashes for vdk-properties-fs-0.0.948436673.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 11bc83c4f3c429f7024bbe83183aedb2ea8e6e3894d50b9cb5ff143db4089f2b |
|
MD5 | 2c2c3bae067cf5ed1ade8000062f3b9b |
|
BLAKE2b-256 | 785c3ea2f75fc728abcb48ce593418f4ed9b1e849ca5b1481ad92c01d9d168d6 |