VDK-INGEST-FILE Plugin
This plugin provides functionality to ingest data into a file. It is intended for local testing.
Usage
To use the plugin, just install it, and set the method attribute of send_object_for_ingestion(),
and send_tabular_data_for_ingestion() functions to "file".
Example:
def run(job_input: IJobInput):
# Do something to get data for ingestion
payload = get_some_data()
# Ingest the data
job_input.send_object_for_ingestion(payload=payload,
destination_table="aa_test_table",
method="file",
target="name_of_file"
)
The above example shows how to ingest json data. In this case, there is only one argument that is required: payload.
It needs to be a json object, and can contain the destination_table inside, using the @table key. For example:
{
"@table": "destination_table_name",
"column1": "value1",
"column2": "value2",
"column3": "value3",
}
The target attribute is being used to specify the name of the file, where the data will be ingested. If not specified, it is constructed,
using the model, table.<creation-timestamp>.json.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file vdk-ingest-file-0.1.415625538.tar.gz.
File metadata
- Download URL: vdk-ingest-file-0.1.415625538.tar.gz
- Upload date:
- Size: 2.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/3.6.0 importlib_metadata/4.8.2 pkginfo/1.8.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
27c92194a695d90606b5c5ead5a4d926e966156f9a76a42a8dd4b201b5f7c5c6
|
|
| MD5 |
6ec107cc10b6c85e147379b0ee5ab0e6
|
|
| BLAKE2b-256 |
ed5e9c2b7a06c2900f4dbd75c764499e2b42056f3894dce11af38275e0827170
|
