VDK-INGEST-FILE Plugin
This plugin provides functionality to ingest data into a file. It is intended for local testing.
Usage
To use the plugin, just install it, and set the method attribute of send_object_for_ingestion(),
and send_tabular_data_for_ingestion() functions to "file".
Example:
def run(job_input: IJobInput):
# Do something to get data for ingestion
payload = get_some_data()
# Ingest the data
job_input.send_object_for_ingestion(payload=payload,
destination_table="aa_test_table",
method="file",
target="name_of_file"
)
The above example shows how to ingest json data. In this case, there is only one argument that is required: payload.
It needs to be a json object, and can contain the destination_table inside, using the @table key. For example:
{
"@table": "destination_table_name",
"column1": "value1",
"column2": "value2",
"column3": "value3",
}
The target attribute is being used to specify the name of the file, where the data will be ingested. If not specified, it is constructed,
using the model, table.<creation-timestamp>.json.
1 maintainer
Metadata
1 maintainer
Release files for vdk-ingest-file 0.1.1431637373
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| vdk_ingest_file-0.1.1431637373.tar.gz | 3.6 kB | Details |
Release files / vdk_ingest_file-0.1.1431637373.tar.gz
| Download URL | vdk_ingest_file-0.1.1431637373.tar.gz |
|---|---|
| Size | 3.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
bbb1ca829bc2fad1429eaa5088cd5887e590446393c6a77f40b9bf69be40f43d
|
|
BLAKE2b-256 checksum How to use checksums |
decbf92b53708c0d55b4f84e4b23d0b22f3400686bfc8b46d8e23d002a6e00df
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.1.1 CPython/3.10.14
|
