Skip to main content

VDK-INGEST-FILE Plugin

This plugin provides functionality to ingest data into a file. It is intended for local testing.

Usage

To use the plugin, just install it, and set the method attribute of send_object_for_ingestion(), and send_tabular_data_for_ingestion() functions to "file".

Example:

def run(job_input: IJobInput):
    # Do something to get data for ingestion
    payload = get_some_data()

    # Ingest the data
    job_input.send_object_for_ingestion(payload=payload,
                                        destination_table="aa_test_table",
                                        method="file",
                                        target="name_of_file"
                                        )

The above example shows how to ingest json data. In this case, there is only one argument that is required: payload.
It needs to be a json object, and can contain the destination_table inside, using the @table key. For example:

{
    "@table": "destination_table_name",
    "column1": "value1",
    "column2": "value2",
    "column3": "value3",
}

The target attribute is being used to specify the name of the file, where the data will be ingested. If not specified, it is constructed, using the model, table.<creation-timestamp>.json.

Metadata

Release files for vdk-ingest-file 0.1.948436673

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for vdk-ingest-file 0.1.948436673
File Size Uploaded
vdk-ingest-file-0.1.948436673.tar.gz 3.4 kB Details

Release files / vdk-ingest-file-0.1.948436673.tar.gz

Download URL vdk-ingest-file-0.1.948436673.tar.gz
Size 3.4 kB
Tags Source
SHA-256 checksum
How to use checksums
59ffb04df28803e4a6cbc25d1d42d63cce18781046533486b4a229268960d6ad
BLAKE2b-256 checksum
How to use checksums
e3cc685f49a66a68ab4e45a7be8f1ce9e9f384733b3512ecffa4ced62399e3b5
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.10.12
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page