Skip to main content

VDK-INGEST-HTTP Plugin

This plugin provides functionality to ingest data over http.

Usage

To use the plugin, just install it, and set the method attribute of send_object_for_ingestion(), and send_tabular_data_for_ingestion() functions to "http".

Example:

def run(job_input: IJobInput):
    # Do something to get data for ingestion
    payload = get_some_data()

    # Ingest the data
    job_input.send_object_for_ingestion(payload=payload,
                                        destination_table="aa_test_table",
                                        method="http",
                                        target="http://example.com/data-source"
                                        )

The above example shows how to ingest json data. In this case, there are three arguments that are required: payload, method and target. This would be fixed in the future, so that only payload would be required.
The payload needs to be a json object, and should contain the destination_table inside, using the @table key. For example:

{
    "@table": "destination_table_name",
    "column1": "value1",
    "column2": "value2",
    "column3": "value3",
}

The method attribute needs to be provided for the time being.
The target attribute should specify the url endpoint, where the data will be ingested.

Metadata

Release files for vdk-ingest-http 0.1.352155979

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for vdk-ingest-http 0.1.352155979
File Size Uploaded
vdk-ingest-http-0.1.352155979.tar.gz 3.4 kB Details

Release files / vdk-ingest-http-0.1.352155979.tar.gz

Download URL vdk-ingest-http-0.1.352155979.tar.gz
Size 3.4 kB
Tags Source
SHA-256 checksum
How to use checksums
36ee777bbb0c755d2ef67ad2f135f5da54beb82bbc7a0412f3d15a5e34039cf6
BLAKE2b-256 checksum
How to use checksums
0a03cccea4f27f0c9ab5f15937a73a7c16ee4bd452cfc662678214b14ff63f85
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.2 importlib_metadata/4.6.3 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.0 CPython/3.7.11
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page