VDK-INGEST-HTTP Plugin
This plugin provides functionality to ingest data over http.
Usage
To use the plugin, just install it, and set the method attribute of send_object_for_ingestion(),
and send_tabular_data_for_ingestion() functions to "http".
Example:
def run(job_input: IJobInput):
# Do something to get data for ingestion
payload = get_some_data()
# Ingest the data
job_input.send_object_for_ingestion(payload=payload,
destination_table="aa_test_table",
method="http",
target="http://example.com/data-source"
)
The above example shows how to ingest json data. In this case, there are three arguments that are required: payload,
method and target. This would be fixed in the future, so that only payload would be required.
The payload needs to be a json object, and should contain the destination_table inside, using the @table key. For example:
{
"@table": "destination_table_name",
"column1": "value1",
"column2": "value2",
"column3": "value3",
}
The method attribute needs to be provided for the time being.
The target attribute should specify the url endpoint, where the data will be ingested.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file vdk-ingest-http-0.1.353684692.tar.gz.
File metadata
- Download URL: vdk-ingest-http-0.1.353684692.tar.gz
- Upload date:
- Size: 3.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/3.4.2 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.1 CPython/3.7.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8e8b09c3bc62c6932897675e754771c7a8a3b2f194513a65ce51fecbc1032df9
|
|
| MD5 |
6fa083463ac1d9d249875a9dba8df3b1
|
|
| BLAKE2b-256 |
7c0f775d3862906f84f84e8db918170d4c700b078037c3b5566e38f35cf26230
|
