Skip to main content

Kusto Ingest Client

Project description

Microsoft Azure Kusto Ingest Library for Python

.. code-block:: python

from azure.kusto.data import KustoConnectionStringBuilder, DataFormat
from azure.kusto.ingest import QueuedIngestClient, IngestionProperties, FileDescriptor, BlobDescriptor

ingestion_props = IngestionProperties(database="{database_name}", table="{table_name}", data_format=DataFormat.CSV)
client = QueuedIngestClient(KustoConnectionStringBuilder.with_interactive_login("https://ingest-{cluster_name}.kusto.windows.net"))

file_descriptor = FileDescriptor("{filename}.csv", 15360)  # in this example, the raw (uncompressed) size of the data is 15KB (15360 bytes)
client.ingest_from_file(file_descriptor, ingestion_properties=ingestion_props)
client.ingest_from_file("{filename}.csv", ingestion_properties=ingestion_props)

blob_descriptor = BlobDescriptor("https://{path_to_blob}.csv.gz?sas", 51200)  # in this example, the raw (uncompressed) size of the data is 50KB (52100 bytes)
client.ingest_from_blob(blob_descriptor, ingestion_properties=ingestion_props)

Overview

Kusto Python Ingest Client Library provides the capability to ingest data into Kusto clusters using Python. It is Python 3.x compatible and supports data types through familiar Python DB API interface.

It's possible to use the library, for instance, from Jupyter Notebooks <http://jupyter.org/>_ which are attached to Spark clusters, including, but not exclusively, Azure Databricks <https://azure.microsoft.com/en-us/services/databricks>_ instances.

  • How to install the package <https://github.com/Azure/azure-kusto-python#install>_.

  • Data ingest sample <https://github.com/Azure/azure-kusto-python/blob/master/azure-kusto-ingest/tests/sample.py>_.

  • GitHub Repository <https://github.com/Azure/azure-kusto-python/tree/master/azure-kusto-data>_.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

azure-kusto-ingest-5.0.4.tar.gz (22.3 kB view details)

Uploaded Source

Built Distribution

azure_kusto_ingest-5.0.4-py2.py3-none-any.whl (29.1 kB view details)

Uploaded Python 2Python 3

File details

Details for the file azure-kusto-ingest-5.0.4.tar.gz.

File metadata

  • Download URL: azure-kusto-ingest-5.0.4.tar.gz
  • Upload date:
  • Size: 22.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for azure-kusto-ingest-5.0.4.tar.gz
Algorithm Hash digest
SHA256 aa02ef6d767c20f3d1b6b12e01dbc9f2ba471e0ab3dacf8b4cf1d927e4a9ea47
MD5 1b3d6685517d7318acab7037b2e65f53
BLAKE2b-256 f38f82ef9115c13f9f749b423747d93936be01a35090b57b01c38bbc2e3b2190

See more details on using hashes here.

Provenance

The following attestation bundles were made for azure-kusto-ingest-5.0.4.tar.gz:

Publisher: release.yml on Azure/azure-kusto-python

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file azure_kusto_ingest-5.0.4-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for azure_kusto_ingest-5.0.4-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 8c5e5763db35d1f050c1fd81e2b5c5a5938ac69170408a1c248e0ed0e14e6eba
MD5 f1a45bb3ce284c37c4fc405df95d50b2
BLAKE2b-256 5f719d45315ff02c98f1dd2ff46f2d7ddae3cd50e97f6892115e21266b25ed03

See more details on using hashes here.

Provenance

The following attestation bundles were made for azure_kusto_ingest-5.0.4-py2.py3-none-any.whl:

Publisher: release.yml on Azure/azure-kusto-python

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page