Skip to main content

A package to implement a singleton for azure data storage gen2

Project description


AZ Data Lake

Instalación

pip3 install azdatalake

Manual de uso

  1. Variables de Entorno
Variable Tipo de dato
AZ_DATA_LAKE_STRING_CONNECTION string
AZ_CONTAINNER_CLI string
  1. Funciones:

    • upload_file(blob_name, data): Este método permite subir un archivo a azure data storage gen2.
    • upsert_data_to_table(table_name, data): Este método permite subir datos a una tabla de azure data storage gen2.
    • send_data_to_queue(queue_name, data): Este método permite subir datos a una cola de azure data storage gen2.
    • get_messages_from_queue(queue_name, max_messages): Este método permite obtener datos de una cola de azure data storage gen2.
    • get_table_data(table_name, partition_key, row_key): Este método permite obtener datos de una tabla de azure data storage gen2.
    • get_all_table_data(table_name, partition_key, row_key): Este método permite obtener una tabla de azure data storage gen2.
    • get_data_by_partition(table_name, partition_key, row_key): Este método permite obtener los datos de una particion de una tabla de azure data storage gen2.
    • get_csv(blob_name): Este método permite obtener datos de un csv de azure data storage gen2 y retorna un dataframe.
  2. Ejemplos de Uso

from azdatalake.singleton import AzDataLakeSingleton

# Crear instancia del singleton
az = AzDataLakeSingleton()

# Consultar datos de un csv
content = az.get_csv(blob_name="mis_datos.csv")
print(content)

# Subir un archivo
az.upload_file("local.csv", az.read_file_as_bytes("local.csv"))

# Consulta datos de una tabla
data = az.get_table_data("unitest3", "480217418839", 23)
print(data)

# actualizar datos de una tabla
az.upsert_data_to_table(table_name="unitest3", data=data)

# obtener tabla completa
data = az.get_all_table_data("alarmassolis")
print("tabla obtenidos: ")
print(data)


# obtener particion de tabla
data = az.get_data_by_partition("alarmassolis", "1298491919449258694_2025_01")
print("tabla obtenidos: ")
print(data)

By: Alan Medina ⚙️

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

azdatalakefacade-1.0.0.tar.gz (5.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

azdatalakefacade-1.0.0-py3-none-any.whl (6.0 kB view details)

Uploaded Python 3

File details

Details for the file azdatalakefacade-1.0.0.tar.gz.

File metadata

  • Download URL: azdatalakefacade-1.0.0.tar.gz
  • Upload date:
  • Size: 5.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.8.10

File hashes

Hashes for azdatalakefacade-1.0.0.tar.gz
Algorithm Hash digest
SHA256 c23167b1a7a23b72aaf6719479b6ee391f000e3ce987582fb3da25424a671564
MD5 e1df9cd74c887133493c11bb9740d816
BLAKE2b-256 490d3436f23149b818d814cb28a2f438e74c683aae36e97daf17052c44503fc4

See more details on using hashes here.

File details

Details for the file azdatalakefacade-1.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for azdatalakefacade-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 26cc2efd3fe38f574c84bea15e68bd1c5c95b4899bb9baab35087565cd491949
MD5 6c4eb4cf4066a65fa42c2e7ab85902fc
BLAKE2b-256 210578aeff38d42ec2bd4abd01d66bf61e4268b1eec52edbce6d9b60651a72f2

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page