Skip to main content

A package to implement a singleton for azure data storage gen2

Project description


AZ Data Lake

Instalación

pip3 install azdatalakefacade

Manual de uso

  1. Variables de Entorno
Variable Tipo de dato
AZ_DATA_LAKE_STRING_CONNECTION string
AZ_CONTAINNER_CLI string
  1. Funciones:

    • upload_file(blob_name, data): Este método permite subir un archivo a azure data storage gen2.
    • upsert_data_to_table(table_name, data): Este método permite subir datos a una tabla de azure data storage gen2.
    • send_data_to_queue(queue_name, data): Este método permite subir datos a una cola de azure data storage gen2.
    • get_messages_from_queue(queue_name, max_messages): Este método permite obtener datos de una cola de azure data storage gen2.
    • get_table_data(table_name, partition_key, row_key): Este método permite obtener datos de una tabla de azure data storage gen2.
    • get_all_table_data(table_name, partition_key, row_key): Este método permite obtener una tabla de azure data storage gen2.
    • get_data_by_partition(table_name, partition_key, row_key): Este método permite obtener los datos de una particion de una tabla de azure data storage gen2.
    • get_csv(blob_name): Este método permite obtener datos de un csv de azure data storage gen2 y retorna un dataframe.
  2. Ejemplos de Uso

from azdatalakefacade.singleton import AzDataLakeSingleton

# Crear instancia del singleton
az = AzDataLakeSingleton()

# Consultar datos de un csv
content = az.get_csv(blob_name="mis_datos.csv")
print(content)

# Subir un archivo
az.upload_file("local.csv", az.read_file_as_bytes("local.csv"))

# Consulta datos de una tabla
data = az.get_table_data("unitest3", "480217418839", 23)
print(data)

# actualizar datos de una tabla
az.upsert_data_to_table(table_name="unitest3", data=data)

# obtener tabla completa
data = az.get_all_table_data("alarmassolis")
print("tabla obtenidos: ")
print(data)


# obtener particion de tabla
data = az.get_data_by_partition("alarmassolis", "1298491919449258694_2025_01")
print("tabla obtenidos: ")
print(data)

By: Alan Medina ⚙️

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

azdatalakefacade-1.0.5.tar.gz (5.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

azdatalakefacade-1.0.5-py3-none-any.whl (6.5 kB view details)

Uploaded Python 3

File details

Details for the file azdatalakefacade-1.0.5.tar.gz.

File metadata

  • Download URL: azdatalakefacade-1.0.5.tar.gz
  • Upload date:
  • Size: 5.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.8.10

File hashes

Hashes for azdatalakefacade-1.0.5.tar.gz
Algorithm Hash digest
SHA256 f1478a4bcb29ddb4424ab334ed207e7b9b721a92f9e76411050788f9e97eaefd
MD5 4549903624058767c28a4c74f9052437
BLAKE2b-256 82259081cec2fa2502e0a0d98c6e378d94d4e77d60ddfefc02152251f214b2d9

See more details on using hashes here.

File details

Details for the file azdatalakefacade-1.0.5-py3-none-any.whl.

File metadata

File hashes

Hashes for azdatalakefacade-1.0.5-py3-none-any.whl
Algorithm Hash digest
SHA256 e2a68438253dbbe504b48f7d5354dce858e310be3f9cf3f7fa439648d54befcb
MD5 67748807a687e11703062e0c7de87dfc
BLAKE2b-256 aae9498962a611df98bb6e5e683053ea930909d11b27c07b16071cd3acb6c803

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page