Skip to main content

A package to implement a singleton for azure data storage gen2

Project description


AZ Data Lake

Instalación

pip3 install azdatalake

Manual de uso

  1. Variables de Entorno
Variable Tipo de dato
AZ_DATA_LAKE_STRING_CONNECTION string
AZ_CONTAINNER_CLI string
  1. Funciones:

    • upload_file(blob_name, data): Este método permite subir un archivo a azure data storage gen2.
    • upsert_data_to_table(table_name, data): Este método permite subir datos a una tabla de azure data storage gen2.
    • send_data_to_queue(queue_name, data): Este método permite subir datos a una cola de azure data storage gen2.
    • get_messages_from_queue(queue_name, max_messages): Este método permite obtener datos de una cola de azure data storage gen2.
    • get_table_data(table_name, partition_key, row_key): Este método permite obtener datos de una tabla de azure data storage gen2.
    • get_all_table_data(table_name, partition_key, row_key): Este método permite obtener una tabla de azure data storage gen2.
    • get_data_by_partition(table_name, partition_key, row_key): Este método permite obtener los datos de una particion de una tabla de azure data storage gen2.
    • get_csv(blob_name): Este método permite obtener datos de un csv de azure data storage gen2 y retorna un dataframe.
  2. Ejemplos de Uso

from azdatalakefacade.singleton import AzDataLakeSingleton

# Crear instancia del singleton
az = AzDataLakeSingleton()

# Consultar datos de un csv
content = az.get_csv(blob_name="mis_datos.csv")
print(content)

# Subir un archivo
az.upload_file("local.csv", az.read_file_as_bytes("local.csv"))

# Consulta datos de una tabla
data = az.get_table_data("unitest3", "480217418839", 23)
print(data)

# actualizar datos de una tabla
az.upsert_data_to_table(table_name="unitest3", data=data)

# obtener tabla completa
data = az.get_all_table_data("alarmassolis")
print("tabla obtenidos: ")
print(data)


# obtener particion de tabla
data = az.get_data_by_partition("alarmassolis", "1298491919449258694_2025_01")
print("tabla obtenidos: ")
print(data)

By: Alan Medina ⚙️

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

azdatalakefacade-1.0.1.tar.gz (5.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

azdatalakefacade-1.0.1-py3-none-any.whl (8.9 kB view details)

Uploaded Python 3

File details

Details for the file azdatalakefacade-1.0.1.tar.gz.

File metadata

  • Download URL: azdatalakefacade-1.0.1.tar.gz
  • Upload date:
  • Size: 5.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.8.10

File hashes

Hashes for azdatalakefacade-1.0.1.tar.gz
Algorithm Hash digest
SHA256 72724b05583c745a4236a2475a55697d3a55d1f09c29c128fef80e5f08f31459
MD5 537028b31dcb148aa3626a59d30249f7
BLAKE2b-256 f0aa652c83ee113b0568fdbae07837861b373b06701036c6ef9e5d1a55bfa9a8

See more details on using hashes here.

File details

Details for the file azdatalakefacade-1.0.1-py3-none-any.whl.

File metadata

File hashes

Hashes for azdatalakefacade-1.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 3d98898e01a23a6b93657d5c31aa413cc501d984c8821bb5ea1d943f6db1394d
MD5 61a6276d6b934047fb13017b3adb7d59
BLAKE2b-256 f5a2269017d591c8f639d737ea200e3e9deaff57ee30b0a6ba605b07150225ee

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page