Skip to main content

algomancy-data

Data layer for Algomancy dashboards: schemas, extract/transform/load (ETL) primitives, validators, and data containers used by the GUI and scenario packages.

Features

  • DataSource and BaseDataSource containers with table management and JSON (de)serialization
  • Pluggable ETL pipeline building blocks: Extractor, Transformer, Validator, Loader
  • DataManager orchestrators (stateful/stateless) to drive ETL and manage datasets
  • Declarative InputFileConfiguration for file inputs (CSV, XLSX, JSON)

Installation

pip install -e packages/algomancy-data

Requires Python >= 3.14. Core dependency: pandas.

Quick start: use DataSource directly

import pandas as pd
from algomancy_data import DataSource, DataClassification

ds = DataSource(ds_type=DataClassification.MASTER_DATA, name="warehouse")
ds.add_table("inventory", pd.DataFrame({"sku": ["A", "B"], "qty": [10, 5]}))

# JSON roundtrip
json_str = ds.to_json()
ds2 = DataSource.from_json(json_str)
assert ds2.get_table("inventory").equals(ds.get_table("inventory"))

Quick start: orchestrate ETL with a DataManager

DataManager wires Extractor → Transformer → Validator → Loader. You provide an ETLFactory that builds these parts for each input configuration.

from typing import List
from algomancy_data import (
    DataSource, DataClassification,
    DataManager, StatelessDataManager, ETLFactory,
    SingleInputFileConfiguration, FileExtension
)

class MyETLFactory(ETLFactory):
    # Implement factory methods to build Extractor/Transformer/Validator/Loader
    ...

input_cfgs: List[SingleInputFileConfiguration] = [
    SingleInputFileConfiguration(
        tag="inventory", file_name="inventory", extension=FileExtension.CSV
    )
]

dm: DataManager = StatelessDataManager(
    etl_factory=MyETLFactory,
    input_configs=input_cfgs,
    save_type="json",  # or other configured type
    data_object_type=DataSource,
)

files = dm.prepare_files(file_items_with_path=[("inventory", "./data/inventory.csv")])
ds: DataSource = dm.etl_data(files=files, dataset_name="warehouse")

Documentation and examples

  • Root docs: documentation/1_data.md
  • End‑to‑end usage in the example app: example/ (see example/data_handling and example/main.py)

Metadata

Release files for algomancy-data 0.10.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distribution (wheel)

Table of built distributions (wheels) for algomancy-data 0.10.0
File Interpreter ABI Platform Actions
algomancy_data-0.10.0-py3-none-any.whl Python 3 none any Details for algomancy_data-0.10.0-py3-none-any.whl

Release files / algomancy_data-0.10.0-py3-none-any.whl

Download URL algomancy_data-0.10.0-py3-none-any.whl
Size 56.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
514e56a11d026afb4afb165920ed7b6f04bf1516b1f72b7a3aee7d0763aa9a77
BLAKE2b-256 checksum
How to use checksums
ddabeaea254e29d8f30c450f717a0c391821d101063ab63a9ae1eba03cd2de29
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.3 {"installer":{"name":"uv","version":"0.12.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Security for algomancy-data 0.10.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page