sibi-flux 2026.1.12

Sibi Toolkit: A collection of tools for Data Analysis/Engineering.

SibiFlux

Production-grade data engineering toolkit with Datacubes, hybrid data loading, and optional MCP integration for agent workflows.

Overview

SibiFlux provides a unified workflow to initialize projects, generate and manage Datacubes, and orchestrate data artifacts across local and distributed environments. The core package lives in src/sibi_flux and ships with a CLI exposed as sibi-flux.

Key Capabilities

• Datacube discovery, generation, and extension via the dc CLI.
• Hybrid data loading with dataset and DataFrame utilities.
• Artifact orchestration and storage registry support.
• Optional MCP integration for agent interfaces.
• Optional geospatial helpers (OSMnx and related tooling).
• Dask and distributed utilities for scalable workloads.

Installation

Python 3.11+ is required. Install from source in your preferred environment manager:

pip install -e .

Optional extras:

• mcp for agent interfaces.
• geospatial for OSMnx and GIS helpers.
• complete for all optional extras.

Example:

pip install -e ".[mcp]"

Quick Start (CLI)

A typical project setup flow uses the CLI commands below.

sibi-flux init my-project --app
sibi-flux env --env-file .env
cd my-project
sibi-flux create-app my-app
sibi-flux dc workflow --force
sibi-flux propose-cubes <db_domain> my-app
sibi-flux create-cubes my-app

CLI Overview

The CLI entry point is sibi-flux.

• init initializes a new project (library or app template).
• env generates configuration files from .env.
• create-app scaffolds an application within a project.
• propose-cubes proposes Datacubes from a database domain.
• create-cubes generates app-specific Datacube extensions.
• dc ... provides Datacube discovery, mapping, and workflow commands.

Documentation

Project docs live under src/docs:

• src/docs/index.md entry index.
• src/docs/guides/cli_workflows.md for command usage.
• src/docs/guides/configuration.md for .env and settings.
• src/docs/guides/hybrid_data_loader.md for dataset loading.
• src/docs/guides/mcp/01_architecture_overview.md for MCP integration.
• src/docs/api_reference/ for module-level APIs.

Package Layout

• src/sibi_flux: Core package and CLI.
• src/sibi_dst: Secondary package.
• src/docs: Documentation and guides.
• solutions/: Example implementations and generators.
• tests/: Test suite and snapshots.

Development

Common tasks are defined in pyproject.toml under [tool.poe.tasks].

pytest tests/

License

Add your license information here.