Batch Analytics

PySpark-based analytics pipeline for ClickHouse data: Extract → Transform → Stage → Analytics. Designed to run as the main application inside a Spark driver container (invoked by analytics_runners via SparkApplication CRD).

Bundle contents

Only the files required for the batch analytics job runner:

analytics/
├── pyproject.toml
├── requirements.txt          # core + scipy + boto3 + clickhouse-connect (single-file install)
├── requirements-batch.txt  # includes requirements.txt
├── README.md
└── src/
    └── batch_analytics/
        ├── __init__.py
        ├── __main__.py        # python -m batch_analytics
        ├── job_runner.py      # Entry point
        ├── config.py
        ├── extract.py
        ├── transform.py
        ├── log.py
        ├── README.md
        └── analytics/
            ├── __init__.py
            ├── linear_regression.py
            ├── correlation.py
            ├── pca_clustering.py
            └── t_test.py

Install

pip install batch-analytics — core (numpy only)
pip install batch-analytics[spark] — PySpark ETL + job runner + SciPy (t-test / ANOVA)
pip install batch-analytics[autogluon] — AutoGluon + I/O (Gluon image; no PySpark)
pip install batch-analytics[full] — PySpark + AutoGluon + I/O

pip install -e ".[spark]"   # dev

Run

# Via module
python -m batch_analytics

# Via CLI (after pip install -e .)
batch-analytics

# Full pipeline
batch-analytics

# Analytics only (from staged ClickHouse table)
batch-analytics --from-stage --modules lr corr pca ttest

Configuration

See src/batch_analytics/README.md for environment variables and usage.

Docker image

For Spark on Kubernetes, build an image that includes this package and exposes job_runner.py at the path used by mainApplicationFile (e.g. local:///opt/analytics/job_runner.py).

Metadata

Release files for batch-analytics 0.3.36.dev0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for batch-analytics 0.3.36.dev0
File	Size	Uploaded
batch_analytics-0.3.36.dev0.tar.gz	46.3 kB	Oct 2, 2026	Details

Built distribution (wheel)

Table of built distributions (wheels) for batch-analytics 0.3.36.dev0
File	Interpreter	ABI	Platform	Reset
batch_analytics-0.3.36.dev0-py3-none-any.whl 52.8 kB Oct 2, 2026	Python 3	none	any	Details

Total release size: 99.1 kB

Release files / batch_analytics-0.3.36.dev0.tar.gz

Download URL	batch_analytics-0.3.36.dev0.tar.gz
Size	46.3 kB
Tags	Source
SHA-256 checksum How to use checksums	`bafecea54777eea6168b4f7ed15023f89758ec24bd082342f03268a70bef3bdb`
BLAKE2b-256 checksum How to use checksums	`5f1ea4afefc4c4780feca62459c35fe0dcc775bf14e91233d994f4c1737b57db`
Upload date	Oct 2, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/6.2.0 CPython/3.14.4`

Release files / batch_analytics-0.3.36.dev0-py3-none-any.whl

Download URL	batch_analytics-0.3.36.dev0-py3-none-any.whl
Size	52.8 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`b1e9feb21f0f85e27b91c7bed1b69417f1e984d31afee9fdb31aadd135d4e660`
BLAKE2b-256 checksum How to use checksums	`b4482ad3f18f149ad6faca5ca6cd4a3ec6f921437e60fe048454190e739ed7c7`
Upload date	Oct 2, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/6.2.0 CPython/3.14.4`