Skip to main content

Batch Analytics

PySpark-based analytics pipeline for ClickHouse data: Extract → Transform → Stage → Analytics. Designed to run as the main application inside a Spark driver container (invoked by analytics_runners via SparkApplication CRD).

Bundle contents

Only the files required for the batch analytics job runner:

analytics/
├── pyproject.toml
├── requirements.txt          # core + scipy + boto3 + clickhouse-connect (single-file install)
├── requirements-batch.txt  # includes requirements.txt
├── README.md
└── src/
    └── batch_analytics/
        ├── __init__.py
        ├── __main__.py        # python -m batch_analytics
        ├── job_runner.py      # Entry point
        ├── config.py
        ├── extract.py
        ├── transform.py
        ├── log.py
        ├── README.md
        └── analytics/
            ├── __init__.py
            ├── linear_regression.py
            ├── correlation.py
            ├── pca_clustering.py
            └── t_test.py

Install

  • pip install batch-analytics — core (numpy only)
  • pip install batch-analytics[spark] — PySpark ETL + job runner + SciPy (t-test / ANOVA)
  • pip install batch-analytics[autogluon] — AutoGluon + I/O (Gluon image; no PySpark)
  • pip install batch-analytics[full] — PySpark + AutoGluon + I/O
pip install -e ".[spark]"   # dev

Run

# Via module
python -m batch_analytics

# Via CLI (after pip install -e .)
batch-analytics

# Full pipeline
batch-analytics

# Analytics only (from staged ClickHouse table)
batch-analytics --from-stage --modules lr corr pca ttest

Configuration

See src/batch_analytics/README.md for environment variables and usage.

Docker image

For Spark on Kubernetes, build an image that includes this package and exposes job_runner.py at the path used by mainApplicationFile (e.g. local:///opt/analytics/job_runner.py).

Metadata

Release files for batch-analytics 1.1.8

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for batch-analytics 1.1.8
File Size Uploaded Provenance Actions
batch_analytics-1.1.8.tar.gz 46.3 kB Without provenance Details for batch_analytics-1.1.8.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for batch-analytics 1.1.8
File Interpreter ABI Platform Actions
batch_analytics-1.1.8-py3-none-any.whl Python 3 none any Details for batch_analytics-1.1.8-py3-none-any.whl

Total release size: 99.0 kB

Release files / batch_analytics-1.1.8.tar.gz

Download URL batch_analytics-1.1.8.tar.gz
Size 46.3 kB
Tags Source
SHA-256 checksum
How to use checksums
27d6c6624d705104f475b19c0739b99d5d5611b487912d5733e3621c29e26545
BLAKE2b-256 checksum
How to use checksums
091c20ef6a24c3cfb2d91405818ea86d3e7ea46d87a38ede1fb1532e52596189
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.14.4

Release files / batch_analytics-1.1.8-py3-none-any.whl

Download URL batch_analytics-1.1.8-py3-none-any.whl
Size 52.7 kB
Tags Python 3
SHA-256 checksum
How to use checksums
3c92d9c44c6345a6865d54fc84b6ff29018696406c62ffef3ed0e9fe91302ec1
BLAKE2b-256 checksum
How to use checksums
c7b26925225f48ca8e1411ba876c5dd3597e7a9ae3ad8fec286e6609634e814b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.14.4

Security for batch-analytics 1.1.8

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

1.1.8 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page