Skip to main content

PySpark engine plugin for distributed DataFrame integration, analytics workloads, and Tigrbl data workflows.

Project description

tigrbl_engine_pyspark

Tigrbl logo

PySpark engine plugin for distributed DataFrame integration, analytics workloads, and Tigrbl data workflows.

PyPI version for tigrbl_engine_pyspark Downloads for tigrbl_engine_pyspark Discord community for tigrbl_engine_pyspark Repository hits for tigrbl_engine_pyspark README Apache 2.0 license Python versions 3.10 | 3.11 | 3.12 | 3.13 | 3.14 for tigrbl_engine_pyspark Workspace group for tigrbl_engine_pyspark

What is tigrbl_engine_pyspark?

PySpark engine plugin for distributed DataFrame integration, analytics workloads, and Tigrbl data workflows.

Why use tigrbl_engine_pyspark?

Use it when a Tigrbl application needs this backend without installing every engine package.

When should I install tigrbl_engine_pyspark?

Install it when the storage, analytics, cache, or integration workload named by this package is the intended runtime backend.

Who is tigrbl_engine_pyspark for?

Application developers, data platform engineers, and operators choosing concrete persistence or data-plane behavior.

Where does tigrbl_engine_pyspark fit?

tigrbl_engine_pyspark lives at pkgs/engines/tigrbl_engine_pyspark and serves DataFrame-backed tabular workflows.

How does tigrbl_engine_pyspark work?

It exposes a tigrbl.engine entry point and a package register() hook so Tigrbl can discover or load the backend at runtime.

Certification Status

  • Package status: governed package in the tigrbl/tigrbl workspace.
  • Governance source: SSOT registry.
  • Release evidence: publish workflow validates package builds, tests, GitHub release assets, and PyPI publication for managed packages.
  • Local certification guard: pkgs/core/tigrbl_tests/tests/unit/test_package_badges_and_notices.py verifies every package README keeps the Discord badge, Apache 2.0 badge, explicit Python-version badge, LICENSE, and NOTICE.
  • Scope note: this README documents the package boundary. Runtime feature support remains governed by .ssot/ entities and the conformance docs linked below.

Install

uv add tigrbl_engine_pyspark
pip install tigrbl_engine_pyspark

Surface Coverage

Surface Value
PyPI package tigrbl_engine_pyspark
Repository path pkgs/engines/tigrbl_engine_pyspark
Python import root tigrbl_engine_pyspark
Console scripts none declared
Entry points tigrbl.engine
Optional extras none declared
Legal files LICENSE, NOTICE
Supported Python `3.10

What It Owns

tigrbl_engine_pyspark owns the engine plugin boundary. It should be installed when you need this package's focused responsibility without assuming every other Tigrbl workspace package is present.

Implementation orientation:

  • tigrbl_engine_pyspark: engine, session

Public API and Import Surface

  • Import roots: tigrbl_engine_pyspark.
  • Public symbols: PySparkSession, pyspark_capabilities, pyspark_engine, register.
  • Workspace dependencies: tigrbl.
  • External runtime dependencies: pyspark>=3.4.

Usage Examples

Verify the installed package

python -m pip show tigrbl_engine_pyspark
python - <<'PY'
from importlib.metadata import version
print(version("tigrbl_engine_pyspark"))
PY

Register the engine plugin explicitly

from tigrbl_engine_pyspark import register

register()

Discover the engine through package metadata

from importlib.metadata import entry_points

for entry_point in entry_points(group="tigrbl.engine"):
    if entry_point.module.startswith("tigrbl_engine_pyspark"):
        plugin_register = entry_point.load()
        plugin_register()

Install alongside the facade

uv add tigrbl tigrbl_engine_pyspark
pip install tigrbl tigrbl_engine_pyspark

How To Choose This Package

Choose tigrbl_engine_pyspark when the quick-answer table matches your use case. Choose tigrbl instead when you want the full public facade. Choose a lower-level package such as tigrbl-core, tigrbl-base, or tigrbl-runtime when you are building framework extensions or testing a specific internal boundary.

Related Packages

Documentation Links

Support

Package-local Boundary

This README is the package-local distribution entry point for tigrbl_engine_pyspark. It answers install, usage, API, ownership, and certification-orientation questions for this package. Broader architectural decisions, release status, and cross-package proof chains remain in the repository-level docs and SSOT registry.

License

Licensed under the Apache License, Version 2.0. See LICENSE, NOTICE, and the official Apache 2.0 license text.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tigrbl_engine_pyspark-0.4.2.dev4.tar.gz (10.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tigrbl_engine_pyspark-0.4.2.dev4-py3-none-any.whl (14.4 kB view details)

Uploaded Python 3

File details

Details for the file tigrbl_engine_pyspark-0.4.2.dev4.tar.gz.

File metadata

  • Download URL: tigrbl_engine_pyspark-0.4.2.dev4.tar.gz
  • Upload date:
  • Size: 10.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.18 {"installer":{"name":"uv","version":"0.11.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for tigrbl_engine_pyspark-0.4.2.dev4.tar.gz
Algorithm Hash digest
SHA256 0a1135e409e8b06e45b5876850bb3bab763e00f7c8986ebf461b0f4447e83ff6
MD5 aa57838716911ecba18867b2a7414444
BLAKE2b-256 478da47c3601d0b957f15d85c50fe1f4a2e448e12c1dd26ab5a5ef9569a61278

See more details on using hashes here.

File details

Details for the file tigrbl_engine_pyspark-0.4.2.dev4-py3-none-any.whl.

File metadata

  • Download URL: tigrbl_engine_pyspark-0.4.2.dev4-py3-none-any.whl
  • Upload date:
  • Size: 14.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.18 {"installer":{"name":"uv","version":"0.11.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for tigrbl_engine_pyspark-0.4.2.dev4-py3-none-any.whl
Algorithm Hash digest
SHA256 50ca10d5c19398692d328da0cec451ccb1eaec9c6bf637ac5d536b2dc91d721d
MD5 9ec82658508414cf8a6638d489888e0b
BLAKE2b-256 d5d1cbd5cd311f4e6e0ce22674cefcf5331b5acdecbc4db4034c44f4c0471931

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page