Skip to main content

PySpark engine plugin for tigrbl.

Project description

tigrbl_engine_pyspark

A minimal PySpark engine plugin for tigrbl. It registers the pyspark engine via the tigrbl.engine entry point, so tigrbl discovers it automatically on import.

Install

pip install -e .

Usage

from tigrbl.engine import EngineSpec

spec = EngineSpec(kind="pyspark")
provider = spec.to_provider()
engine, session_factory = provider.build()

sess = session_factory()     # has .spark (SparkSession) and .close()
sess.spark.sql("SELECT 1").show()

Notes

  • Entry point group: tigrbl.engine
  • Target: tigrbl_engine_pyspark:register

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tigrbl_engine_pyspark-0.1.1.dev1.tar.gz (7.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tigrbl_engine_pyspark-0.1.1.dev1-py3-none-any.whl (11.5 kB view details)

Uploaded Python 3

File details

Details for the file tigrbl_engine_pyspark-0.1.1.dev1.tar.gz.

File metadata

  • Download URL: tigrbl_engine_pyspark-0.1.1.dev1.tar.gz
  • Upload date:
  • Size: 7.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.3 {"installer":{"name":"uv","version":"0.10.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for tigrbl_engine_pyspark-0.1.1.dev1.tar.gz
Algorithm Hash digest
SHA256 75ea56128852b3171c0ccc54eb8e00559ed92cc8f280ef09979f91b29931ab53
MD5 2c48c2ac945c207ffc2838f3e16f86ee
BLAKE2b-256 464572870ec04c338c2d407f8a6cdfffb881232827c3ff987e93bbd873eda21a

See more details on using hashes here.

File details

Details for the file tigrbl_engine_pyspark-0.1.1.dev1-py3-none-any.whl.

File metadata

  • Download URL: tigrbl_engine_pyspark-0.1.1.dev1-py3-none-any.whl
  • Upload date:
  • Size: 11.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.3 {"installer":{"name":"uv","version":"0.10.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for tigrbl_engine_pyspark-0.1.1.dev1-py3-none-any.whl
Algorithm Hash digest
SHA256 4d86a3be9a53f16163723fe51d4158d3fd7f35b6edee186c426aa518a60f101c
MD5 96b9ea95b1245c471926f2438553181a
BLAKE2b-256 77114292448f1f5bf116ab57cda8914870fe1feed55ffb8c4bebb4503e7de60e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page