Skip to main content

PySpark engine plugin for tigrbl.

Project description

tigrbl_engine_pyspark

A minimal PySpark engine plugin for tigrbl. It registers the pyspark engine via the tigrbl.engine entry point, so tigrbl discovers it automatically on import.

Install

pip install -e .

Usage

from tigrbl.engine import EngineSpec

spec = EngineSpec(kind="pyspark")
provider = spec.to_provider()
engine, session_factory = provider.build()

sess = session_factory()     # has .spark (SparkSession) and .close()
sess.spark.sql("SELECT 1").show()

Notes

  • Entry point group: tigrbl.engine
  • Target: tigrbl_engine_pyspark:register

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tigrbl_engine_pyspark-0.1.1.dev2.tar.gz (7.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tigrbl_engine_pyspark-0.1.1.dev2-py3-none-any.whl (11.5 kB view details)

Uploaded Python 3

File details

Details for the file tigrbl_engine_pyspark-0.1.1.dev2.tar.gz.

File metadata

  • Download URL: tigrbl_engine_pyspark-0.1.1.dev2.tar.gz
  • Upload date:
  • Size: 7.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.3 {"installer":{"name":"uv","version":"0.10.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for tigrbl_engine_pyspark-0.1.1.dev2.tar.gz
Algorithm Hash digest
SHA256 a9e59d1f668703b8dca548cc6078d83a98065d2aeda7ba7dbc9b865e96b5a7be
MD5 e91cc8f7852dbd84c05834e1804385ef
BLAKE2b-256 76ea46850146a0ce47b1e4f9b18af01120f21eae6d20b6bc5614e1a9ff63f49f

See more details on using hashes here.

File details

Details for the file tigrbl_engine_pyspark-0.1.1.dev2-py3-none-any.whl.

File metadata

  • Download URL: tigrbl_engine_pyspark-0.1.1.dev2-py3-none-any.whl
  • Upload date:
  • Size: 11.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.3 {"installer":{"name":"uv","version":"0.10.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for tigrbl_engine_pyspark-0.1.1.dev2-py3-none-any.whl
Algorithm Hash digest
SHA256 fb1848f62c64dbe06b61a96f8766469585c98ec937fbd0e52bd83b80734af0e6
MD5 36e80fd1a1949b786c4f3923e32532dc
BLAKE2b-256 abc53374ba78be343052306ff301295373185e90a250f8d2af1d146f689fb7ca

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page