Skip to main content

sparklanes is a lightweight data processing framework for Apache Sparkwritten in Python. It was built with the intention to make buildingcomplex spark processing pipelines simpler, by shifting the focustowards writing data processing code without having to spent much timeon the surrounding application architecture. Data processing pipelines, or lanes, are built by stringing togetherencapsulated processor classes, which allows creation of lane definitionswith an arbitrary processor order, where processors can be easilyremoved, added or swapped. Processing pipelines can be defined using lane configuration YAML files,to then be packaged and submitted to spark using a single command.Alternatively, the same can be achieved manually by using the frameworkAPI.

Metadata

Release files for sparklanes 0.2.4

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for sparklanes 0.2.4
File Size Uploaded Provenance Actions
sparklanes-0.2.4.tar.gz 14.7 kB Without provenance Details for sparklanes-0.2.4.tar.gz

Built distributions (wheels)

Table of built distributions (wheels) for sparklanes 0.2.4
File Interpreter ABI Platform Actions
sparklanes-0.2.4-py3-none-any.whl Python 3 none any Details for sparklanes-0.2.4-py3-none-any.whl
sparklanes-0.2.4-py2-none-any.whl Python 2 none any Details for sparklanes-0.2.4-py2-none-any.whl

Total release size: 52.3 kB

Release files / sparklanes-0.2.4.tar.gz

Download URL sparklanes-0.2.4.tar.gz
Size 14.7 kB
Tags Source
SHA-256 checksum
How to use checksums
06d5909c9c2ce2e1e66d647b04589b2621532eff43502d415996be86937f7c22
BLAKE2b-256 checksum
How to use checksums
61bb8c22201fd293a0415b17cf08037f28fb97da0bf6b57e682b44e848b50613
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.12.1 pkginfo/1.5.0.1 requests/2.21.0 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.30.0 CPython/3.6.5

Release files / sparklanes-0.2.4-py3-none-any.whl

Download URL sparklanes-0.2.4-py3-none-any.whl
Size 18.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
b23e0a319574e37827c9d70ca745972829c05ba82b4ef4e03fbcee4cf248cb28
BLAKE2b-256 checksum
How to use checksums
16f86f60e8c998ca5a3b0ac86dbcd8ddb0ad1a41a7056611651a8364c8e664e8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.12.1 pkginfo/1.5.0.1 requests/2.21.0 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.30.0 CPython/3.6.5

Release files / sparklanes-0.2.4-py2-none-any.whl

Download URL sparklanes-0.2.4-py2-none-any.whl
Size 18.8 kB
Tags Python 2
SHA-256 checksum
How to use checksums
791aa71df792d8dd4b316a1ad9fab1b8e1327103b86794ab5f97e6a170be6fbc
BLAKE2b-256 checksum
How to use checksums
bfedd90ea71cf31f719c3d3aee57362ebc72778b33ff30bf57bf0bd1fdeb2dbe
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.12.1 pkginfo/1.5.0.1 requests/2.21.0 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.30.0 CPython/3.6.5

Security for sparklanes 0.2.4

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page