Skip to main content

Spylon

Version Status Downloads

A set of compatibility routines for making it easier to interact with Scala from Python.

Occasionally Python-focused data shops need to use JVM languages for performance reasons. Generally this necessitates throwing away whole repositories of Python code and starting over or resorting to service architectures (e.g., Apache thrift) which increase system complexity.

You don’t have to.

Using py4j and Spylon you can readily interact with Scala code for more performance critical sections of your whilst leaving the rest unmodified.

Alternatively you can use it as a bridge to allow building wrappers for a Scala/Java codebase.

Installation

Spylon can be installed either from pip or conda-forge

Usage

The simplest way to use spylon is to use it to help with writing PySpark jobs. If you want to supply your own jars to load for usage as Spark user defined functions, you’d want to supply the jar with the udf implementation to spark via spark-submit.

For an easier interactive experience you can make use of the supplied Apache Spark launcher to make it simpler to instantiate a PySpark application from inside a python Jupyter notebook.

Extensions

Spylon is designed as an easy to extend toolkit. Since Apache Spark is a major user or Py4J, some special use cases have been implemented for that and its an example of some use cases for Spylon.

Metadata

Release files for spylon 0.1.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for spylon 0.1.3
File Size Uploaded Provenance Actions
spylon-0.1.3.tar.gz 69.8 kB Without provenance Details for spylon-0.1.3.tar.gz

Release files / spylon-0.1.3.tar.gz

Download URL spylon-0.1.3.tar.gz
Size 69.8 kB
Tags Source
SHA-256 checksum
How to use checksums
b918e4782bac8e135ee14d0c8346a74c134971ea8e2c8fb2d7538ec46370e15c
BLAKE2b-256 checksum
How to use checksums
f2b6b63db74aa2fc28c4c70233364381c67b37a1b9d06c94f12c2abc90dd71d0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Security for spylon 0.1.3

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page