nose2-spark

nose2 plugin to run the tests with support of pyspark (Apache Spark).

Features:

Make “pyspark” importable in you code executed by nose2.
Add a list of py-files dependencies of your pyspark application (which is usually supplied as an option spark-submit --py-files ...).

Install

$ pip install nose2-spark

Load “nose2-spark” plugin into nose2 by creating nose2.cfg in your project directory:

[unittest]
plugins = nose2_spark

Run tests with nose2-spark activated (pyspark and friends are added to pythonpath):

$ nose2 --pyspark

nose2-spark will try to import pyspark by looking into:

You can set it manually in case if all of mentioned methods are failing to find Spark. Add section “nose2-spark” to nose2.cfg:

[nose2-spark]
spark_home = /opt/spark

You can add a list of required py-files to run your code:

[nose2-spark]
pyfiles = package1.zip
          package2.zip

Example of nose2.cfg with spark_home defined, one py-files dependency and auto activating nose2-spark plugin:

[unittest]
plugins = nose2_spark

[nose2-spark]
always-on = True
spark_home = /opt/spark
pyfiles = package1.zip

This will allow to run tests by single command:

$ nose2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution for nose2-spark 0.3
File	Size	Uploaded
nose2-spark-0.3.tar.gz	2.7 kB	Nov 15, 2016	Details

Table of built distributions (wheels) for nose2-spark 0.3
File	Interpreter	ABI	Platform	Reset
nose2_spark-0.3-py2.py3-none-any.whl 4.4 kB Nov 15, 2016	Python 3, Python 2	none	any	Details

Total release size: 7.1 kB

Download URL	nose2-spark-0.3.tar.gz
Size	2.7 kB
Tags	Source
SHA-256 checksum How to use checksums	`443d341664c623de629e4f9eb444404740f71ab16a2f742b3b54429e048e6bb7`
BLAKE2b-256 checksum How to use checksums	`b1db47d691433d4f0293904fdb1edb5fd759f89ef0018d0426f01cc7274e30cc`
Upload date	Nov 15, 2016
Uploaded using Trusted Publishing? What is trusted publishing?	No

Download URL	nose2_spark-0.3-py2.py3-none-any.whl
Size	4.4 kB
Tags	Python 2 Python 3
SHA-256 checksum How to use checksums	`17172396291eb7fa27235cfc2c6d7b7c6dbe5a11bda3987faf446bf0854c1620`
BLAKE2b-256 checksum How to use checksums	`77c003ffaa0bd3cf7c1f93d5a952794a7723eb2068c3cea1b8d38d0be74e2113`
Upload date	Nov 15, 2016
Uploaded using Trusted Publishing? What is trusted publishing?	No