Skip to main content

PySpark Data Audit library

Project description

PySparkAudit: PySpark Data Audit

This is our PySpark Data Audit library repositories. The API can be found at: https://runawayhorse001.github.io/PySparkAudit. If you want to install it, you can

Install from PyPI

You can install the PySparkAudit from PyPI:

pip install PySparkAudit

Install from Repo

Or you can istall the PySparkAudit from the repo:

1. clone

git clone https://github.com/runawayhorse001/PySparkAudit.git

2. install

cd PySparkAudit
pip install -r requirements.txt 
python setup.py install

3. test

cd PySparkAudit/test
spark-submit test.py

4. uninstall

pip uninstall PySparkAudit

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

PySparkAuditTest-1.0.0.tar.gz (9.9 kB view details)

Uploaded Source

Built Distribution

PySparkAuditTest-1.0.0-py3-none-any.whl (10.1 kB view details)

Uploaded Python 3

File details

Details for the file PySparkAuditTest-1.0.0.tar.gz.

File metadata

  • Download URL: PySparkAuditTest-1.0.0.tar.gz
  • Upload date:
  • Size: 9.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.4

File hashes

Hashes for PySparkAuditTest-1.0.0.tar.gz
Algorithm Hash digest
SHA256 22b4b732488c4d52c25f5b4373ef07096f87378fbeeb370facb0e3c719a9d194
MD5 4d2c3a40f771d5fff83f1e6e1cd6195d
BLAKE2b-256 053f7369e69242767ac3f09a4648bb26b8448ba070a6a7535e9bc708ee8a8c5a

See more details on using hashes here.

File details

Details for the file PySparkAuditTest-1.0.0-py3-none-any.whl.

File metadata

  • Download URL: PySparkAuditTest-1.0.0-py3-none-any.whl
  • Upload date:
  • Size: 10.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.4

File hashes

Hashes for PySparkAuditTest-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 b657df9f58085edded050ff88bb8469c81ee5891b86d79f542409bee24ced5a2
MD5 041c34af6d9d9701ce68ad60059db816
BLAKE2b-256 3988e44fca86eeea6a8ea9bc23f55da359d2b622c4d7945bd08e39c5c9b7634b

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page