faker-pyspark 0.1.0

faker_pyspark is a PySpark provider for the Faker python package

PySpark provider for Faker

faker_pyspark is a provider for the Faker Python package.

Description

faker_pyspark provides PySpark based fake data for testing purposes. The definition of "fake" in this context really means "random," as the data may look real. However, I make no claims about accuracy, so do not use this as real data!

Installation

Install with pip:

pip install faker_pyspark

Add as a provider to your Faker instance:

from faker import Faker
from faker_pyspark import PySparkProvider
fake.add_provider(PySparkProvider)

If you already use faker, you probably know the conventional use is:

from faker import Faker
fake = Faker()

PySpark DataFrame and Schema (StructType)

>>> df = fake.pyspark_dataframe()

>>> schema = fake.pyspark_schema()