faker-pyspark 0.2.0

faker-pyspark is a PySpark DataFrame and Schema provider for the Faker python package

PySpark provider for Faker

faker-pyspark is a PySpark DataFrame and Schema (StructType) provider for the Faker Python package.

Description

faker-pyspark provides PySpark based fake data for testing purposes. The definition of "fake" in this context really means "random," as the data may look real. However, I make no claims about accuracy, so do not use this as real data!

Installation

Install with pip:

pip install faker-pyspark

Add as a provider to your Faker instance:

from faker import Faker
from faker_pyspark import PySparkProvider
fake.add_provider(PySparkProvider)

If you already use faker, you probably know the conventional use is:

from faker import Faker
fake = Faker()

PySpark DataFrame and Schema (StructType)

>>> df = fake.pyspark_dataframe()

>>> schema = fake.pyspark_schema()