faker-pyspark is a PySpark DataFrame and Schema provider for the Faker python package
Project description
PySpark provider for Faker
faker-pyspark
is a PySpark DataFrame and Schema (StructType) provider for the Faker
Python package.
Description
faker-pyspark
provides PySpark based fake data for testing purposes. The definition of "fake" in this context really means "random," as the data may look real. However, I make no claims about accuracy, so do not use this as real data!
Installation
Install with pip:
pip install faker-pyspark
Add as a provider to your Faker instance:
from faker import Faker
from faker_pyspark import PySparkProvider
fake.add_provider(PySparkProvider)
If you already use faker, you probably know the conventional use is:
from faker import Faker
fake = Faker()
PySpark DataFrame, Schema and more
>>> df = fake.pyspark_dataframe()
>>> schema = fake.pyspark_schema()
>>> df_updated = fake.pyspark_update_dataframe(df)
>>> column_names = fake.pyspark_column_names()
>>> data = fake.pyspark_data_dict_using_schema(schema)
>>> data = fake.pyspark_data_dict()
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
faker_pyspark-0.3.0.tar.gz
(3.8 kB
view hashes)
Built Distribution
Close
Hashes for faker_pyspark-0.3.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a626017b7221ba9eca29f8dc4ce04f6407f36a566eb05c846a7ddb9aa7e23e94 |
|
MD5 | aba55f9429be1a77154ecc146d180e15 |
|
BLAKE2b-256 | 5742f0492a1223a35ddd356dc9cdeca5110c30fd2fe5b0c5ec506eb1bac10cb7 |