Skip to main content

A DataSource for reading and writing HuggingFace Datasets in Spark

Project description

pyspark_huggingface

PySpark custom data source for Hugging Face Datasets

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pyspark_huggingface-0.0.1.dev0.tar.gz (6.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pyspark_huggingface-0.0.1.dev0-py3-none-any.whl (7.0 kB view details)

Uploaded Python 3

File details

Details for the file pyspark_huggingface-0.0.1.dev0.tar.gz.

File metadata

  • Download URL: pyspark_huggingface-0.0.1.dev0.tar.gz
  • Upload date:
  • Size: 6.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.4 CPython/3.11.6 Darwin/23.4.0

File hashes

Hashes for pyspark_huggingface-0.0.1.dev0.tar.gz
Algorithm Hash digest
SHA256 355034e0892ec14d72b2f71cb905d01d744b2fdf95904ed465b9a02347ff87d7
MD5 5a435d047d050ac6d97eb848ece39d9c
BLAKE2b-256 e689a9ee8d812bc78805255d7a393edf9ba0f35729ac6ff3ed9aafa69201b633

See more details on using hashes here.

File details

Details for the file pyspark_huggingface-0.0.1.dev0-py3-none-any.whl.

File metadata

File hashes

Hashes for pyspark_huggingface-0.0.1.dev0-py3-none-any.whl
Algorithm Hash digest
SHA256 c0b1081bb48289d145e51f556fc3d873c18baf84101ef064de0c3140cffbaee8
MD5 7f33b727cff310a38c7a359b16192a60
BLAKE2b-256 909dfc37860dd36ab0d329b8ab656241a56d15b9ed54636ec7724931ea737816

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page