Skip to main content

A DataSource for reading and writing HuggingFace Datasets in Spark

Project description

pyspark_huggingface

PySpark custom data source for Hugging Face Datasets

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pyspark_huggingface-0.1.1.tar.gz (10.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pyspark_huggingface-0.1.1-py3-none-any.whl (12.3 kB view details)

Uploaded Python 3

File details

Details for the file pyspark_huggingface-0.1.1.tar.gz.

File metadata

  • Download URL: pyspark_huggingface-0.1.1.tar.gz
  • Upload date:
  • Size: 10.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.4 CPython/3.11.6 Darwin/23.4.0

File hashes

Hashes for pyspark_huggingface-0.1.1.tar.gz
Algorithm Hash digest
SHA256 ec57722657dc1b93787e43111852ea8d464f35360e1daa5e5f4730635772f44d
MD5 fd1d8df1216e54a44802872f43cb0540
BLAKE2b-256 5f3d0e39ed2132da3bdc7cd14dffe48846283acb0588a681982efef9a71ca169

See more details on using hashes here.

File details

Details for the file pyspark_huggingface-0.1.1-py3-none-any.whl.

File metadata

File hashes

Hashes for pyspark_huggingface-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 df556efe67b1e44d79245d30d287b0ba0553d3b7944b1f440a5f55cbb977883d
MD5 f90cf9bb40034b401d5b7919923d2f6e
BLAKE2b-256 19e895e63115509f2e3484816cff79e382b2c8c789f121b6dbcf56f181fc2f07

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page