Skip to main content

A DataSource for reading and writing HuggingFace Datasets in Spark

Project description

pyspark_huggingface

PySpark custom data source for Hugging Face Datasets

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pyspark_huggingface-0.0.1.tar.gz (6.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pyspark_huggingface-0.0.1-py3-none-any.whl (7.2 kB view details)

Uploaded Python 3

File details

Details for the file pyspark_huggingface-0.0.1.tar.gz.

File metadata

  • Download URL: pyspark_huggingface-0.0.1.tar.gz
  • Upload date:
  • Size: 6.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.4 CPython/3.11.6 Darwin/23.4.0

File hashes

Hashes for pyspark_huggingface-0.0.1.tar.gz
Algorithm Hash digest
SHA256 8ec7fd614eab6da8aba55f1364659efe52786fdb28a742211db2acb4ed22862c
MD5 6e3df3073381c4610723967f5c9b2e7c
BLAKE2b-256 db2020f64110a4b548d20796b53f23ecdd3fc12ef6af2c450f9629d549de0b8b

See more details on using hashes here.

File details

Details for the file pyspark_huggingface-0.0.1-py3-none-any.whl.

File metadata

File hashes

Hashes for pyspark_huggingface-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 862bd099c0119bca73a46e6b0345c8098ec04d5492d05b288abab1ef40d2694c
MD5 b51487037f3095d773155878d2f3d02b
BLAKE2b-256 cd2ff3dd9c82b271e105209eb36220d232b39ba38357f08440c7270f8a547037

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page