Dataset Preparation for Transformers Fine-tuning
The Dataset Prep Transformers package simplifies the process of preparing datasets for fine-tuning or training various large language models available in the Hugging Face Transformers library. Whether you're using a model from the Hugging Face repository or have your own dataset, this package streamlines the data integration for a seamless training experience.
Features
- Easily integrate your dataset with Hugging Face Transformers models for training or fine-tuning.
- Specify the model repository ID and dataset from the Hugging Face library to automatically fetch and configure the data.
- Seamlessly incorporate your custom dataset by providing it as input to the package.
Installation
You can install the package using pip:
pip install d4train
Metadata
Release files for d4train 0.0.2.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| d4train-0.0.2.2.tar.gz | 3.0 kB | Without provenance | Details for d4train-0.0.2.2.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| d4train-0.0.2.2-py3-none-any.whl | Python 3 | none | any | Details for d4train-0.0.2.2-py3-none-any.whl |
Total release size: 6.2 kB
Release files / d4train-0.0.2.2.tar.gz
| Download URL | d4train-0.0.2.2.tar.gz |
|---|---|
| Size | 3.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
93b130b3b8229f358e57890b4c83adba95e351a4437f86db341faf0e5e5a9bff
|
|
BLAKE2b-256 checksum How to use checksums |
b5e83326c2cbc38cc1df84e029e676efa018d9b221d77b2d5534771ef071a116
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.11.5
|
Release files / d4train-0.0.2.2-py3-none-any.whl
| Download URL | d4train-0.0.2.2-py3-none-any.whl |
|---|---|
| Size | 3.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
fc14ba4a55ce6b8455e69896544077e79588c57f053d79ad403a78eb7959b0ca
|
|
BLAKE2b-256 checksum How to use checksums |
180570590d6cfc1a51d6750cddf5ee7730f5ca261f0d5eba75f72214cd1b5aaf
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.11.5
|
Security for d4train 0.0.2.2
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.