Skip to main content

this contains some kind operations in it.

Project description

Dataset Preparation for Transformers Fine-tuning

License

The Dataset Prep Transformers package simplifies the process of preparing datasets for fine-tuning or training various large language models available in the Hugging Face Transformers library. Whether you're using a model from the Hugging Face repository or have your own dataset, this package streamlines the data integration for a seamless training experience.

Features

  • Easily integrate your dataset with Hugging Face Transformers models for training or fine-tuning.
  • Specify the model repository ID and dataset from the Hugging Face library to automatically fetch and configure the data.
  • Seamlessly incorporate your custom dataset by providing it as input to the package.

Installation

You can install the package using pip:

pip install train-y

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

d4train-0.0.2.tar.gz (2.9 kB view details)

Uploaded Source

Built Distribution

d4train-0.0.2-py3-none-any.whl (3.1 kB view details)

Uploaded Python 3

File details

Details for the file d4train-0.0.2.tar.gz.

File metadata

  • Download URL: d4train-0.0.2.tar.gz
  • Upload date:
  • Size: 2.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.3

File hashes

Hashes for d4train-0.0.2.tar.gz
Algorithm Hash digest
SHA256 abb019e7e8b6fca040a10c28caf503bd76641f2c8182a029c1f34ba9b574b3c8
MD5 d4a77bd9942c34fc2a7598eb50152526
BLAKE2b-256 db86799681a4852b9de6ba2a3de0988c396687b249268d06317681a819146310

See more details on using hashes here.

File details

Details for the file d4train-0.0.2-py3-none-any.whl.

File metadata

  • Download URL: d4train-0.0.2-py3-none-any.whl
  • Upload date:
  • Size: 3.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.3

File hashes

Hashes for d4train-0.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 f7d3eed54198aacb9ac5dfd3fc3ee119a1cd7dcc30d1a1d488664c4294cbb8a6
MD5 71d9f5e2265094dd8e943286bbc5f815
BLAKE2b-256 12d529f0e95842cc5245ad49cd114f4bce0dda09d467dd9913f745913c3178ca

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page