Skip to main content

Fine Tuning Data Maker

Project description

wyra

Wyra is a Python library designed to create and format data for fine-tuning OpenAI models, specifically tailored for Azure OpenAI services. It simplifies the process of converting text content into the JSON Lines (JSONL) format required for fine-tuning conversational AI models.

Features

  • Easy Integration: Seamlessly integrates with Azure OpenAI services.
  • Secure Data Handling: Utilizes encryption for sensitive data.
  • Automated Formatting: Converts text content into JSONL format effortlessly.
  • Customizable Prompts: Allows for flexible prompt creation for various use cases.

Installation

To install Wyra, use pip:

pip install wyra

Usage

Here's a basic example of how to use Wyra:

from wyra import FineTuningDataMaker

# Initialize the data maker
fine_tunner = FineTuningDataMaker()

# Sample content to format
content = "Your text content here."

# Create and format data
formatted_data = fine_tunner.format_data(content)

print(formatted_data)
# Save JSONL data to a file
with open('formatted_data.jsonl', 'w') as file:
    for item in jsonl_data:
        file.write(f"{item}\n")

License

This project is licensed under the MIT License. See the LICENSE file for details.

Contact

For any questions or feedback, please open an issue on our GitHub repository.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

wyra-0.0.1.tar.gz (7.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

wyra-0.0.1-py3-none-any.whl (5.1 kB view details)

Uploaded Python 3

File details

Details for the file wyra-0.0.1.tar.gz.

File metadata

  • Download URL: wyra-0.0.1.tar.gz
  • Upload date:
  • Size: 7.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.6

File hashes

Hashes for wyra-0.0.1.tar.gz
Algorithm Hash digest
SHA256 13a55adc0532f8108da58bc6a0b9bac5ac1436cb0d6c5c8baa78fedc8d01593f
MD5 fa0990edacaf5c1fe0a435c253d61e9d
BLAKE2b-256 cbc344a96c8308302cab8406cfbeac390db742950eec2dbade4a243be404e5c8

See more details on using hashes here.

File details

Details for the file wyra-0.0.1-py3-none-any.whl.

File metadata

  • Download URL: wyra-0.0.1-py3-none-any.whl
  • Upload date:
  • Size: 5.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.6

File hashes

Hashes for wyra-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 c6ab205e1564f33a15449e578061944e999e5feb5268f418a198178bc635dc1c
MD5 2b2c7d808b81e54632ec673cb1797783
BLAKE2b-256 c22df6e1cea1c7bd938baf019f898e565086dbfe8815742026fb79bc9a86c777

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page