Skip to main content

Fine Tuning Data Maker

Project description

Wyra

Wyra is a Python library designed to create and format data for fine-tuning OpenAI models, specifically tailored for Azure OpenAI services. It simplifies the process of converting text content into the JSON Lines (JSONL) format required for fine-tuning conversational AI models.

"Wyra" is a term used in indigenous languages to refer to a bird or bird species. Just like a bird, this library will help you "fly" through fine-tuning. Enjoy!

Features

  • Easy Integration: Seamlessly integrates with Azure OpenAI services.
  • Secure Data Handling: Utilizes encryption for sensitive data.
  • Automated Formatting: Converts text content into JSONL format effortlessly.
  • Customizable Prompts: Allows for flexible prompt creation for various use cases.

Installation

To install Wyra, use pip:

pip install wyra

Usage

Here's a basic example of how to use Wyra:

from wyra import FineTuningDataMaker

# Initialize the data maker
fine_tuning_creator = FineTuningDataMaker()

# Sample content to format
content = "Your text content here."

# Create and format data
formatted_data = fine_tuning_creator.format_data(content)

print(formatted_data)

# Save JSONL data to a file
with open('formatted_data.jsonl', 'w') as file:
    file.write(formatted_data)

License

This project is licensed under the MIT License. See the LICENSE file for details.

Contact

For any questions or feedback, please open an issue on our GitHub repository.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

wyra-0.0.2.tar.gz (7.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

wyra-0.0.2-py3-none-any.whl (5.3 kB view details)

Uploaded Python 3

File details

Details for the file wyra-0.0.2.tar.gz.

File metadata

  • Download URL: wyra-0.0.2.tar.gz
  • Upload date:
  • Size: 7.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.6

File hashes

Hashes for wyra-0.0.2.tar.gz
Algorithm Hash digest
SHA256 139d4232aace3f15aa29bfa6e7f3acb18e14c3cb96b00658661341a776fd6c14
MD5 918d981a1847a10d46c26318dbfd272c
BLAKE2b-256 b499ad017c4539121953afa6cce16b81170b91502909fede45eb3b16c236568d

See more details on using hashes here.

File details

Details for the file wyra-0.0.2-py3-none-any.whl.

File metadata

  • Download URL: wyra-0.0.2-py3-none-any.whl
  • Upload date:
  • Size: 5.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.6

File hashes

Hashes for wyra-0.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 03a6449cfe14389269f43455edf07f8ede62403090ef723f2aaf0c8d931e50a2
MD5 757df32641fd894ceb91fa487aed15b0
BLAKE2b-256 12b5de92aba6ec3a6e25252fc8542b0ba2c17a755b32334932c8df656e9ea8ee

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page