Fine Tuning Data Maker
Project description
wyra
Wyra is a Python library designed to create and format data for fine-tuning OpenAI models, specifically tailored for Azure OpenAI services. It simplifies the process of converting text content into the JSON Lines (JSONL) format required for fine-tuning conversational AI models.
Features
- Easy Integration: Seamlessly integrates with Azure OpenAI services.
- Secure Data Handling: Utilizes encryption for sensitive data.
- Automated Formatting: Converts text content into JSONL format effortlessly.
- Customizable Prompts: Allows for flexible prompt creation for various use cases.
Installation
To install Wyra, use pip:
pip install wyra
Usage
Here's a basic example of how to use Wyra:
from wyra import FineTuningDataMaker
# Initialize the data maker
fine_tunner = FineTuningDataMaker()
# Sample content to format
content = "Your text content here."
# Create and format data
formatted_data = fine_tunner.format_data(content)
print(formatted_data)
# Save JSONL data to a file
with open('formatted_data.jsonl', 'w') as file:
for item in jsonl_data:
file.write(f"{item}\n")
License
This project is licensed under the MIT License. See the LICENSE file for details.
Contact
For any questions or feedback, please open an issue on our GitHub repository.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file wyra-0.0.1.tar.gz.
File metadata
- Download URL: wyra-0.0.1.tar.gz
- Upload date:
- Size: 7.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.12.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
13a55adc0532f8108da58bc6a0b9bac5ac1436cb0d6c5c8baa78fedc8d01593f
|
|
| MD5 |
fa0990edacaf5c1fe0a435c253d61e9d
|
|
| BLAKE2b-256 |
cbc344a96c8308302cab8406cfbeac390db742950eec2dbade4a243be404e5c8
|
File details
Details for the file wyra-0.0.1-py3-none-any.whl.
File metadata
- Download URL: wyra-0.0.1-py3-none-any.whl
- Upload date:
- Size: 5.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.12.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c6ab205e1564f33a15449e578061944e999e5feb5268f418a198178bc635dc1c
|
|
| MD5 |
2b2c7d808b81e54632ec673cb1797783
|
|
| BLAKE2b-256 |
c22df6e1cea1c7bd938baf019f898e565086dbfe8815742026fb79bc9a86c777
|