Datasets and models for instruction-tuning
Project description
Datasets and models for instruction-tuning
txtinstruct is a framework for training instruction-tuned models.
The objective of this project is to support open data, open models and integration with your own data. One of the biggest problems today is the lack of licensing clarity with instruction-following datasets and large language models. txtinstruct makes it easy to build your own instruction-following datasets and use those datasets to train instructed-tuned models.
txtinstruct is built with Python 3.7+ and txtai.
Installation
The easiest way to install is via pip and PyPI
pip install txtinstruct
You can also install txtinstruct directly from GitHub. Using a Python Virtual Environment is recommended.
pip install git+https://github.com/neuml/txtinstruct
Python 3.7+ is supported
See this link to help resolve environment-specific install issues.
Examples
The following example notebooks show how to build models with txtinstruct.
Notebook | Description | |
---|---|---|
Introducing txtinstruct | Build instruction-tuned datasets and models |
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file txtinstruct-0.1.0.tar.gz
.
File metadata
- Download URL: txtinstruct-0.1.0.tar.gz
- Upload date:
- Size: 7.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.26.0 setuptools/42.0.2 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.16
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | a36c14bc357dc9714b5b724cefd97ef2db73ac75ca2983b6eb5ada8eaf7251d8 |
|
MD5 | 13bf931e4f4957667aa4f32b8500d2aa |
|
BLAKE2b-256 | f0e5fb8435fcf4681071c0db953bdb380075546c716990e80fd8e069c28ab9e4 |
File details
Details for the file txtinstruct-0.1.0-py3-none-any.whl
.
File metadata
- Download URL: txtinstruct-0.1.0-py3-none-any.whl
- Upload date:
- Size: 13.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.26.0 setuptools/42.0.2 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.16
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | b807aa380e33c9be22f331093f7d7e5d5da137d31ef054d0570574a7b0e2552f |
|
MD5 | b62547b0c14aff700aa6ab91971cc1f4 |
|
BLAKE2b-256 | e17b9eb3e17901d3db33884bea5e1160fe43444e34b16b62eced1c8229ea66cb |