Skip to main content

Datasets and models for instruction-tuning

Project description

Datasets and models for instruction-tuning


txtinstruct is a framework for training instruction-tuned models.

architecture

The objective of this project is to support open data, open models and integration with your own data. One of the biggest problems today is the lack of licensing clarity with instruction-following datasets and large language models. txtinstruct makes it easy to build your own instruction-following datasets and use those datasets to train instructed-tuned models.

txtinstruct is built with Python 3.7+ and txtai.

Installation

The easiest way to install is via pip and PyPI

pip install txtinstruct

You can also install txtinstruct directly from GitHub. Using a Python Virtual Environment is recommended.

pip install git+https://github.com/neuml/txtinstruct

Python 3.7+ is supported

See this link to help resolve environment-specific install issues.

Examples

The following example notebooks show how to build models with txtinstruct.

Notebook Description
Introducing txtinstruct Build instruction-tuned datasets and models Open In Colab

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

txtinstruct-0.1.0.tar.gz (7.4 kB view details)

Uploaded Source

Built Distribution

txtinstruct-0.1.0-py3-none-any.whl (13.4 kB view details)

Uploaded Python 3

File details

Details for the file txtinstruct-0.1.0.tar.gz.

File metadata

  • Download URL: txtinstruct-0.1.0.tar.gz
  • Upload date:
  • Size: 7.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.26.0 setuptools/42.0.2 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.16

File hashes

Hashes for txtinstruct-0.1.0.tar.gz
Algorithm Hash digest
SHA256 a36c14bc357dc9714b5b724cefd97ef2db73ac75ca2983b6eb5ada8eaf7251d8
MD5 13bf931e4f4957667aa4f32b8500d2aa
BLAKE2b-256 f0e5fb8435fcf4681071c0db953bdb380075546c716990e80fd8e069c28ab9e4

See more details on using hashes here.

File details

Details for the file txtinstruct-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: txtinstruct-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 13.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.26.0 setuptools/42.0.2 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.16

File hashes

Hashes for txtinstruct-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 b807aa380e33c9be22f331093f7d7e5d5da137d31ef054d0570574a7b0e2552f
MD5 b62547b0c14aff700aa6ab91971cc1f4
BLAKE2b-256 e17b9eb3e17901d3db33884bea5e1160fe43444e34b16b62eced1c8229ea66cb

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page