llm-mpt30b

Plugin for LLM adding support for the MPT-30B language model.

This plugin uses TheBloke/mpt-30B-GGML. The code was inspired by abacaj/mpt-30B-inference.

Installation

Install this plugin in the same environment as LLM.

llm install llm-mpt30b

After installing the plugin you will need to download the ~19GB model file. You can do this by running:

llm mpt30b download

Usage

This plugin adds a model called mpt30b. You can execute it like this:

llm -m mpt30b "Three great names for a pet goat"

The alias -m mpt works as well.

You can pass the option -o verbose 1 to see more verbose output - currently a progress bar showing any additional downloads that are made during execution.

Development

To set up this plugin locally, first checkout the code. Then create a new virtual environment:

cd llm-mpt30b
python3 -m venv venv
source venv/bin/activate

Now install the dependencies and test dependencies:

pip install -e '.[test]'

To run the tests:

pytest

Metadata

Release files for llm-mpt30b 0.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for llm-mpt30b 0.1
File	Size	Uploaded	Provenance	Actions
llm-mpt30b-0.1.tar.gz	8.1 kB	Jul 12, 2023	Without provenance	Details for llm-mpt30b-0.1.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for llm-mpt30b 0.1
File	Interpreter	ABI	Platform	Actions Reset
llm_mpt30b-0.1-py3-none-any.whl 7.9 kB Jul 12, 2023 Without provenance	Python 3	none	any	Details for llm_mpt30b-0.1-py3-none-any.whl

Total release size: 15.9 kB

Release files / llm-mpt30b-0.1.tar.gz

Download URL	llm-mpt30b-0.1.tar.gz
Size	8.1 kB
Tags	Source
SHA-256 checksum How to use checksums	`c7524a4564827c5d41fa1c739f761f922a5dc35c98ee8c33174167b56877caf3`
BLAKE2b-256 checksum How to use checksums	`3c89d53f4453f8d1e729c214d7fd293e705778e40df05734d0dac5aac7cd5ded`
Upload date	Jul 12, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.11.4`

Release files / llm_mpt30b-0.1-py3-none-any.whl

Download URL	llm_mpt30b-0.1-py3-none-any.whl
Size	7.9 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`6d30f782f7033407501900380b3b058b0c3d47cafa477e705905de0fc2ac19bc`
BLAKE2b-256 checksum How to use checksums	`dba8a23ce0d1e970854101f286d29bc4faf3bf1f6d57964ec86d64738097b17d`
Upload date	Jul 12, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.11.4`

Security for llm-mpt30b 0.1

Report project as malware

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.1 This release

Jul 12, 2023 2 release files No provenance

llm-mpt30b 0.1