together-worker

Example

cat examples/echo.py

from together_worker.fast_inference import FastInferenceInterface

class Echo(FastInferenceInterface):
    def setup(self, args):
        self.message = " to you too."

    def dispatch_request(self, args, env):
        prompt = args[0]["prompt"]
        return {
            "choices": [ { "text": prompt + self.message } ],
        }

Test with local REST server

pip install --upgrade together-worker
python -m together_worker.serving examples.echo Echo

curl -X POST http://127.0.0.1:5001/ -d '{ "prompt": "test123" }'
{"choices": [{"text": "test123 to you too."}]}

Setup dev

make install

Publish to PyPi

GitHub repo > Releases > Draft a new Release > Choose a tag > Create new tag on publish >

Name the tag using the current version from pyproject.toml with a "v" e.g. v1.0.9.

Publish Release

In the repo toolbar select > Actions

Verify the publish workflow is running and completes successfully

Metadata

Release files for together-worker 0.1.22

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for together-worker 0.1.22
File	Size	Uploaded
together_worker-0.1.22.tar.gz	8.4 kB	Aug 17, 2023	Details

Built distribution (wheel)

Table of built distributions (wheels) for together-worker 0.1.22
File	Interpreter	ABI	Platform	Reset
together_worker-0.1.22-py3-none-any.whl 10.1 kB Aug 17, 2023	Python 3	none	any	Details

Total release size: 18.6 kB

Release files / together_worker-0.1.22.tar.gz

Download URL	together_worker-0.1.22.tar.gz
Size	8.4 kB
Tags	Source
SHA-256 checksum How to use checksums	`0bd97bb3a85cb8d358cbad7f89da133afa0b2a3d7a26378560de9572756887e9`
BLAKE2b-256 checksum How to use checksums	`0d997d7a716b18841915f7ff1849e3b8838e4160d84c328edfe7eb0687eaa4ed`
Upload date	Aug 17, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.11.4`

Release files / together_worker-0.1.22-py3-none-any.whl

Download URL	together_worker-0.1.22-py3-none-any.whl
Size	10.1 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`f37d058968e90a6f66d283f32706cab21c2e8b904b27da5a49c32202865d2606`
BLAKE2b-256 checksum How to use checksums	`feb8fb82a7cbe4c94aad93de205cfc34ca3c107b021af0a9564e41c61725de23`
Upload date	Aug 17, 2023
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.11.4`