Skip to main content

Refer to https://gai-labs.github.io/gai for more information

Project description

GAI SDK Setup Guide

Install

  1. Clone Repository recursively
git clone https://github.com/kakkoii1337/gai-sdk --recursive
  1. Update submodule branches
cd gai-sdk
git submodule foreach -q --recursive 'git checkout $(git config -f $toplevel/.gitmodules submodule.$name.branch || echo master)'
  1. Create conda env
conda create -n gai-sdk python=3.10.10 -y
conda activate gai-sdk
  1. Install Packages
poetry install

Initialise

gai init

Download model

gai pull exllamav2-mistral7b

Start server

gai docker start

If it is successfully started, you will see the following:

INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:12031 (Press CTRL+C to quit)

Test

gai news

demo

Quick Start

Run Quick Start Guide

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gai_sdk-1.0.7.tar.gz (13.8 MB view details)

Uploaded Source

Built Distribution

gai_sdk-1.0.7-py3-none-any.whl (66.2 kB view details)

Uploaded Python 3

File details

Details for the file gai_sdk-1.0.7.tar.gz.

File metadata

  • Download URL: gai_sdk-1.0.7.tar.gz
  • Upload date:
  • Size: 13.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.12

File hashes

Hashes for gai_sdk-1.0.7.tar.gz
Algorithm Hash digest
SHA256 2ff5981627edd5424e9f8596c2fc973676501ba51516cb1ac9c32112435cb42a
MD5 bb006394113d1b6c33f9bf598210b90f
BLAKE2b-256 2dd83388245023bbb3b6a91fe5bbdb51f65a2e9d4267d383ca6467f1c7ace71b

See more details on using hashes here.

File details

Details for the file gai_sdk-1.0.7-py3-none-any.whl.

File metadata

  • Download URL: gai_sdk-1.0.7-py3-none-any.whl
  • Upload date:
  • Size: 66.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.12

File hashes

Hashes for gai_sdk-1.0.7-py3-none-any.whl
Algorithm Hash digest
SHA256 8d21bc7c554c41c3a6dc0768efccd91b147bfafeb458eaabec0f992cd830de0e
MD5 08df108e3933272059e4deb4babb4437
BLAKE2b-256 051bf7c93c1cfea5061ae02344aef20b8757c7cedca32b613785bf81a33e7dce

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page