Skip to main content

Refer to https://gai-labs.github.io/gai for more information

Project description

GAI SDK Setup Guide

Install

  1. Clone Repository recursively
git clone https://github.com/kakkoii1337/gai-sdk --recursive
  1. Update submodule branches
cd gai-sdk
git submodule foreach -q --recursive 'git checkout $(git config -f $toplevel/.gitmodules submodule.$name.branch || echo master)'
  1. Create conda env
conda create -n gai-sdk python=3.10.10 -y
conda activate gai-sdk
  1. Install Packages
poetry install

Initialise

gai init

Download model

gai pull exllamav2-mistral7b

Start server

gai docker start

If it is successfully started, you will see the following:

INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:12031 (Press CTRL+C to quit)

Test

gai news

demo

Quick Start

Run Quick Start Guide

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gai_sdk-1.0.133.tar.gz (4.5 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

gai_sdk-1.0.133-py3-none-any.whl (3.4 MB view details)

Uploaded Python 3

File details

Details for the file gai_sdk-1.0.133.tar.gz.

File metadata

  • Download URL: gai_sdk-1.0.133.tar.gz
  • Upload date:
  • Size: 4.5 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.12

File hashes

Hashes for gai_sdk-1.0.133.tar.gz
Algorithm Hash digest
SHA256 36b8904f53a4408fcef6cf78b94cf4e6b8a9ef75ebfc8a1df1457d4fcc3af4c4
MD5 e84b0904104c1f1ed577ab2ec2eab502
BLAKE2b-256 0a5501306f93939569df29849284fc48f28dd40d5018872a49749e2f2f8dcc53

See more details on using hashes here.

File details

Details for the file gai_sdk-1.0.133-py3-none-any.whl.

File metadata

  • Download URL: gai_sdk-1.0.133-py3-none-any.whl
  • Upload date:
  • Size: 3.4 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.12

File hashes

Hashes for gai_sdk-1.0.133-py3-none-any.whl
Algorithm Hash digest
SHA256 cf0743faefc102db18d1bde82fdf57a4c33be266d9931aebbae688c31799d159
MD5 7a3abe46ccb728c3fdfaa45979531a0c
BLAKE2b-256 17219778ada47b80b3efda6d4dc3ec20b5660146649615908dce0ff0741769d1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page