Skip to main content

Refer to https://gai-labs.github.io/gai for more information

Project description

GAI SDK Setup Guide

Install

  1. Clone Repository recursively
git clone https://github.com/kakkoii1337/gai-sdk --recursive
  1. Update submodule branches
cd gai-sdk
git submodule foreach -q --recursive 'git checkout $(git config -f $toplevel/.gitmodules submodule.$name.branch || echo master)'
  1. Create conda env
conda create -n gai-sdk python=3.10.10 -y
conda activate gai-sdk
  1. Install Packages
poetry install

Initialise

gai init

Download model

gai pull exllamav2-mistral7b

Start server

gai docker start

If it is successfully started, you will see the following:

INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:12031 (Press CTRL+C to quit)

Test

gai news

demo

Quick Start

Run Quick Start Guide

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gai_sdk-1.0.6.tar.gz (6.2 MB view details)

Uploaded Source

Built Distribution

gai_sdk-1.0.6-py3-none-any.whl (66.2 kB view details)

Uploaded Python 3

File details

Details for the file gai_sdk-1.0.6.tar.gz.

File metadata

  • Download URL: gai_sdk-1.0.6.tar.gz
  • Upload date:
  • Size: 6.2 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.12

File hashes

Hashes for gai_sdk-1.0.6.tar.gz
Algorithm Hash digest
SHA256 054f32ba23a0b66948b3bb75e2dc71bff92e86717872c4d71de4bb8d6a2e2ee3
MD5 a13da77ea2968a12ecc74a041a96e12b
BLAKE2b-256 3bdee0957f9e40f54e04abbc67f4288f35ef9ac9425a5e5990e7199d7885447f

See more details on using hashes here.

File details

Details for the file gai_sdk-1.0.6-py3-none-any.whl.

File metadata

  • Download URL: gai_sdk-1.0.6-py3-none-any.whl
  • Upload date:
  • Size: 66.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.12

File hashes

Hashes for gai_sdk-1.0.6-py3-none-any.whl
Algorithm Hash digest
SHA256 bdf61e57da41a0dd58dffbc2fdc7b4601dec84b36b74a5203422c86591403204
MD5 4cb969f96d7c295592839b50802b505e
BLAKE2b-256 2df667f893f4699180871695c994b4840669486a58ac39e8be55e68290d523ff

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page