Skip to main content

Refer to https://gai-labs.github.io/gai for more information

Project description

GAI SDK Setup Guide

Install

  1. Clone Repository recursively
git clone https://github.com/kakkoii1337/gai-sdk --recursive
  1. Update submodule branches
cd gai-sdk
git submodule foreach -q --recursive 'git checkout $(git config -f $toplevel/.gitmodules submodule.$name.branch || echo master)'
  1. Create conda env
conda create -n gai-sdk python=3.10.10 -y
conda activate gai-sdk
  1. Install Packages
poetry install

Initialise

gai init

Download model

gai pull exllamav2-mistral7b

Start server

gai docker start

If it is successfully started, you will see the following:

INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:12031 (Press CTRL+C to quit)

Test

gai news

demo

Quick Start

Run Quick Start Guide

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gai_sdk-1.0.5.tar.gz (6.2 MB view details)

Uploaded Source

Built Distribution

gai_sdk-1.0.5-py3-none-any.whl (66.2 kB view details)

Uploaded Python 3

File details

Details for the file gai_sdk-1.0.5.tar.gz.

File metadata

  • Download URL: gai_sdk-1.0.5.tar.gz
  • Upload date:
  • Size: 6.2 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.12

File hashes

Hashes for gai_sdk-1.0.5.tar.gz
Algorithm Hash digest
SHA256 8674ba3178dc48add6fdaa03aa440f88cb8bc7b45598c6ffe0de21e9339cd6b5
MD5 7417b5e283fa4e4dedde94b4bb4ff2a4
BLAKE2b-256 3917b0bea55044973988722a4f04962aed4bc1352cee9404baf89f2a12f43837

See more details on using hashes here.

File details

Details for the file gai_sdk-1.0.5-py3-none-any.whl.

File metadata

  • Download URL: gai_sdk-1.0.5-py3-none-any.whl
  • Upload date:
  • Size: 66.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.12

File hashes

Hashes for gai_sdk-1.0.5-py3-none-any.whl
Algorithm Hash digest
SHA256 d319bd216ef08eb6021b69c2381db9b784846fb5129f2764cbbbabc7b932b9e6
MD5 264e0542cd95dae17589ffbb268b41a5
BLAKE2b-256 c6dc7a4ac14a828a13e627665d91c2034ebb2edcd990ccd945ec2d6735f2f23d

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page