GLLM Inference

Description

A library containing components related to model inferences in Gen AI applications.

Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here

Extras (required only for Artifact Registry installations):

  1. gcloud CLI (for authentication) — Install here, then log in using: 
    gcloud auth login

Option 1: Install from Artifact Registry

This option requires authentication via the gcloud CLI.

uv pip install \
  --extra-index-url "https://oauth2accesstoken:$(gcloud auth print-access-token)@glsdk.gdplabs.id/gen-ai-internal/simple/" \
  gllm-inference

Option 2: Install from PyPI

This option requires no authentication. However, it installs the binary wheel version of the package, which is fully usable but does not include source code.

uv pip install gllm-inference-binary

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login

  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository

1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-inference

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.6.113.post1)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for glx-sre from gravatar.com glx-sre

Credits

Author: Henry Wicaksono

Requires

Python <3.14, >=3.11

Provides Extra

dev anthropic bedrock cohere datasaur google huggingface litellm livekit openai portkey-ai snowflake twelvelabs voyage xai

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_inference_binary-0.6.108-cp313-cp313-win_amd64.whl (2.6 MB view details)

Uploaded CPython 3.13Windows x86-64

gllm_inference_binary-0.6.108-cp313-cp313-manylinux_2_31_x86_64.whl (3.9 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.31+ x86-64

gllm_inference_binary-0.6.108-cp313-cp313-macosx_13_0_arm64.whl (3.1 MB view details)

Uploaded CPython 3.13macOS 13.0+ ARM64

gllm_inference_binary-0.6.108-cp312-cp312-win_amd64.whl (2.6 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_inference_binary-0.6.108-cp312-cp312-manylinux_2_31_x86_64.whl (3.9 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_inference_binary-0.6.108-cp312-cp312-macosx_13_0_arm64.whl (3.0 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_inference_binary-0.6.108-cp311-cp311-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_inference_binary-0.6.108-cp311-cp311-manylinux_2_31_x86_64.whl (3.6 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_inference_binary-0.6.108-cp311-cp311-macosx_13_0_arm64.whl (3.0 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_inference_binary-0.6.108-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.108-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 d0f5daa5a8abefe9e973f2bea26cc8af90782d7969103472d335eb5422cb50df
MD5 67a8cd6c486948091215dc592d7a91d3
BLAKE2b-256 9a8c6e482198eadf32efb7c6a7e3c8c6c471635eca514416ebdc0bf1d7123bcf

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.108-cp313-cp313-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.108-cp313-cp313-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.108-cp313-cp313-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 32a32ac911c05a860e86dd5abeef95c52dc6626cc7f9c2c9c775ec0caf6317c4
MD5 13521f0e73149f8bfbd90dbb40da11b4
BLAKE2b-256 7868d12ac8322d2c6d9644868051ec10d757c034e9ac128f70eaffe8be0dd2b8

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.6.108-cp313-cp313-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.108-cp313-cp313-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 880ec875287409ac54657cfc091f167078bc014c81f50f83f89d9de924e50bc8
MD5 e546887c4e158c5e39f6b5a666f13228
BLAKE2b-256 cc26aff7a3c79970f8db18769fd8b97440e7232cc79eaa36c0544fb84be1d129

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.108-cp313-cp313-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.108-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.108-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 450b3786b99b5c5d166abf415128811d1be3cd53d90fac7bbd4a9518c5ff8342
MD5 20aa975f84f4f85412c36aea1f397387
BLAKE2b-256 18d2452ba5ad1275851c1bcb2ad7c0ccf4188f159301e74ec292a882395c9e0e

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.108-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.108-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.108-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 f46894dfd7c551a65647c105412d437942468a3207bad0ff9976994ba9eccb56
MD5 359073408b5ad105fae3648974509360
BLAKE2b-256 b8a25ec494a5ea2a3f82c1d18e96ac7486cfcb29b95627f9595de6f69982b8f9

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.6.108-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.108-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 6162eb0432fe0a6f764737d03c811f32a7e11c5cf26bc7c6055521739718c776
MD5 08713a259c0d4eafa07e92270facca6b
BLAKE2b-256 0f076cb3283fb72860b9b7d37d70ed46968b8f1fbc49da9474bb40032692e0e9

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.108-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.108-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.108-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 3f5f78e3ef2588ef990e542e4786ee24bcdf76069dc56d806365618378192341
MD5 c290d01cdd09ac062bdcdbde9ca246c5
BLAKE2b-256 41117461ec75f6367b48d894721bbed93fd07b73546114a21c10ba97beaad42f

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.108-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.108-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.108-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 6997477807a880bd06384f40ac64618d79fce7509dbb9874c3dcabd23165af43
MD5 4306637790eed459770d535fa8a147b1
BLAKE2b-256 4fea5f9aa5f6a106a8ef01b6e55a0dfa2c32e5c87bbfa2b4240619d7f0403844

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.6.108-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.108-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 ed9abc8198147c84c973f06dbb6500255a33e94e31908fd1b2168876ea065364
MD5 a041f3d8bb43ef66e93d1d742ca64af7
BLAKE2b-256 1788378f965c8e67c42993760bbc704928694ca22e270380841a861dbfb0fadf

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.108-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.6.113.post1

0.6.113

0.6.112

0.6.111

0.6.110

0.6.109

This release

0.6.108

0.6.107

0.6.106

0.6.105.post1

0.6.105

0.6.104

0.6.103

0.6.102.post1

0.6.102

0.6.101

0.6.100

0.6.99

0.6.98

0.6.97

0.6.96

0.6.95

0.6.94

0.6.93.post1

0.6.93

0.6.92

0.6.91

0.6.90

0.6.89

0.6.88

0.6.87

0.6.86

0.6.85

0.6.84

0.6.83

0.6.82

0.6.81

0.6.80

0.6.79

0.6.78

0.6.77

0.6.76

0.6.75

0.6.74

0.6.73

0.6.72.post1

0.6.72

0.6.71

0.6.70

0.6.69.post6

0.6.69.post5

0.6.69.post4

0.6.69.post3

0.6.69.post2

0.6.69.post1

0.6.69

0.6.69b4 pre-release

0.6.69b3 pre-release

0.6.69b2 pre-release

0.6.69b1 pre-release

0.6.68

0.6.67

0.6.66

0.6.65

0.6.64

0.6.63

0.6.62

0.6.61

0.6.60

0.6.59

0.6.58

0.6.57

0.6.56

0.6.55

0.6.54

0.6.53

0.6.52

0.6.51.post1

0.6.50

0.6.49

0.6.48

0.6.47

0.6.46

0.6.45

0.6.44

0.6.43

0.6.42

0.6.41

0.6.40

0.6.39

0.6.38

0.6.37

0.6.36

0.6.35

0.6.34

0.6.33

0.6.32

0.6.31

0.6.30

0.6.29

0.6.28

0.6.27

0.6.26

0.6.25

0.6.24

0.6.23

0.6.22

0.6.21

0.6.20

0.6.19

0.6.18

0.6.17

0.6.16

0.6.15

0.6.14

0.6.13.post1

0.6.13

0.6.13b1 pre-release

0.6.12

0.6.11

0.6.10

0.6.9

0.6.8

0.6.7

0.6.6

0.6.5

0.6.4

0.6.3

0.6.2

0.6.1

0.6.0

0.5.166

0.5.165

0.5.164

0.5.163

0.5.162.post1

0.5.162

0.5.161

0.5.160.post1

0.5.160

0.5.159.post1

0.5.159

0.5.158

0.5.157

0.5.156.post1

0.5.156

0.5.155.post1

0.5.155

0.5.154.post1

0.5.154

0.5.153.post1

0.5.153

0.5.152.post1

0.5.152

0.5.151.post1

0.5.151

0.5.150.post1

0.5.150

0.5.149.post1

0.5.149

0.5.148.post2

0.5.148.post1

0.5.148

0.5.147.post2

0.5.147.post1

0.5.147

0.5.146

0.5.145

0.5.144

0.5.143

0.5.142

0.5.141

0.5.140.post1

0.5.140

0.5.139.post1

0.5.139

0.5.138.post1

0.5.138

0.5.137

0.5.136

0.5.135

0.5.134

0.5.133

0.5.132

0.5.131

0.5.130

0.5.129

0.5.128

0.5.127

0.5.126

0.5.125.post1

0.5.125

0.5.124

0.5.123

0.5.122

0.5.121

0.5.120

0.5.119.post1

0.5.119

0.5.118

0.5.117.post1

0.5.115

0.5.114

0.5.113

0.5.112

0.5.111

0.5.110

0.5.109

0.5.108

0.5.107

0.5.106

0.5.105

0.5.104.post1

0.5.104

0.5.104b1 pre-release

0.5.103

0.5.102

0.5.101

0.5.100

0.5.99

0.5.98

0.5.97

0.5.96

0.5.95

0.5.94

0.5.93

0.5.92

0.5.91.post1

0.5.91

0.5.91b2 pre-release

0.5.91b1 pre-release

0.5.90

0.5.89

0.5.88

0.5.87

0.5.86

0.5.85

0.5.84

0.5.83

0.5.82

0.5.81

0.5.80

0.5.79

0.5.78

0.5.77

0.5.76

0.5.75

0.5.74

0.5.73

0.5.72

0.5.71

0.5.70

0.5.69

0.5.68

0.5.67

0.5.66

0.5.65

0.5.64

0.5.63

0.5.62

0.5.61

0.5.60

0.5.59

0.5.58

0.5.57

0.5.56

0.5.55

0.5.54

0.5.53

0.5.52

0.5.51.post1

0.5.51

0.5.51b3 pre-release

0.5.50

0.5.49

0.5.48

0.5.47

0.5.46

0.5.45

0.5.44

0.5.43

0.5.42

0.5.41

0.5.40

0.5.39

0.5.38

0.5.37

0.5.36

0.5.35

0.5.34

0.5.33

0.5.32

0.5.32b1 pre-release

0.5.31

0.5.30

0.5.30b1 pre-release

0.5.29

0.5.28

0.5.27

0.5.26.post4

0.5.26.post3 yanked

Reason this release was yanked:

Missing dependencies

0.5.26.post2 yanked

Reason this release was yanked:

Missing dependencies

0.5.26.post1 yanked

Reason this release was yanked:

Missing dependencies

0.5.26b5 pre-release

0.5.26b1 pre-release

0.5.25

0.5.24

0.5.23

0.5.22

0.5.21

0.5.20

0.5.19

0.5.18

0.5.17

0.5.16

0.5.15

0.5.14

0.5.13

0.5.12

0.5.11

0.5.10

0.5.10b13 pre-release

0.5.10b12 pre-release

0.5.10b11 pre-release

0.5.10b10 pre-release

0.5.10b9 pre-release

0.5.10b8 pre-release

0.5.10b7 pre-release

0.5.10b6 pre-release

0.5.10b5 pre-release

0.5.10b4 pre-release

0.5.10b3 pre-release

0.5.10b2 pre-release

0.5.10b1 pre-release

0.5.9

0.5.9b1 pre-release

0.5.8

0.5.7

0.5.6

0.5.5

0.5.4

0.5.3

0.5.2

0.5.1.post1

0.5.1

0.5.0

0.4.62

0.4.61

0.4.60

0.4.59

0.4.58

0.4.57

0.4.56

0.4.55

0.4.54

0.4.53

0.4.52

0.4.51

0.4.50

0.4.49

0.4.48

0.4.47

0.4.46

0.4.45

0.4.44

0.4.43

0.4.42

0.4.41

0.4.40

0.4.39

0.4.38

0.4.37

0.4.36

0.4.35

0.4.34

0.4.33

0.4.32

0.4.31

0.4.30

0.4.29

0.4.28

0.4.27

0.4.26

0.4.25

0.4.24

0.4.23

0.4.22

0.4.21

0.4.20

0.4.19

0.4.18

0.4.17

0.4.16

0.4.15

0.4.14

0.4.13

0.4.12

0.4.11

0.4.10

0.4.9

0.4.8

0.4.7

0.4.6

0.4.5

0.4.4

0.4.3

0.4.2

0.4.1

0.4.0

0.3.13

0.3.12

0.3.11

0.3.11b1 pre-release

0.3.10

0.3.9

0.3.9b1 pre-release

0.3.8

0.3.8b3 pre-release

0.3.8b2 pre-release

0.3.8b1 pre-release

0.3.7

0.3.6

0.3.5

0.3.4

0.3.4b2 pre-release

0.3.3

0.3.2

0.3.1.post1

0.3.1

0.3.0.post1

0.3.0b1 pre-release

0.2.53

0.2.52

0.2.51

0.2.50

0.2.49

0.2.48

0.2.47

0.2.46

0.2.45

0.2.44

0.2.43

0.2.42

0.2.38

0.0.0

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page