GLLM Inference

Description

A library containing components related to model inferences in Gen AI applications.

Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here

Extras (required only for Artifact Registry installations):

  1. gcloud CLI (for authentication) — Install here, then log in using: 
    gcloud auth login

Option 1: Install from Artifact Registry

This option requires authentication via the gcloud CLI.

uv pip install \
  --extra-index-url "https://oauth2accesstoken:$(gcloud auth print-access-token)@glsdk.gdplabs.id/gen-ai-internal/simple/" \
  gllm-inference

Option 2: Install from PyPI

This option requires no authentication. However, it installs the binary wheel version of the package, which is fully usable but does not include source code.

uv pip install gllm-inference-binary

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login

  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository

1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-inference

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for glx-sre from gravatar.com glx-sre

Credits

Author: Henry Wicaksono

Requires

Python <3.14, >=3.11

Provides Extra

dev anthropic audio bedrock cohere datasaur google huggingface image litellm livekit openai portkey-ai snowflake twelvelabs voyage xai

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_inference_binary-0.6.124-cp313-cp313-win_amd64.whl (2.8 MB view details)

Uploaded CPython 3.13Windows x86-64

gllm_inference_binary-0.6.124-cp313-cp313-manylinux_2_31_x86_64.whl (4.2 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.31+ x86-64

gllm_inference_binary-0.6.124-cp313-cp313-macosx_13_0_arm64.whl (3.3 MB view details)

Uploaded CPython 3.13macOS 13.0+ ARM64

gllm_inference_binary-0.6.124-cp312-cp312-win_amd64.whl (2.8 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_inference_binary-0.6.124-cp312-cp312-manylinux_2_31_x86_64.whl (4.1 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_inference_binary-0.6.124-cp312-cp312-macosx_13_0_arm64.whl (3.2 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_inference_binary-0.6.124-cp311-cp311-win_amd64.whl (2.9 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_inference_binary-0.6.124-cp311-cp311-manylinux_2_31_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_inference_binary-0.6.124-cp311-cp311-macosx_13_0_arm64.whl (3.2 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_inference_binary-0.6.124-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.124-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 5dadea74b28a364005d9a20dd313551e0fd70af3cd5ff01683ef96eaa4996eba
MD5 ecf82722c9c61a10004e1cfba6f820c3
BLAKE2b-256 6ce0b6b5e02b1b861e64a7434ee5ddb7bc084a0b91159a33bd791cc77a0718ab

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.124-cp313-cp313-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.124-cp313-cp313-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.124-cp313-cp313-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 d59451e3af5a0505a879e82cf6347f300e7ca406f10ce8626578b96cd4bb194b
MD5 c07274425bb114a09f9bb51c75269aa7
BLAKE2b-256 8a076d79a2d2cb7e180398357781c390ac16a05562c803720666b074e2f8d8ac

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.6.124-cp313-cp313-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.124-cp313-cp313-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 8b68f16613d319e7a8ca1a62b9e6b4b6dd414f50a795ec90e1506f781556b590
MD5 2b4235a3258eda7f894cd119dc640220
BLAKE2b-256 0491f59c80afdce495b2ce004205967239aa1fb89e1f5875cd988d0daa4d6933

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.124-cp313-cp313-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.124-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.124-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 eb3aabd8fdbb8c0785df9fa01169272e33b31555b2a4c6e0366ac1b3e29bd734
MD5 8cdd0421a9408de3183f25c88b171c79
BLAKE2b-256 333be2b769108f95f9c19018edb5f05d7c289c50563bc52cdef673ba32c993e0

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.124-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.124-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.124-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 785ca522a942cc75e70fa630b0ba69af9c05e65f42b98c5aae55a21383c242b3
MD5 5258cc5cda1015f80a347e85f5536dc4
BLAKE2b-256 5a5168efd040cabf61c9c92dd32a21618a1bf715cbfbd9ece3f34e524a43cc2b

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.6.124-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.124-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 94fbe46a91b2f4a8a51b57bbb889f116f8466e36383334edbefa70884f765da9
MD5 16261058e376dff30497df2b2389b057
BLAKE2b-256 3f4b4f73c7ce2919b6e86e3fc3c8651269fdc0e5e135a934e24f44e75f839303

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.124-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.124-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.124-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 72c47c3c5dad4577ee9ff7f352b2b371ad186953e1069af974b501ac69bb4fab
MD5 73680ad937da6c4454fd115eea29279c
BLAKE2b-256 33f8af97dfd8c490c85897dcc54def22a28450471b636cb487edf3bb66a14db6

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.124-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.124-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.124-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 92d322996382cae2ac9539f4b7caf89c8c2f33d8ded5a437d936f91fc36221f0
MD5 e46a22b10f633edd16c3edc1bab812ed
BLAKE2b-256 0af88a31c49c56df01b5c21bbd57e6dd663c679d6385113ec299df11e1fe02bb

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.6.124-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.124-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 8b0b500976d962512d2b35ca5c2c96c4c851448d1f5315dd71ac12ea42857350
MD5 5871e0015f0b2a0d950d90a604bb797a
BLAKE2b-256 cf05c4a602d9331fedd777143c81d34ea67c97527d1e6dcbce710e4ae916dd7c

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.124-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.6.124

0.6.123

0.6.122

0.6.121

0.6.120

0.6.119.post1

0.6.118

0.6.117

0.6.116

0.6.115

0.6.114

0.6.113.post1

0.6.113

0.6.112

0.6.111

0.6.110

0.6.109

0.6.108

0.6.107

0.6.106

0.6.105.post1

0.6.105

0.6.104

0.6.103

0.6.102.post1

0.6.102

0.6.101

0.6.100

0.6.99

0.6.98

0.6.97

0.6.96

0.6.95

0.6.94

0.6.93.post1

0.6.93

0.6.92

0.6.91

0.6.90

0.6.89

0.6.88

0.6.87

0.6.86

0.6.85

0.6.84

0.6.83

0.6.82

0.6.81

0.6.80

0.6.79

0.6.78

0.6.77

0.6.76

0.6.75

0.6.74

0.6.73

0.6.72.post1

0.6.72

0.6.71

0.6.70

0.6.69.post6

0.6.69.post5

0.6.69.post4

0.6.69.post3

0.6.69.post2

0.6.69.post1

0.6.69

0.6.69b4 pre-release

0.6.69b3 pre-release

0.6.69b2 pre-release

0.6.69b1 pre-release

0.6.68

0.6.67

0.6.66

0.6.65

0.6.64

0.6.63

0.6.62

0.6.61

0.6.60

0.6.59

0.6.58

0.6.57

0.6.56

0.6.55

0.6.54

0.6.53

0.6.52

0.6.51.post1

0.6.50

0.6.49

0.6.48

0.6.47

0.6.46

0.6.45

0.6.44

0.6.43

0.6.42

0.6.41

0.6.40

0.6.39

0.6.38

0.6.37

0.6.36

0.6.35

0.6.34

0.6.33

0.6.32

0.6.31

0.6.30

0.6.29

0.6.28

0.6.27

0.6.26

0.6.25

0.6.24

0.6.23

0.6.22

0.6.21

0.6.20

0.6.19

0.6.18

0.6.17

0.6.16

0.6.15

0.6.14

0.6.13.post1

0.6.13

0.6.13b1 pre-release

0.6.12

0.6.11

0.6.10

0.6.9

0.6.8

0.6.7

0.6.6

0.6.5

0.6.4

0.6.3

0.6.2

0.6.1

0.6.0

0.5.166

0.5.165

0.5.164

0.5.163

0.5.162.post1

0.5.162

0.5.161

0.5.160.post1

0.5.160

0.5.159.post1

0.5.159

0.5.158

0.5.157

0.5.156.post1

0.5.156

0.5.155.post1

0.5.155

0.5.154.post1

0.5.154

0.5.153.post1

0.5.153

0.5.152.post1

0.5.152

0.5.151.post1

0.5.151

0.5.150.post1

0.5.150

0.5.149.post1

0.5.149

0.5.148.post2

0.5.148.post1

0.5.148

0.5.147.post2

0.5.147.post1

0.5.147

0.5.146

0.5.145

0.5.144

0.5.143

0.5.142

0.5.141

0.5.140.post1

0.5.140

0.5.139.post1

0.5.139

0.5.138.post1

0.5.138

0.5.137

0.5.136

0.5.135

0.5.134

0.5.133

0.5.132

0.5.131

0.5.130

0.5.129

0.5.128

0.5.127

0.5.126

0.5.125.post1

0.5.125

0.5.124

0.5.123

0.5.122

0.5.121

0.5.120

0.5.119.post1

0.5.119

0.5.118

0.5.117.post1

0.5.115

0.5.114

0.5.113

0.5.112

0.5.111

0.5.110

0.5.109

0.5.108

0.5.107

0.5.106

0.5.105

0.5.104.post1

0.5.104

0.5.104b1 pre-release

0.5.103

0.5.102

0.5.101

0.5.100

0.5.99

0.5.98

0.5.97

0.5.96

0.5.95

0.5.94

0.5.93

0.5.92

0.5.91.post1

0.5.91

0.5.91b2 pre-release

0.5.91b1 pre-release

0.5.90

0.5.89

0.5.88

0.5.87

0.5.86

0.5.85

0.5.84

0.5.83

0.5.82

0.5.81

0.5.80

0.5.79

0.5.78

0.5.77

0.5.76

0.5.75

0.5.74

0.5.73

0.5.72

0.5.71

0.5.70

0.5.69

0.5.68

0.5.67

0.5.66

0.5.65

0.5.64

0.5.63

0.5.62

0.5.61

0.5.60

0.5.59

0.5.58

0.5.57

0.5.56

0.5.55

0.5.54

0.5.53

0.5.52

0.5.51.post1

0.5.51

0.5.51b3 pre-release

0.5.50

0.5.49

0.5.48

0.5.47

0.5.46

0.5.45

0.5.44

0.5.43

0.5.42

0.5.41

0.5.40

0.5.39

0.5.38

0.5.37

0.5.36

0.5.35

0.5.34

0.5.33

0.5.32

0.5.32b1 pre-release

0.5.31

0.5.30

0.5.30b1 pre-release

0.5.29

0.5.28

0.5.27

0.5.26.post4

0.5.26.post3 yanked

Reason this release was yanked:

Missing dependencies

0.5.26.post2 yanked

Reason this release was yanked:

Missing dependencies

0.5.26.post1 yanked

Reason this release was yanked:

Missing dependencies

0.5.26b5 pre-release

0.5.26b1 pre-release

0.5.25

0.5.24

0.5.23

0.5.22

0.5.21

0.5.20

0.5.19

0.5.18

0.5.17

0.5.16

0.5.15

0.5.14

0.5.13

0.5.12

0.5.11

0.5.10

0.5.10b13 pre-release

0.5.10b12 pre-release

0.5.10b11 pre-release

0.5.10b10 pre-release

0.5.10b9 pre-release

0.5.10b8 pre-release

0.5.10b7 pre-release

0.5.10b6 pre-release

0.5.10b5 pre-release

0.5.10b4 pre-release

0.5.10b3 pre-release

0.5.10b2 pre-release

0.5.10b1 pre-release

0.5.9

0.5.9b1 pre-release

0.5.8

0.5.7

0.5.6

0.5.5

0.5.4

0.5.3

0.5.2

0.5.1.post1

0.5.1

0.5.0

0.4.62

0.4.61

0.4.60

0.4.59

0.4.58

0.4.57

0.4.56

0.4.55

0.4.54

0.4.53

0.4.52

0.4.51

0.4.50

0.4.49

0.4.48

0.4.47

0.4.46

0.4.45

0.4.44

0.4.43

0.4.42

0.4.41

0.4.40

0.4.39

0.4.38

0.4.37

0.4.36

0.4.35

0.4.34

0.4.33

0.4.32

0.4.31

0.4.30

0.4.29

0.4.28

0.4.27

0.4.26

0.4.25

0.4.24

0.4.23

0.4.22

0.4.21

0.4.20

0.4.19

0.4.18

0.4.17

0.4.16

0.4.15

0.4.14

0.4.13

0.4.12

0.4.11

0.4.10

0.4.9

0.4.8

0.4.7

0.4.6

0.4.5

0.4.4

0.4.3

0.4.2

0.4.1

0.4.0

0.3.13

0.3.12

0.3.11

0.3.11b1 pre-release

0.3.10

0.3.9

0.3.9b1 pre-release

0.3.8

0.3.8b3 pre-release

0.3.8b2 pre-release

0.3.8b1 pre-release

0.3.7

0.3.6

0.3.5

0.3.4

0.3.4b2 pre-release

0.3.3

0.3.2

0.3.1.post1

0.3.1

0.3.0.post1

0.3.0b1 pre-release

0.2.53

0.2.52

0.2.51

0.2.50

0.2.49

0.2.48

0.2.47

0.2.46

0.2.45

0.2.44

0.2.43

0.2.42

0.2.38

0.0.0

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page