GLLM Inference

Description

A library containing components related to model inferences in Gen AI applications.

Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here

Extras (required only for Artifact Registry installations):

  1. gcloud CLI (for authentication) — Install here, then log in using: 
    gcloud auth login

Option 1: Install from Artifact Registry

This option requires authentication via the gcloud CLI.

uv pip install \
  --extra-index-url "https://oauth2accesstoken:$(gcloud auth print-access-token)@glsdk.gdplabs.id/gen-ai-internal/simple/" \
  gllm-inference

Option 2: Install from PyPI

This option requires no authentication. However, it installs the binary wheel version of the package, which is fully usable but does not include source code.

uv pip install gllm-inference-binary

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login

  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository

1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-inference

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.6.122)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for glx-sre from gravatar.com glx-sre

Credits

Author: Henry Wicaksono

Requires

Python <3.14, >=3.11

Provides Extra

dev anthropic audio bedrock cohere datasaur google huggingface image litellm livekit openai portkey-ai snowflake twelvelabs voyage xai

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_inference_binary-0.6.120-cp313-cp313-win_amd64.whl (2.8 MB view details)

Uploaded CPython 3.13Windows x86-64

gllm_inference_binary-0.6.120-cp313-cp313-manylinux_2_31_x86_64.whl (4.1 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.31+ x86-64

gllm_inference_binary-0.6.120-cp313-cp313-macosx_13_0_arm64.whl (3.2 MB view details)

Uploaded CPython 3.13macOS 13.0+ ARM64

gllm_inference_binary-0.6.120-cp312-cp312-win_amd64.whl (2.8 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_inference_binary-0.6.120-cp312-cp312-manylinux_2_31_x86_64.whl (4.1 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_inference_binary-0.6.120-cp312-cp312-macosx_13_0_arm64.whl (3.2 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_inference_binary-0.6.120-cp311-cp311-win_amd64.whl (2.9 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_inference_binary-0.6.120-cp311-cp311-manylinux_2_31_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_inference_binary-0.6.120-cp311-cp311-macosx_13_0_arm64.whl (3.2 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_inference_binary-0.6.120-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.120-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 a084c0761573d526bc9c0427d4f1b11d1edfda348398a17e967a7e54fa2c1aee
MD5 a096e61b0bee30828217836909f6128d
BLAKE2b-256 9dd99fc6eac21847946b835c97105a5ef72ce393291aa6dbb3ca3974be5e8b62

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.120-cp313-cp313-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.120-cp313-cp313-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.120-cp313-cp313-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 2ea99592627195f3dd1e6fd766ba9641c8b734cffdd2e9b66b5552d29a45a4fe
MD5 f778b39cc17fafe8edc9ad6d5906b403
BLAKE2b-256 75845528acae9e405345b631dcc0d3ff77c2be7c516f7dfd6a2f774ef0850154

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.6.120-cp313-cp313-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.120-cp313-cp313-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 6f2ec3177dee45100444f8691ebe8e81d341691d2e9cee379543ff9d3ba22b17
MD5 2f810f7a8ce41088bd57d6c79e492328
BLAKE2b-256 0691100d1a9b5f63521cb57c9900c0f7c5dba0e079595d3315381272c67364d7

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.120-cp313-cp313-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.120-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.120-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 918a96d9c1526d70025cf7198a8e30fc566a6ca501696f4c18d787b22ec78167
MD5 76bf7e1df71a4fbe57d10d780299331e
BLAKE2b-256 7b89754caad3238c0869c92a80f43bd0996f22ee72f60fc9118bc79a7099502d

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.120-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.120-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.120-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 1942b9334f47a9022241db5450b20064f9bafa38eb7705c73ca00f6752956a26
MD5 becab5817bb5f50f6f957432b400a475
BLAKE2b-256 03f63e2f0f4d1fb14c32620f330b4591a004d54261b06fe0c28e0aa1d8930cd0

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.6.120-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.120-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 61453bba3786391d3f63917b370ce89b13b8eaec5aa5ff74e61d8e7f46c8a50f
MD5 6f317300cae2b64c7fef3e1c102f0061
BLAKE2b-256 0188b8b2b92c825d98f8e2676b627012d8271bf37e349b8f73e76da04c9e5998

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.120-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.120-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.120-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 9ba5ab1b43e8bf2416fe2c64850cf9e85e9e7f4c01f187101e9fabbc3e48d86f
MD5 68a3e402f3da53137b1318dee5799767
BLAKE2b-256 4c0cc5d323159cf62af1cd1b537234bc761e3cc1616313ba873e2314badc4596

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.120-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.120-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.120-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 08da88a81c4c0047fa5080d7ae86699c11a18997609433a321c85b7ac29c8ebf
MD5 1ee722bd380cc71b8b44f375c3e2083e
BLAKE2b-256 0343d9dbff47f2f9c29c547fc6cdc17fca15e54ffa5b2c580896b90b802ecd86

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.6.120-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.120-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 6b3139f070b8242ad6e821e1a15589c66ffdbe83e361760de83303f4944a18d6
MD5 3177685ee7b942d01293b6dff2125ca0
BLAKE2b-256 e8faa08f58e3628434789b1651d0e15e29dfac921f3a1a0da17df1e08962d0ed

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.120-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.6.122

0.6.121

This release

0.6.120

0.6.119.post1

0.6.118

0.6.117

0.6.116

0.6.115

0.6.114

0.6.113.post1

0.6.113

0.6.112

0.6.111

0.6.110

0.6.109

0.6.108

0.6.107

0.6.106

0.6.105.post1

0.6.105

0.6.104

0.6.103

0.6.102.post1

0.6.102

0.6.101

0.6.100

0.6.99

0.6.98

0.6.97

0.6.96

0.6.95

0.6.94

0.6.93.post1

0.6.93

0.6.92

0.6.91

0.6.90

0.6.89

0.6.88

0.6.87

0.6.86

0.6.85

0.6.84

0.6.83

0.6.82

0.6.81

0.6.80

0.6.79

0.6.78

0.6.77

0.6.76

0.6.75

0.6.74

0.6.73

0.6.72.post1

0.6.72

0.6.71

0.6.70

0.6.69.post6

0.6.69.post5

0.6.69.post4

0.6.69.post3

0.6.69.post2

0.6.69.post1

0.6.69

0.6.69b4 pre-release

0.6.69b3 pre-release

0.6.69b2 pre-release

0.6.69b1 pre-release

0.6.68

0.6.67

0.6.66

0.6.65

0.6.64

0.6.63

0.6.62

0.6.61

0.6.60

0.6.59

0.6.58

0.6.57

0.6.56

0.6.55

0.6.54

0.6.53

0.6.52

0.6.51.post1

0.6.50

0.6.49

0.6.48

0.6.47

0.6.46

0.6.45

0.6.44

0.6.43

0.6.42

0.6.41

0.6.40

0.6.39

0.6.38

0.6.37

0.6.36

0.6.35

0.6.34

0.6.33

0.6.32

0.6.31

0.6.30

0.6.29

0.6.28

0.6.27

0.6.26

0.6.25

0.6.24

0.6.23

0.6.22

0.6.21

0.6.20

0.6.19

0.6.18

0.6.17

0.6.16

0.6.15

0.6.14

0.6.13.post1

0.6.13

0.6.13b1 pre-release

0.6.12

0.6.11

0.6.10

0.6.9

0.6.8

0.6.7

0.6.6

0.6.5

0.6.4

0.6.3

0.6.2

0.6.1

0.6.0

0.5.166

0.5.165

0.5.164

0.5.163

0.5.162.post1

0.5.162

0.5.161

0.5.160.post1

0.5.160

0.5.159.post1

0.5.159

0.5.158

0.5.157

0.5.156.post1

0.5.156

0.5.155.post1

0.5.155

0.5.154.post1

0.5.154

0.5.153.post1

0.5.153

0.5.152.post1

0.5.152

0.5.151.post1

0.5.151

0.5.150.post1

0.5.150

0.5.149.post1

0.5.149

0.5.148.post2

0.5.148.post1

0.5.148

0.5.147.post2

0.5.147.post1

0.5.147

0.5.146

0.5.145

0.5.144

0.5.143

0.5.142

0.5.141

0.5.140.post1

0.5.140

0.5.139.post1

0.5.139

0.5.138.post1

0.5.138

0.5.137

0.5.136

0.5.135

0.5.134

0.5.133

0.5.132

0.5.131

0.5.130

0.5.129

0.5.128

0.5.127

0.5.126

0.5.125.post1

0.5.125

0.5.124

0.5.123

0.5.122

0.5.121

0.5.120

0.5.119.post1

0.5.119

0.5.118

0.5.117.post1

0.5.115

0.5.114

0.5.113

0.5.112

0.5.111

0.5.110

0.5.109

0.5.108

0.5.107

0.5.106

0.5.105

0.5.104.post1

0.5.104

0.5.104b1 pre-release

0.5.103

0.5.102

0.5.101

0.5.100

0.5.99

0.5.98

0.5.97

0.5.96

0.5.95

0.5.94

0.5.93

0.5.92

0.5.91.post1

0.5.91

0.5.91b2 pre-release

0.5.91b1 pre-release

0.5.90

0.5.89

0.5.88

0.5.87

0.5.86

0.5.85

0.5.84

0.5.83

0.5.82

0.5.81

0.5.80

0.5.79

0.5.78

0.5.77

0.5.76

0.5.75

0.5.74

0.5.73

0.5.72

0.5.71

0.5.70

0.5.69

0.5.68

0.5.67

0.5.66

0.5.65

0.5.64

0.5.63

0.5.62

0.5.61

0.5.60

0.5.59

0.5.58

0.5.57

0.5.56

0.5.55

0.5.54

0.5.53

0.5.52

0.5.51.post1

0.5.51

0.5.51b3 pre-release

0.5.50

0.5.49

0.5.48

0.5.47

0.5.46

0.5.45

0.5.44

0.5.43

0.5.42

0.5.41

0.5.40

0.5.39

0.5.38

0.5.37

0.5.36

0.5.35

0.5.34

0.5.33

0.5.32

0.5.32b1 pre-release

0.5.31

0.5.30

0.5.30b1 pre-release

0.5.29

0.5.28

0.5.27

0.5.26.post4

0.5.26.post3 yanked

Reason this release was yanked:

Missing dependencies

0.5.26.post2 yanked

Reason this release was yanked:

Missing dependencies

0.5.26.post1 yanked

Reason this release was yanked:

Missing dependencies

0.5.26b5 pre-release

0.5.26b1 pre-release

0.5.25

0.5.24

0.5.23

0.5.22

0.5.21

0.5.20

0.5.19

0.5.18

0.5.17

0.5.16

0.5.15

0.5.14

0.5.13

0.5.12

0.5.11

0.5.10

0.5.10b13 pre-release

0.5.10b12 pre-release

0.5.10b11 pre-release

0.5.10b10 pre-release

0.5.10b9 pre-release

0.5.10b8 pre-release

0.5.10b7 pre-release

0.5.10b6 pre-release

0.5.10b5 pre-release

0.5.10b4 pre-release

0.5.10b3 pre-release

0.5.10b2 pre-release

0.5.10b1 pre-release

0.5.9

0.5.9b1 pre-release

0.5.8

0.5.7

0.5.6

0.5.5

0.5.4

0.5.3

0.5.2

0.5.1.post1

0.5.1

0.5.0

0.4.62

0.4.61

0.4.60

0.4.59

0.4.58

0.4.57

0.4.56

0.4.55

0.4.54

0.4.53

0.4.52

0.4.51

0.4.50

0.4.49

0.4.48

0.4.47

0.4.46

0.4.45

0.4.44

0.4.43

0.4.42

0.4.41

0.4.40

0.4.39

0.4.38

0.4.37

0.4.36

0.4.35

0.4.34

0.4.33

0.4.32

0.4.31

0.4.30

0.4.29

0.4.28

0.4.27

0.4.26

0.4.25

0.4.24

0.4.23

0.4.22

0.4.21

0.4.20

0.4.19

0.4.18

0.4.17

0.4.16

0.4.15

0.4.14

0.4.13

0.4.12

0.4.11

0.4.10

0.4.9

0.4.8

0.4.7

0.4.6

0.4.5

0.4.4

0.4.3

0.4.2

0.4.1

0.4.0

0.3.13

0.3.12

0.3.11

0.3.11b1 pre-release

0.3.10

0.3.9

0.3.9b1 pre-release

0.3.8

0.3.8b3 pre-release

0.3.8b2 pre-release

0.3.8b1 pre-release

0.3.7

0.3.6

0.3.5

0.3.4

0.3.4b2 pre-release

0.3.3

0.3.2

0.3.1.post1

0.3.1

0.3.0.post1

0.3.0b1 pre-release

0.2.53

0.2.52

0.2.51

0.2.50

0.2.49

0.2.48

0.2.47

0.2.46

0.2.45

0.2.44

0.2.43

0.2.42

0.2.38

0.0.0

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page