GLLM Inference

Description

A library containing components related to model inferences in Gen AI applications.

Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here

Extras (required only for Artifact Registry installations):

  1. gcloud CLI (for authentication) — Install here, then log in using: 
    gcloud auth login

Option 1: Install from Artifact Registry

This option requires authentication via the gcloud CLI.

uv pip install \
  --extra-index-url "https://oauth2accesstoken:$(gcloud auth print-access-token)@glsdk.gdplabs.id/gen-ai-internal/simple/" \
  gllm-inference

Option 2: Install from PyPI

This option requires no authentication. However, it installs the binary wheel version of the package, which is fully usable but does not include source code.

uv pip install gllm-inference-binary

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login

  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository

1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-inference

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.6.113.post1)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for glx-sre from gravatar.com glx-sre

Credits

Author: Henry Wicaksono

Requires

Python <3.14, >=3.11

Provides Extra

dev anthropic bedrock cohere datasaur google huggingface litellm livekit openai portkey-ai snowflake twelvelabs voyage xai

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_inference_binary-0.6.111-cp313-cp313-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.13Windows x86-64

gllm_inference_binary-0.6.111-cp313-cp313-manylinux_2_31_x86_64.whl (4.0 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.31+ x86-64

gllm_inference_binary-0.6.111-cp313-cp313-macosx_13_0_arm64.whl (3.1 MB view details)

Uploaded CPython 3.13macOS 13.0+ ARM64

gllm_inference_binary-0.6.111-cp312-cp312-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_inference_binary-0.6.111-cp312-cp312-manylinux_2_31_x86_64.whl (4.0 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_inference_binary-0.6.111-cp312-cp312-macosx_13_0_arm64.whl (3.1 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_inference_binary-0.6.111-cp311-cp311-win_amd64.whl (2.8 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_inference_binary-0.6.111-cp311-cp311-manylinux_2_31_x86_64.whl (3.6 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_inference_binary-0.6.111-cp311-cp311-macosx_13_0_arm64.whl (3.0 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_inference_binary-0.6.111-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.111-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 59c37a7e34879c89587d8307276a8ec395cb88552fe4edd844c0a3efa26c09eb
MD5 5263717e1c85967ffb8ad504ff04057e
BLAKE2b-256 af23b4d05445798c505b31f580c66a1e69736d41b4d2d9cde0e6d81075a3e868

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.111-cp313-cp313-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.111-cp313-cp313-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.111-cp313-cp313-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 aa6f5a0ffe6274fbf52c806b9162f0e24a37fb4512a3d36145e972e3d5ab24b1
MD5 b7400f222eef12b29aeb4fd419276d7b
BLAKE2b-256 393f2f840e34bcfa15bdd15161042f215b11cb06021c961783208c5b5f76b586

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.6.111-cp313-cp313-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.111-cp313-cp313-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 71e106ab34576549d659d86845906c15ca8e0fc18ad708595e034a387cab823f
MD5 a3dbafa364a5a15590840472b11aa19c
BLAKE2b-256 3319ee790affda1c171278df48b6a9e651046853de17542881aaa57467b1ec06

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.111-cp313-cp313-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.111-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.111-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 7f6a7acce92ace04d8862f26ace2cc7694a5611ff38c4f89a812190131f4d45c
MD5 a1a07b5161d3ea6f0fdd9195e720e9e6
BLAKE2b-256 08adb83e575d4015575c9f310487e599426763fae38fefc08338ad448e07cfab

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.111-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.111-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.111-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 a7aaf22ed2b812e717e20036283705f40b6983025138410c72b6c19d273a2a88
MD5 b90c30ac55e576d6e7be63f9acc779bf
BLAKE2b-256 b2ae90cc6d67771281315cc50fc9bb8b871658d45e536bed28fdcb2cdc72d619

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.6.111-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.111-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 a5d15adb5a53cacbf028a793eb400c6476820b603cbad46acef241e41c8ab54e
MD5 8ee7a5060d6e6de67225ab48b704c983
BLAKE2b-256 c8244de45b0963fb069d4ac1ccb6760f4d8f891dd5575404564682116a19cd3f

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.111-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.111-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.111-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 eb02a3efd70e8094446a8de6eaeb15e7aaa65caeca2762becd8d92afd0460c2e
MD5 d0e79b385bad463fa72340b87fc79a07
BLAKE2b-256 dfd14cf5741b5b7ff5092e959efb65db4e56143ed03593a550719afc64259437

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.111-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.111-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.111-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 5da031805940f5e2717f8a5ea353da7fa2cdf0f6bf6198d53c10d0fc0e32bcb7
MD5 d78827b9cafa986cb2093bd9d813257b
BLAKE2b-256 9d866110c9d244f6c0fcd8f3e4f1dde2937a7ee9b225b11b9eeab35e23c5e88b

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.6.111-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.111-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 b5dac97189542aad7cdff45e1c6b1271cd60e0cd10baef56b9a0aa4fc5b183e6
MD5 b71ea2516f327f282e604dfee1b436fc
BLAKE2b-256 c4d2f8a899e95b36a579d3e8223af990049f5faaa44567bc7275ce3de73d36f9

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.111-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.6.113.post1

0.6.113

0.6.112

This release

0.6.111

0.6.110

0.6.109

0.6.108

0.6.107

0.6.106

0.6.105.post1

0.6.105

0.6.104

0.6.103

0.6.102.post1

0.6.102

0.6.101

0.6.100

0.6.99

0.6.98

0.6.97

0.6.96

0.6.95

0.6.94

0.6.93.post1

0.6.93

0.6.92

0.6.91

0.6.90

0.6.89

0.6.88

0.6.87

0.6.86

0.6.85

0.6.84

0.6.83

0.6.82

0.6.81

0.6.80

0.6.79

0.6.78

0.6.77

0.6.76

0.6.75

0.6.74

0.6.73

0.6.72.post1

0.6.72

0.6.71

0.6.70

0.6.69.post6

0.6.69.post5

0.6.69.post4

0.6.69.post3

0.6.69.post2

0.6.69.post1

0.6.69

0.6.69b4 pre-release

0.6.69b3 pre-release

0.6.69b2 pre-release

0.6.69b1 pre-release

0.6.68

0.6.67

0.6.66

0.6.65

0.6.64

0.6.63

0.6.62

0.6.61

0.6.60

0.6.59

0.6.58

0.6.57

0.6.56

0.6.55

0.6.54

0.6.53

0.6.52

0.6.51.post1

0.6.50

0.6.49

0.6.48

0.6.47

0.6.46

0.6.45

0.6.44

0.6.43

0.6.42

0.6.41

0.6.40

0.6.39

0.6.38

0.6.37

0.6.36

0.6.35

0.6.34

0.6.33

0.6.32

0.6.31

0.6.30

0.6.29

0.6.28

0.6.27

0.6.26

0.6.25

0.6.24

0.6.23

0.6.22

0.6.21

0.6.20

0.6.19

0.6.18

0.6.17

0.6.16

0.6.15

0.6.14

0.6.13.post1

0.6.13

0.6.13b1 pre-release

0.6.12

0.6.11

0.6.10

0.6.9

0.6.8

0.6.7

0.6.6

0.6.5

0.6.4

0.6.3

0.6.2

0.6.1

0.6.0

0.5.166

0.5.165

0.5.164

0.5.163

0.5.162.post1

0.5.162

0.5.161

0.5.160.post1

0.5.160

0.5.159.post1

0.5.159

0.5.158

0.5.157

0.5.156.post1

0.5.156

0.5.155.post1

0.5.155

0.5.154.post1

0.5.154

0.5.153.post1

0.5.153

0.5.152.post1

0.5.152

0.5.151.post1

0.5.151

0.5.150.post1

0.5.150

0.5.149.post1

0.5.149

0.5.148.post2

0.5.148.post1

0.5.148

0.5.147.post2

0.5.147.post1

0.5.147

0.5.146

0.5.145

0.5.144

0.5.143

0.5.142

0.5.141

0.5.140.post1

0.5.140

0.5.139.post1

0.5.139

0.5.138.post1

0.5.138

0.5.137

0.5.136

0.5.135

0.5.134

0.5.133

0.5.132

0.5.131

0.5.130

0.5.129

0.5.128

0.5.127

0.5.126

0.5.125.post1

0.5.125

0.5.124

0.5.123

0.5.122

0.5.121

0.5.120

0.5.119.post1

0.5.119

0.5.118

0.5.117.post1

0.5.115

0.5.114

0.5.113

0.5.112

0.5.111

0.5.110

0.5.109

0.5.108

0.5.107

0.5.106

0.5.105

0.5.104.post1

0.5.104

0.5.104b1 pre-release

0.5.103

0.5.102

0.5.101

0.5.100

0.5.99

0.5.98

0.5.97

0.5.96

0.5.95

0.5.94

0.5.93

0.5.92

0.5.91.post1

0.5.91

0.5.91b2 pre-release

0.5.91b1 pre-release

0.5.90

0.5.89

0.5.88

0.5.87

0.5.86

0.5.85

0.5.84

0.5.83

0.5.82

0.5.81

0.5.80

0.5.79

0.5.78

0.5.77

0.5.76

0.5.75

0.5.74

0.5.73

0.5.72

0.5.71

0.5.70

0.5.69

0.5.68

0.5.67

0.5.66

0.5.65

0.5.64

0.5.63

0.5.62

0.5.61

0.5.60

0.5.59

0.5.58

0.5.57

0.5.56

0.5.55

0.5.54

0.5.53

0.5.52

0.5.51.post1

0.5.51

0.5.51b3 pre-release

0.5.50

0.5.49

0.5.48

0.5.47

0.5.46

0.5.45

0.5.44

0.5.43

0.5.42

0.5.41

0.5.40

0.5.39

0.5.38

0.5.37

0.5.36

0.5.35

0.5.34

0.5.33

0.5.32

0.5.32b1 pre-release

0.5.31

0.5.30

0.5.30b1 pre-release

0.5.29

0.5.28

0.5.27

0.5.26.post4

0.5.26.post3 yanked

Reason this release was yanked:

Missing dependencies

0.5.26.post2 yanked

Reason this release was yanked:

Missing dependencies

0.5.26.post1 yanked

Reason this release was yanked:

Missing dependencies

0.5.26b5 pre-release

0.5.26b1 pre-release

0.5.25

0.5.24

0.5.23

0.5.22

0.5.21

0.5.20

0.5.19

0.5.18

0.5.17

0.5.16

0.5.15

0.5.14

0.5.13

0.5.12

0.5.11

0.5.10

0.5.10b13 pre-release

0.5.10b12 pre-release

0.5.10b11 pre-release

0.5.10b10 pre-release

0.5.10b9 pre-release

0.5.10b8 pre-release

0.5.10b7 pre-release

0.5.10b6 pre-release

0.5.10b5 pre-release

0.5.10b4 pre-release

0.5.10b3 pre-release

0.5.10b2 pre-release

0.5.10b1 pre-release

0.5.9

0.5.9b1 pre-release

0.5.8

0.5.7

0.5.6

0.5.5

0.5.4

0.5.3

0.5.2

0.5.1.post1

0.5.1

0.5.0

0.4.62

0.4.61

0.4.60

0.4.59

0.4.58

0.4.57

0.4.56

0.4.55

0.4.54

0.4.53

0.4.52

0.4.51

0.4.50

0.4.49

0.4.48

0.4.47

0.4.46

0.4.45

0.4.44

0.4.43

0.4.42

0.4.41

0.4.40

0.4.39

0.4.38

0.4.37

0.4.36

0.4.35

0.4.34

0.4.33

0.4.32

0.4.31

0.4.30

0.4.29

0.4.28

0.4.27

0.4.26

0.4.25

0.4.24

0.4.23

0.4.22

0.4.21

0.4.20

0.4.19

0.4.18

0.4.17

0.4.16

0.4.15

0.4.14

0.4.13

0.4.12

0.4.11

0.4.10

0.4.9

0.4.8

0.4.7

0.4.6

0.4.5

0.4.4

0.4.3

0.4.2

0.4.1

0.4.0

0.3.13

0.3.12

0.3.11

0.3.11b1 pre-release

0.3.10

0.3.9

0.3.9b1 pre-release

0.3.8

0.3.8b3 pre-release

0.3.8b2 pre-release

0.3.8b1 pre-release

0.3.7

0.3.6

0.3.5

0.3.4

0.3.4b2 pre-release

0.3.3

0.3.2

0.3.1.post1

0.3.1

0.3.0.post1

0.3.0b1 pre-release

0.2.53

0.2.52

0.2.51

0.2.50

0.2.49

0.2.48

0.2.47

0.2.46

0.2.45

0.2.44

0.2.43

0.2.42

0.2.38

0.0.0

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page