GLLM Inference

Description

A library containing components related to model inferences in Gen AI applications.

Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here

Extras (required only for Artifact Registry installations):

  1. gcloud CLI (for authentication) — Install here, then log in using: 
    gcloud auth login

Option 1: Install from Artifact Registry

This option requires authentication via the gcloud CLI.

uv pip install \
  --extra-index-url "https://oauth2accesstoken:$(gcloud auth print-access-token)@glsdk.gdplabs.id/gen-ai-internal/simple/" \
  gllm-inference

Option 2: Install from PyPI

This option requires no authentication. However, it installs the binary wheel version of the package, which is fully usable but does not include source code.

uv pip install gllm-inference-binary

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login

  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository

1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-inference

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.6.124)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for glx-sre from gravatar.com glx-sre

Credits

Author: Henry Wicaksono

Requires

Python <3.14, >=3.11

Provides Extra

dev anthropic audio bedrock cohere datasaur google huggingface image litellm livekit openai portkey-ai snowflake twelvelabs voyage xai

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_inference_binary-0.6.117-cp313-cp313-win_amd64.whl (2.8 MB view details)

Uploaded CPython 3.13Windows x86-64

gllm_inference_binary-0.6.117-cp313-cp313-manylinux_2_31_x86_64.whl (4.1 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.31+ x86-64

gllm_inference_binary-0.6.117-cp313-cp313-macosx_13_0_arm64.whl (3.2 MB view details)

Uploaded CPython 3.13macOS 13.0+ ARM64

gllm_inference_binary-0.6.117-cp312-cp312-win_amd64.whl (2.8 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_inference_binary-0.6.117-cp312-cp312-manylinux_2_31_x86_64.whl (4.1 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_inference_binary-0.6.117-cp312-cp312-macosx_13_0_arm64.whl (3.2 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_inference_binary-0.6.117-cp311-cp311-win_amd64.whl (2.9 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_inference_binary-0.6.117-cp311-cp311-manylinux_2_31_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_inference_binary-0.6.117-cp311-cp311-macosx_13_0_arm64.whl (3.2 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_inference_binary-0.6.117-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.117-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 136ba3f04ee4a78a0b357827553175288c8e41886873dc092d0ee61163958502
MD5 1d1d04aa7cc277c15aba86a122f1264d
BLAKE2b-256 85f4b19e080d364b8c410cd30f3db4df4cc7347ec6c819f29f0c3244cc87d0f5

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.117-cp313-cp313-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.117-cp313-cp313-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.117-cp313-cp313-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 b150e7e9358c177f79051674b5459e116ab19662223a7efb6d06fc2cabbcfe65
MD5 80177a1024a872ca671b408b5fcf7ce5
BLAKE2b-256 f5347ed70338403829671f7baa99d9b8d7c36a6285fb7cefc441f8324a0982ee

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.6.117-cp313-cp313-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.117-cp313-cp313-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 3846e4a0c423119bfb9579cce6398701068ddad9fd48ba4f1f55471a24350c54
MD5 38f0cf2261bb18f9add521a7c48bc7bf
BLAKE2b-256 6bddbe10ae2142aee17a6bcd0d801f2329efb98cf694fa0b805047ce35a658e8

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.117-cp313-cp313-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.117-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.117-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 cd0307573476e720ef2e8d3880b8f28c971ed46767d644b239b916ca8b4b26db
MD5 a27c83640f7635add2e316f1e7ebacbe
BLAKE2b-256 abd95c8954fee3423e624757f91c61d28019c56de5c69bbf74bff0538d50df22

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.117-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.117-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.117-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 b8cb781ced17900843d574bd7e52e62f77032724299b58c71976515e291d15d9
MD5 e13696cb71bdaff5c5d1dd77213cce81
BLAKE2b-256 38135a6f16243486d2e96eb0780d64d417c3717fdc7fa743cba3ee3aa02c133d

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.6.117-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.117-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 611a1dd59c6528abdb2dc8259f7e355415fe43624835da0ef0ab2519d95eb518
MD5 d2b5a5227263512d0685451fa09a1ede
BLAKE2b-256 48da7e047130a89e6c7fb0f53bd9ca27016b909a27ff26aa17d0e51581d69891

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.117-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.117-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.117-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 9334bcac5b9478ee54689036f636c81a57ac17d7252061573a133ea859d58864
MD5 af1a4c961ae245693f4bbbcf777ca758
BLAKE2b-256 a149d65ae978e9d7a114ee3fa22eea9aaeca90f2fc55da33dc8f8a9335e70181

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.117-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.6.117-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.117-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 e5b8076c6d75c982021d9b7ef3972a4d0a0aee44d462b482f465ebb6c6926fd2
MD5 1478bad00b702c026a3439ad92ef2825
BLAKE2b-256 2d37d08d05da199cd50e93bcca150ab10b792da34398921871d751885f5e58da

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.6.117-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.6.117-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 943d6c53709f95b58cde235127e864d56d390967b9000aa884585018b6e06dbb
MD5 61b467938433dcb25e4cf870c9103eb0
BLAKE2b-256 59eaa3b6d629ada3fa85a195db275ee070543815e29835b095657f88aab264f6

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.6.117-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.6.124

0.6.123

0.6.122

0.6.121

0.6.120

0.6.119.post1

0.6.118

This release

0.6.117

0.6.116

0.6.115

0.6.114

0.6.113.post1

0.6.113

0.6.112

0.6.111

0.6.110

0.6.109

0.6.108

0.6.107

0.6.106

0.6.105.post1

0.6.105

0.6.104

0.6.103

0.6.102.post1

0.6.102

0.6.101

0.6.100

0.6.99

0.6.98

0.6.97

0.6.96

0.6.95

0.6.94

0.6.93.post1

0.6.93

0.6.92

0.6.91

0.6.90

0.6.89

0.6.88

0.6.87

0.6.86

0.6.85

0.6.84

0.6.83

0.6.82

0.6.81

0.6.80

0.6.79

0.6.78

0.6.77

0.6.76

0.6.75

0.6.74

0.6.73

0.6.72.post1

0.6.72

0.6.71

0.6.70

0.6.69.post6

0.6.69.post5

0.6.69.post4

0.6.69.post3

0.6.69.post2

0.6.69.post1

0.6.69

0.6.69b4 pre-release

0.6.69b3 pre-release

0.6.69b2 pre-release

0.6.69b1 pre-release

0.6.68

0.6.67

0.6.66

0.6.65

0.6.64

0.6.63

0.6.62

0.6.61

0.6.60

0.6.59

0.6.58

0.6.57

0.6.56

0.6.55

0.6.54

0.6.53

0.6.52

0.6.51.post1

0.6.50

0.6.49

0.6.48

0.6.47

0.6.46

0.6.45

0.6.44

0.6.43

0.6.42

0.6.41

0.6.40

0.6.39

0.6.38

0.6.37

0.6.36

0.6.35

0.6.34

0.6.33

0.6.32

0.6.31

0.6.30

0.6.29

0.6.28

0.6.27

0.6.26

0.6.25

0.6.24

0.6.23

0.6.22

0.6.21

0.6.20

0.6.19

0.6.18

0.6.17

0.6.16

0.6.15

0.6.14

0.6.13.post1

0.6.13

0.6.13b1 pre-release

0.6.12

0.6.11

0.6.10

0.6.9

0.6.8

0.6.7

0.6.6

0.6.5

0.6.4

0.6.3

0.6.2

0.6.1

0.6.0

0.5.166

0.5.165

0.5.164

0.5.163

0.5.162.post1

0.5.162

0.5.161

0.5.160.post1

0.5.160

0.5.159.post1

0.5.159

0.5.158

0.5.157

0.5.156.post1

0.5.156

0.5.155.post1

0.5.155

0.5.154.post1

0.5.154

0.5.153.post1

0.5.153

0.5.152.post1

0.5.152

0.5.151.post1

0.5.151

0.5.150.post1

0.5.150

0.5.149.post1

0.5.149

0.5.148.post2

0.5.148.post1

0.5.148

0.5.147.post2

0.5.147.post1

0.5.147

0.5.146

0.5.145

0.5.144

0.5.143

0.5.142

0.5.141

0.5.140.post1

0.5.140

0.5.139.post1

0.5.139

0.5.138.post1

0.5.138

0.5.137

0.5.136

0.5.135

0.5.134

0.5.133

0.5.132

0.5.131

0.5.130

0.5.129

0.5.128

0.5.127

0.5.126

0.5.125.post1

0.5.125

0.5.124

0.5.123

0.5.122

0.5.121

0.5.120

0.5.119.post1

0.5.119

0.5.118

0.5.117.post1

0.5.115

0.5.114

0.5.113

0.5.112

0.5.111

0.5.110

0.5.109

0.5.108

0.5.107

0.5.106

0.5.105

0.5.104.post1

0.5.104

0.5.104b1 pre-release

0.5.103

0.5.102

0.5.101

0.5.100

0.5.99

0.5.98

0.5.97

0.5.96

0.5.95

0.5.94

0.5.93

0.5.92

0.5.91.post1

0.5.91

0.5.91b2 pre-release

0.5.91b1 pre-release

0.5.90

0.5.89

0.5.88

0.5.87

0.5.86

0.5.85

0.5.84

0.5.83

0.5.82

0.5.81

0.5.80

0.5.79

0.5.78

0.5.77

0.5.76

0.5.75

0.5.74

0.5.73

0.5.72

0.5.71

0.5.70

0.5.69

0.5.68

0.5.67

0.5.66

0.5.65

0.5.64

0.5.63

0.5.62

0.5.61

0.5.60

0.5.59

0.5.58

0.5.57

0.5.56

0.5.55

0.5.54

0.5.53

0.5.52

0.5.51.post1

0.5.51

0.5.51b3 pre-release

0.5.50

0.5.49

0.5.48

0.5.47

0.5.46

0.5.45

0.5.44

0.5.43

0.5.42

0.5.41

0.5.40

0.5.39

0.5.38

0.5.37

0.5.36

0.5.35

0.5.34

0.5.33

0.5.32

0.5.32b1 pre-release

0.5.31

0.5.30

0.5.30b1 pre-release

0.5.29

0.5.28

0.5.27

0.5.26.post4

0.5.26.post3 yanked

Reason this release was yanked:

Missing dependencies

0.5.26.post2 yanked

Reason this release was yanked:

Missing dependencies

0.5.26.post1 yanked

Reason this release was yanked:

Missing dependencies

0.5.26b5 pre-release

0.5.26b1 pre-release

0.5.25

0.5.24

0.5.23

0.5.22

0.5.21

0.5.20

0.5.19

0.5.18

0.5.17

0.5.16

0.5.15

0.5.14

0.5.13

0.5.12

0.5.11

0.5.10

0.5.10b13 pre-release

0.5.10b12 pre-release

0.5.10b11 pre-release

0.5.10b10 pre-release

0.5.10b9 pre-release

0.5.10b8 pre-release

0.5.10b7 pre-release

0.5.10b6 pre-release

0.5.10b5 pre-release

0.5.10b4 pre-release

0.5.10b3 pre-release

0.5.10b2 pre-release

0.5.10b1 pre-release

0.5.9

0.5.9b1 pre-release

0.5.8

0.5.7

0.5.6

0.5.5

0.5.4

0.5.3

0.5.2

0.5.1.post1

0.5.1

0.5.0

0.4.62

0.4.61

0.4.60

0.4.59

0.4.58

0.4.57

0.4.56

0.4.55

0.4.54

0.4.53

0.4.52

0.4.51

0.4.50

0.4.49

0.4.48

0.4.47

0.4.46

0.4.45

0.4.44

0.4.43

0.4.42

0.4.41

0.4.40

0.4.39

0.4.38

0.4.37

0.4.36

0.4.35

0.4.34

0.4.33

0.4.32

0.4.31

0.4.30

0.4.29

0.4.28

0.4.27

0.4.26

0.4.25

0.4.24

0.4.23

0.4.22

0.4.21

0.4.20

0.4.19

0.4.18

0.4.17

0.4.16

0.4.15

0.4.14

0.4.13

0.4.12

0.4.11

0.4.10

0.4.9

0.4.8

0.4.7

0.4.6

0.4.5

0.4.4

0.4.3

0.4.2

0.4.1

0.4.0

0.3.13

0.3.12

0.3.11

0.3.11b1 pre-release

0.3.10

0.3.9

0.3.9b1 pre-release

0.3.8

0.3.8b3 pre-release

0.3.8b2 pre-release

0.3.8b1 pre-release

0.3.7

0.3.6

0.3.5

0.3.4

0.3.4b2 pre-release

0.3.3

0.3.2

0.3.1.post1

0.3.1

0.3.0.post1

0.3.0b1 pre-release

0.2.53

0.2.52

0.2.51

0.2.50

0.2.49

0.2.48

0.2.47

0.2.46

0.2.45

0.2.44

0.2.43

0.2.42

0.2.38

0.0.0

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page