A library containing components related to model inferences in Gen AI applications.

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for glx-sre from gravatar.com glx-sre

Unverified details

These details have not been verified by PyPI
Meta
Classifiers
Report project as malware

Project description

GLLM Inference

Description

A library containing components related to model inferences in Gen AI applications.

Installation

Prerequisites

1. Installation from Artifact Registry

Choose one of the following methods to install the package:

Using pip

pip install gllm-inference-binary

Using Poetry

poetry add gllm-inference-binary

2. Development Installation (Git)

For development purposes, you can install directly from the Git repository:

poetry add "git+ssh://git@github.com/GDP-ADMIN/gen-ai-internal.git#subdirectory=libs/gllm-inference"

Available extras:

  • anthropic: Install Anthropic models dependencies
  • google-genai: Install Google Generative AI models dependencies
  • google-vertexai: Install Google Vertex AI models dependencies
  • huggingface: Install HuggingFace models dependencies
  • openai: Install OpenAI models dependencies
  • twelvelabs: Install TwelveLabs models dependencies

Managing Dependencies

  1. Go to root folder of gllm-inference module, e.g. cd libs/gllm-inference.
  2. Run poetry shell to create a virtual environment.
  3. Run poetry lock to create a lock file if you haven't done it yet.
  4. Run poetry install to install the gllm-inference requirements for the first time.
  5. Run poetry update if you update any dependency module version at pyproject.toml.

Contributing

Please refer to this Python Style Guide to get information about code style, documentation standard, and SCA that you need to use when contributing to this project

  1. Activate pre-commit hooks using pre-commit install
  2. Run poetry shell to create a virtual environment.
  3. Run poetry lock to create a lock file if you haven't done it yet.
  4. Run poetry install to install the gllm-inference requirements for the first time.
  5. Run which python to get the path to be referenced at Visual Studio Code interpreter path (Ctrl+Shift+P or Cmd+Shift+P)
  6. Try running the unit test to see if it's working:
poetry run pytest -s tests/unit_tests/

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for glx-sre from gravatar.com glx-sre

Unverified details

These details have not been verified by PyPI
Meta
Classifiers

Release history Release notifications | RSS feed

0.6.42

0.6.41

0.6.40

0.6.39

0.6.38

0.6.37

0.6.36

0.6.35

0.6.34

0.6.33

0.6.32

0.6.31

0.6.30

0.6.29

0.6.28

0.6.27

0.6.26

0.6.25

0.6.24

0.6.23

0.6.22

0.6.21

0.6.20

0.6.19

0.6.18

0.6.17

0.6.16

0.6.15

0.6.14

0.6.13.post1

0.6.13

0.6.13b1 pre-release

0.6.12

0.6.11

0.6.10

0.6.9

0.6.8

0.6.7

0.6.6

0.6.5

0.6.4

0.6.3

0.6.2

0.6.1

0.6.0

0.5.163

0.5.162.post1

0.5.162

0.5.161

0.5.160.post1

0.5.160

0.5.159.post1

0.5.159

0.5.158

0.5.157

0.5.156.post1

0.5.156

0.5.155.post1

0.5.155

0.5.154.post1

0.5.154

0.5.153.post1

0.5.153

0.5.152.post1

0.5.152

0.5.151.post1

0.5.151

0.5.150.post1

0.5.150

0.5.149.post1

0.5.149

0.5.148.post2

0.5.148.post1

0.5.148

0.5.147.post2

0.5.147.post1

0.5.147

0.5.146

0.5.145

0.5.144

0.5.143

0.5.142

0.5.141

0.5.140.post1

0.5.140

0.5.139.post1

0.5.139

0.5.138.post1

0.5.138

0.5.137

0.5.136

0.5.135

0.5.134

0.5.133

0.5.132

0.5.131

0.5.130

0.5.129

0.5.128

0.5.127

0.5.126

0.5.125.post1

0.5.125

0.5.124

0.5.123

0.5.122

0.5.121

0.5.120

0.5.119.post1

0.5.119

0.5.118

0.5.117.post1

0.5.115

0.5.114

0.5.113

0.5.112

0.5.111

0.5.110

0.5.109

0.5.108

0.5.107

0.5.106

0.5.105

0.5.104.post1

0.5.104

0.5.104b1 pre-release

0.5.103

0.5.102

0.5.101

0.5.100

0.5.99

0.5.98

0.5.97

0.5.96

0.5.95

0.5.94

0.5.93

0.5.92

0.5.91.post1

0.5.91

0.5.91b2 pre-release

0.5.91b1 pre-release

0.5.90

0.5.89

0.5.88

0.5.87

0.5.86

0.5.85

0.5.84

0.5.83

0.5.82

0.5.81

0.5.80

0.5.79

0.5.78

0.5.77

0.5.76

0.5.75

0.5.74

0.5.73

0.5.72

0.5.71

0.5.70

0.5.69

0.5.68

0.5.67

0.5.66

0.5.65

0.5.64

0.5.63

0.5.62

0.5.61

0.5.60

0.5.59

0.5.58

0.5.57

0.5.56

0.5.55

0.5.54

0.5.53

0.5.52

0.5.51.post1

0.5.51

0.5.51b3 pre-release

0.5.50

0.5.49

0.5.48

0.5.47

0.5.46

0.5.45

0.5.44

0.5.43

0.5.42

0.5.41

0.5.40

0.5.39

0.5.38

0.5.37

0.5.36

0.5.35

0.5.34

0.5.33

0.5.32

0.5.32b1 pre-release

0.5.31

0.5.30

0.5.30b1 pre-release

0.5.29

0.5.28

0.5.27

0.5.26.post4

0.5.26.post3 yanked

Reason this release was yanked:

Missing dependencies

0.5.26.post2 yanked

Reason this release was yanked:

Missing dependencies

0.5.26.post1 yanked

Reason this release was yanked:

Missing dependencies

0.5.26b5 pre-release

0.5.26b1 pre-release

0.5.25

0.5.24

0.5.23

0.5.22

0.5.21

0.5.20

0.5.19

0.5.18

0.5.17

0.5.16

0.5.15

0.5.14

0.5.13

0.5.12

0.5.11

0.5.10

0.5.10b13 pre-release

0.5.10b12 pre-release

0.5.10b11 pre-release

0.5.10b10 pre-release

0.5.10b9 pre-release

0.5.10b8 pre-release

0.5.10b7 pre-release

0.5.10b6 pre-release

0.5.10b5 pre-release

0.5.10b4 pre-release

0.5.10b3 pre-release

0.5.10b2 pre-release

0.5.10b1 pre-release

0.5.9

0.5.9b1 pre-release

0.5.8

0.5.7

0.5.6

0.5.5

0.5.4

0.5.3

0.5.2

0.5.1.post1

0.5.1

0.5.0

0.4.62

0.4.61

0.4.60

0.4.59

0.4.58

0.4.57

0.4.56

0.4.55

0.4.54

0.4.53

0.4.52

0.4.51

0.4.50

0.4.49

0.4.48

0.4.47

0.4.46

0.4.45

0.4.44

0.4.43

0.4.42

0.4.41

0.4.40

0.4.39

0.4.38

0.4.37

0.4.36

0.4.35

0.4.34

0.4.33

0.4.32

0.4.31

0.4.30

0.4.29

0.4.28

0.4.27

0.4.26

0.4.25

0.4.24

0.4.23

0.4.22

0.4.21

0.4.20

0.4.19

0.4.18

0.4.17

0.4.16

0.4.15

0.4.14

0.4.13

0.4.12

0.4.11

0.4.10

0.4.9

0.4.8

0.4.7

0.4.6

0.4.5

0.4.4

0.4.3

0.4.2

0.4.1

0.4.0

0.3.13

0.3.12

0.3.11

0.3.11b1 pre-release

0.3.10

This version

0.3.9

0.3.9b1 pre-release

0.3.8

0.3.8b3 pre-release

0.3.8b2 pre-release

0.3.8b1 pre-release

0.3.7

0.3.6

0.3.5

0.3.4

0.3.4b2 pre-release

0.3.3

0.3.2

0.3.1.post1

0.3.1

0.3.0.post1

0.3.0b1 pre-release

0.2.53

0.2.52

0.2.51

0.2.50

0.2.49

0.2.48

0.2.47

0.2.46

0.2.45

0.2.44

0.2.43

0.2.42

0.2.38

0.0.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_inference_binary-0.3.9-cp313-cp313-win_amd64.whl (898.7 kB view details)

Uploaded CPython 3.13Windows x86-64

gllm_inference_binary-0.3.9-cp313-cp313-manylinux_2_36_x86_64.whl (1.3 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.36+ x86-64

gllm_inference_binary-0.3.9-cp313-cp313-manylinux_2_31_x86_64.whl (1.4 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.31+ x86-64

gllm_inference_binary-0.3.9-cp313-cp313-macosx_13_0_x86_64.macosx_15_0_x86_64.whl (1.1 MB view details)

Uploaded CPython 3.13macOS 13.0+ x86-64macOS 15.0+ x86-64

gllm_inference_binary-0.3.9-cp313-cp313-macosx_13_0_arm64.macosx_15_0_arm64.whl (928.8 kB view details)

Uploaded CPython 3.13macOS 13.0+ ARM64macOS 15.0+ ARM64

gllm_inference_binary-0.3.9-cp312-cp312-win_amd64.whl (901.5 kB view details)

Uploaded CPython 3.12Windows x86-64

gllm_inference_binary-0.3.9-cp312-cp312-manylinux_2_36_x86_64.whl (1.3 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.36+ x86-64

gllm_inference_binary-0.3.9-cp312-cp312-manylinux_2_31_x86_64.whl (1.4 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_inference_binary-0.3.9-cp312-cp312-macosx_13_0_x86_64.macosx_15_0_x86_64.whl (1.1 MB view details)

Uploaded CPython 3.12macOS 13.0+ x86-64macOS 15.0+ x86-64

gllm_inference_binary-0.3.9-cp312-cp312-macosx_13_0_arm64.macosx_15_0_arm64.whl (923.5 kB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64macOS 15.0+ ARM64

gllm_inference_binary-0.3.9-cp311-cp311-win_amd64.whl (911.9 kB view details)

Uploaded CPython 3.11Windows x86-64

gllm_inference_binary-0.3.9-cp311-cp311-manylinux_2_36_x86_64.whl (1.2 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.36+ x86-64

gllm_inference_binary-0.3.9-cp311-cp311-manylinux_2_31_x86_64.whl (1.3 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_inference_binary-0.3.9-cp311-cp311-macosx_13_0_x86_64.macosx_15_0_x86_64.whl (1.1 MB view details)

Uploaded CPython 3.11macOS 13.0+ x86-64macOS 15.0+ x86-64

gllm_inference_binary-0.3.9-cp311-cp311-macosx_13_0_arm64.macosx_15_0_arm64.whl (912.6 kB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64macOS 15.0+ ARM64

File details

Details for the file gllm_inference_binary-0.3.9-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.3.9-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 00a71b794a4ad63da221f28fa8d5f4ea043fd3324b472537fbbfa5f2b71ebbf9
MD5 7c5070e0c2c4f00790e34576ea761218
BLAKE2b-256 5a240a0d6925a0eb0968f2eaf302d76240d88756815937db17f5a3852982de6d

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.3.9-cp313-cp313-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gen-ai-internal

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.3.9-cp313-cp313-manylinux_2_36_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.3.9-cp313-cp313-manylinux_2_36_x86_64.whl
Algorithm Hash digest
SHA256 091a1bae966047678c4c3309f8ed53c31365244315f0491868c4374e724feffb
MD5 7408eec9210e89434edd8c4e23231dee
BLAKE2b-256 0267332611efce8cc3cc379d63ca232c1d9c6152a5e208106441218eae3333f0

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.3.9-cp313-cp313-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.3.9-cp313-cp313-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 6c1e50a5b29b71e7e9d6eb8ec55c5f056d22c6d74780f55880b3a0362c1dabe7
MD5 8b356fa2a3f4e4131eac2c3dd774e642
BLAKE2b-256 9343fdbf8a8e480c5b30e9a22de792f32be2762ef5ad2479b4a804c7a22ca032

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.3.9-cp313-cp313-macosx_13_0_x86_64.macosx_15_0_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.3.9-cp313-cp313-macosx_13_0_x86_64.macosx_15_0_x86_64.whl
Algorithm Hash digest
SHA256 da08868f960f0bcc766e0331ce8907cd2bab01f50f6fbf775b293acb60621abd
MD5 276ac3c3393d58a891aab969e0dc6394
BLAKE2b-256 c09ff61c76823e7f4d81f69d55f2666aaa77dfabfad7daa23fa8cf21bc251ec4

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.3.9-cp313-cp313-macosx_13_0_x86_64.macosx_15_0_x86_64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gen-ai-internal

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.3.9-cp313-cp313-macosx_13_0_arm64.macosx_15_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.3.9-cp313-cp313-macosx_13_0_arm64.macosx_15_0_arm64.whl
Algorithm Hash digest
SHA256 f36f059ba41219a0b4caac9f398377f161187baf928d6628f115e30046338c5c
MD5 dd38f48535d1c68fd74765b53eb1ab7e
BLAKE2b-256 f28209dc09898b3307226a233b2757de63e9b096072cb7e28f0a5d9026be440b

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.3.9-cp313-cp313-macosx_13_0_arm64.macosx_15_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gen-ai-internal

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.3.9-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.3.9-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 745f884356bb32f1ba25c2e823d7eff4029aa802fe17b3fd1578a36f900d3724
MD5 64ae3ee3f0fc4663b7cfb31a8612eeb1
BLAKE2b-256 7cc374821357ea53574ed222bc102d3d36eef4c3835ac02b806874682902aa45

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.3.9-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gen-ai-internal

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.3.9-cp312-cp312-manylinux_2_36_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.3.9-cp312-cp312-manylinux_2_36_x86_64.whl
Algorithm Hash digest
SHA256 3e2146bf021ff6b3b2dafa381da6c3eeb2edfba325d6cc8fce34111096dfc213
MD5 0e96cc1c318e4c5d82f34ceaf98d72ad
BLAKE2b-256 245600cc55986be9b53e69250cd3e043948620eaeb200eed333eb155ff5a7ce6

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.3.9-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.3.9-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 65db36a13b0f015bd67595f43ac9a14279cab822e04be4f4c8df30f7127f17d7
MD5 0a23a716053292c23545f52b6d4ab767
BLAKE2b-256 6294bc6860f3c62f2598d3ab031a79b4b031f302a336e5042ac57c015f5fb84b

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.3.9-cp312-cp312-macosx_13_0_x86_64.macosx_15_0_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.3.9-cp312-cp312-macosx_13_0_x86_64.macosx_15_0_x86_64.whl
Algorithm Hash digest
SHA256 8246186b705d78c587e09e0b16d6e5926d80f56d41f2bf25e7ce972fd07e65b1
MD5 f0d4b042b3bf753546a57e56a34c93fa
BLAKE2b-256 2d50670adfde2a915dd39ed255d52c9de6e1a5ff62262b5662418fc839026413

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.3.9-cp312-cp312-macosx_13_0_x86_64.macosx_15_0_x86_64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gen-ai-internal

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.3.9-cp312-cp312-macosx_13_0_arm64.macosx_15_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.3.9-cp312-cp312-macosx_13_0_arm64.macosx_15_0_arm64.whl
Algorithm Hash digest
SHA256 57db790e928731ea63bd54a2be3d5787b5a77df18119d4c939feb03bfaab6833
MD5 deb4246c11fbd82e116adab8405e69f6
BLAKE2b-256 e7484c805ba80ebde3ee5bd5d24b68db6a9844efa2bbd9bfa4935983007dd4e1

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.3.9-cp312-cp312-macosx_13_0_arm64.macosx_15_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gen-ai-internal

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.3.9-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.3.9-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 27e96ce53489f8323dffe8958e59e9a7e096814307e42dddf16642f4ee2584fd
MD5 bb3f09a7044a27cc0e7fa171845066f0
BLAKE2b-256 9dde9f5adc4fae99b712d944895f716c2d380760c05b0c4baa31f64a30628079

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.3.9-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gen-ai-internal

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.3.9-cp311-cp311-manylinux_2_36_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.3.9-cp311-cp311-manylinux_2_36_x86_64.whl
Algorithm Hash digest
SHA256 79195018e5a6fa2f38988e0b68c123b653e011d58b6955c37fdabd953bc38671
MD5 6a6a8a461f547be91a036d9fb4e32d26
BLAKE2b-256 3c82a99eea2f3e6f42d6557d37005d1f7580d072feb8d81cd631435951dc718a

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.3.9-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.3.9-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 3f595555c93947f3f49a57b67db7f03fa07c9d2775557eb5562e9bf054dee9d5
MD5 bc4fc297b32ec9ea1df354e1a738eb9f
BLAKE2b-256 3e2fd04ae8ceb04d7baedf5ee113ee0137f8602b94c21aa308f70effb4bb90df

See more details on using hashes here.

File details

Details for the file gllm_inference_binary-0.3.9-cp311-cp311-macosx_13_0_x86_64.macosx_15_0_x86_64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.3.9-cp311-cp311-macosx_13_0_x86_64.macosx_15_0_x86_64.whl
Algorithm Hash digest
SHA256 a5a811a8a82a1a2044eade03ce0f4c1100884b1730f96c8e9c748b7d160761cf
MD5 75695402d73545a1010c4d30a5ab216f
BLAKE2b-256 7a1b35291cb2b36bad1d6647a4766dce5f6cb6c24da890a41f2944ffb66dfc14

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.3.9-cp311-cp311-macosx_13_0_x86_64.macosx_15_0_x86_64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gen-ai-internal

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_inference_binary-0.3.9-cp311-cp311-macosx_13_0_arm64.macosx_15_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_inference_binary-0.3.9-cp311-cp311-macosx_13_0_arm64.macosx_15_0_arm64.whl
Algorithm Hash digest
SHA256 f23be3bd8ea4efcf22ab9ca700895bbc667ae06a42e6bd4b7b035d6e567df3e3
MD5 67c7f1ceb59fa9dbcbd17af635334bfa
BLAKE2b-256 4de8b9e9bd69db463f79c2cf1a080af71cd2826e94506459b2e6acfe21ceffeb

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_inference_binary-0.3.9-cp311-cp311-macosx_13_0_arm64.macosx_15_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gen-ai-internal

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page