Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.7.22-cp312-cp312-win_amd64.whl (1.7 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.7.22-cp312-cp312-manylinux_2_31_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.7.22-cp312-cp312-macosx_13_0_arm64.whl (1.9 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.7.22-cp311-cp311-win_amd64.whl (1.7 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.7.22-cp311-cp311-manylinux_2_31_x86_64.whl (2.3 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.7.22-cp311-cp311-macosx_13_0_arm64.whl (1.8 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.7.22-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.22-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 35ec47774eedccf299f538a7cf6d68023bf4f412c6438771bc3b82b86f6316b4
MD5 23788aa9fd5754f2a2e6ccb4cfa499e0
BLAKE2b-256 e3928f8c08c14cbbdcdf3a6175348a794d9f7a654e43db9708fc3c7e49ba6daf

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.7.22-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.7.22-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.22-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 9541fa68a9368df708d82dd7fae19d69a40a48d233566daf434fcf099911a13c
MD5 d62eecb56c5f6fe51fda17ba42a03568
BLAKE2b-256 5e19a09b6fe5cad93f0cef6f954b7a33c74d742313fbcb473e8ab85eccd2659f

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.7.22-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.22-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 8a1306de5034f227ad8e4b79cd58ed3cc73f68dedeaa462f17d4886545ba1ffe
MD5 d68d957d8ad3a53071e00c76c5cec1dd
BLAKE2b-256 fba18713ae9fc0b8c8c65900012cf15afc843a07d987801520c950ad1b25b6dd

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.7.22-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.7.22-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.22-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 f9a026c8fee15ae017893d5bd3eee2e9e3ebc54ae0c3e56fc61ac61a467ccc30
MD5 646cacd84657cecb719e48009be76f28
BLAKE2b-256 6b38d660f7b0a9b7b71de56d40da2652286a3ee2a5aa428730b14dcea0df742e

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.7.22-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.7.22-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.22-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 71de7879339620fd968f8ef9d9a7f53ab3918dd0be3d26f46d11523d366293e2
MD5 e746c19f21028d6df860d65ec867a6df
BLAKE2b-256 f84430a3f6fabff7d73e24017d03bf887657fe62a5e67624a1d750661bd431e1

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.7.22-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.22-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 101dae5539aec131bdd6c40ecc1e532edd08d7131c8bf2deec3046bfc1a78041
MD5 7be1651f3f4ad0b99ba9266059f4b056
BLAKE2b-256 1b4e1673a5d2bced8f4dee7501f717bc7f9e665fc57b744d4b365f81ac0f6ffc

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.7.22-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page