Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.10.3-cp312-cp312-win_amd64.whl (2.0 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.10.3-cp312-cp312-manylinux_2_31_x86_64.whl (3.0 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.10.3-cp312-cp312-macosx_13_0_arm64.whl (2.3 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.10.3-cp311-cp311-win_amd64.whl (2.1 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.10.3-cp311-cp311-manylinux_2_31_x86_64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.10.3-cp311-cp311-macosx_13_0_arm64.whl (2.3 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.10.3-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.3-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 0c63a2cc828d9ba402db801a3965b9be24480f4a5881d36688043b61c428ddea
MD5 f5a7d20fa26d47ab1bacbfeab9dc4522
BLAKE2b-256 6ad7468c34a7e2dc1d58452c40b926aee64ae256a12c94394a822855f7e2a0cf

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.10.3-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.10.3-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.3-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 add44570ee07d3bc7545a55058d1390f716639033a17f4fef50df46bb5ea659c
MD5 2f26cb500b761a2ad14e40249e27d985
BLAKE2b-256 fdae40a09fc50610223022c5aaeadcb823abb10d27f15d7850f598039ccc2c02

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.10.3-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.3-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 a9b4be0c12d77b79c47b6861a61fb93b2db763e7715db78735bf0ee3a1dd83cc
MD5 0ae5f427020e66ca2512fed51539f7a0
BLAKE2b-256 9de2ab69bf438cd2e3efdf6824549e12c07e532f16527eacac142ee77454e08a

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.10.3-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.10.3-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.3-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 f249410ad92bce6ee4d22a415a5a43e15467d99a3616a400fd2cdd86377c8675
MD5 af9aabf2866c39034a3c2318e83a1637
BLAKE2b-256 0612653e1ac5c63cbf15d335ab0aaa33a1d890032220bdac9326c2a4765ca67d

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.10.3-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.10.3-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.3-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 61cb8a169d1328c8c5db42e4dc648325f879891d11785c9214074fb77d7e7fff
MD5 798d835090a7d75cf35c8dece97a0129
BLAKE2b-256 0d52b60f61f77b46f17e4b21b60c0e14f2818a738b823ca5fcea7c23ba347e02

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.10.3-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.3-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 7f4855bb1fc84f46c88f8f207e8b964f2616f3dd745f3b5ad375909d1ff09bb7
MD5 a9c255ee3c8e81e37bb74d4b948676d8
BLAKE2b-256 bea0c5c4a0412a5ef4763543ea99529b37040b0e69ebc5e978bb2e84652013bf

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.10.3-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page