Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.12.9-cp312-cp312-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.12.9-cp312-cp312-manylinux_2_31_x86_64.whl (4.1 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.12.9-cp312-cp312-macosx_13_0_arm64.whl (3.2 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.12.9-cp311-cp311-win_amd64.whl (2.8 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.12.9-cp311-cp311-manylinux_2_31_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.12.9-cp311-cp311-macosx_13_0_arm64.whl (3.2 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.12.9-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.12.9-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 e0382b15acbfd3cf7b3c4fa9365919eff337ddb0f2af0b9e8312ea8505f3a9d9
MD5 a2f8bd427930b877a16c1a30d04af187
BLAKE2b-256 0acf07a2fbe94b14f575ba1a5b9df441302be1eefa297e193f589b86ceadb927

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.12.9-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.12.9-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.12.9-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 c413cd12105c303dc3721c74d231dfecc6642d35800c0f3b4692d4852b5591cf
MD5 8f80701130a62584adfad6cdfa86773e
BLAKE2b-256 540645b756e77ed1ed9a95f692ca67d658ef206d9bdc72ac8d6e8ee5d58a5aac

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.12.9-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.12.9-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 f7d2ea8d2c7ed70de6db6534fc75a6bdc2a392f69e305b994c5a738b6a058310
MD5 0a07a7b58657cd59a77589a655bb2a27
BLAKE2b-256 f61fff8b2002a5869e2cf0f5b8d09fb8ab93d8f0845b30234590b31cc7b98948

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.12.9-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.12.9-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.12.9-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 c3ba99b344b4166356799f4062f5ed795d2c16a0f5e3742e4b39cb2c8040a5a4
MD5 3dca14feddfe1ed7ba45265cad3b1b36
BLAKE2b-256 d37d50c24a3ad8b20c00f5679c4a5144e05b8a3ca926b36ade4f205374574143

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.12.9-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.12.9-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.12.9-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 a9ff1c07527f1b48239c76d49e1a7ae5e371e82f5dc4f0066fd7a02fe8b821ac
MD5 4b06373a3d65dff14553d58d58ce1c54
BLAKE2b-256 b4c7eb126303cf66f95e21440de000fb47e150c2354c8125b66a366ab55280d9

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.12.9-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.12.9-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 48282326c7bd73b06306f754ca2344020068f0ada2733af2a5aef1bca70e168f
MD5 2bd8de3effaf92d197dccb9d81ca97ee
BLAKE2b-256 4d5b4d99cb7d300952e2a0dc3392a18db2be190ad8c0ed13357302e55f3cc44a

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.12.9-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page