Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.11.43-cp312-cp312-win_amd64.whl (2.5 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.11.43-cp312-cp312-manylinux_2_31_x86_64.whl (3.9 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.43-cp312-cp312-macosx_13_0_arm64.whl (3.0 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.11.43-cp311-cp311-win_amd64.whl (2.6 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.11.43-cp311-cp311-manylinux_2_31_x86_64.whl (3.6 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.43-cp311-cp311-macosx_13_0_arm64.whl (3.0 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.11.43-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.43-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 219606c786051032ddb064b885a68680c14dec60b4c4d39d4352fca3479dd91c
MD5 cffd72ab6b40bd3f54bb604ef6050125
BLAKE2b-256 bc7111e9fad958931038737ce67b082597e00f64057b7a3e7d8f7bc9a66a1a86

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.43-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.43-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.43-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 d66fafc33afd6742d0bfa28fc9cac0efc186eb7f29e216f17577bc3e025299ff
MD5 f5baf35f1a52480ad2e3c00d9bfb6dfe
BLAKE2b-256 1d392caf360cea2156dc75b327dd10d39667b9cdcaadc65e97c866d43c25e8e2

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.43-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.43-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 a9f6a65542aa6e00509fb1c2fe7e81fdca8b373690ba0e435e73ea4fade2cf86
MD5 d773131798f218fa7dbb662a25112ab4
BLAKE2b-256 dee66df827884c149066895fd95735ce4170bce053445abcc674569796c38ed6

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.43-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.43-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.43-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 bcd2183a9dac5a2a1466c450e08b4c3f030b24e038cd063ec1ad145b8b4827a6
MD5 847d78528f1caae27c1138c2fbe238a0
BLAKE2b-256 8d6df4399aa4025959bd1ffa2fd5431b2b123444c359df0db48eb3ca6373d49c

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.43-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.43-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.43-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 70956e0e482938a7a7a2a9c3123e81777f746f998648170bb1bd85f3fbfa54be
MD5 2b3d423fe3a722515824123d9a09fd63
BLAKE2b-256 59fe98596215dfd39f241bbb53442d4e3d7646b186e0d9c67a7c91a56ec1e821

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.43-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.43-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 7cdb3d312fa205a38663b1d108223628744d550abd339083121d93fe6bfb2460
MD5 6ad84ab5b311bb9e3a13c82c5b3a7b35
BLAKE2b-256 545887330a1a1db9e95eda1922dbede38b876c5793227a82e98b3c9933d414c0

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.43-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page