Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.9.2-cp312-cp312-win_amd64.whl (2.0 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.9.2-cp312-cp312-manylinux_2_31_x86_64.whl (2.9 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.9.2-cp312-cp312-macosx_13_0_arm64.whl (2.3 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.9.2-cp311-cp311-win_amd64.whl (2.1 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.9.2-cp311-cp311-manylinux_2_31_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.9.2-cp311-cp311-macosx_13_0_arm64.whl (2.2 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.9.2-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.9.2-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 11d01fe1fb4e70e6266448b18018df411927e51a931195dc3bbb0c4ad9cb9c62
MD5 bf68b5bc02cec54165633b0fe2576d26
BLAKE2b-256 5fb958fb45062c553e4cf00a6d04b497d062b43ac53fba4540df1f92a46c3950

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.9.2-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.9.2-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.9.2-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 998ae40a52028b0b557fdd15ed989fb753011ce89094cf0021c05da7e21ebf15
MD5 9c1851ef2b4597d04d7ff61f0acdb6d7
BLAKE2b-256 9b536abccceabf98bf7eeb5201c982559a96ef20a18775eb5a8ea235a5df5d2c

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.9.2-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.9.2-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 baf598b96f3727044ce603ccf4fe782a27b9298e09141826e0fca324a9aea1ae
MD5 4f30dd7f9f95f13fd0df86da982a662d
BLAKE2b-256 4f6b7845460d80a6597214161e5f911db898b598ff3fa79c5b399e514f27fdcd

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.9.2-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.9.2-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.9.2-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 7c883a3fe9c208c665e64f923c6acb54ab1152aa21ef1c51708e9d133895f0de
MD5 206c399ab00ccd998549c3c262763c41
BLAKE2b-256 8e67340b6e0afab8d67a89db545669b3579c89a402b689a44e6d9acfe650d205

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.9.2-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.9.2-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.9.2-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 6ddc00e6ea19dff594bc925c1bf85295dfacc134a1eeb1dea641971963d79836
MD5 af5dc2479eef0a00c681e1ce86f1028e
BLAKE2b-256 3119194526b65112c4c0c1cfc4fce6dd67f7c01539c3381b8a37698e07c67408

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.9.2-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.9.2-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 75357d515be205c8fa3cc08d20dbf7541bdddb8885ddbfb3fa8db01d0af5cb76
MD5 242e1436f20248811243aa31bed97461
BLAKE2b-256 f72c9aa94ba2c0657a84736b1bd9cada6428a1a3bcd57a8f14328c6b4781202d

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.9.2-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page