Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.10.9-cp312-cp312-win_amd64.whl (2.0 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.10.9-cp312-cp312-manylinux_2_31_x86_64.whl (3.0 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.10.9-cp312-cp312-macosx_13_0_arm64.whl (2.3 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.10.9-cp311-cp311-win_amd64.whl (2.1 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.10.9-cp311-cp311-manylinux_2_31_x86_64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.10.9-cp311-cp311-macosx_13_0_arm64.whl (2.3 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.10.9-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.9-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 1ae84793fe092f636a728a92b68e26301e0b8b6d1b1e0df8b6182f6c39628a80
MD5 3451a7a51636ff49881536770bed4e80
BLAKE2b-256 d352b30675b0bc586d542d3315c08c5bfaa0e09cfb3c2de5a35a669923925f9c

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.10.9-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.10.9-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.9-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 ea7ef4cd4086470db65c2d1798e5ecaf052e7eb9992c9dbed66ec1dcbded222c
MD5 28f781e8642fe97b416b96fe3493f431
BLAKE2b-256 9b1de4f821959dea77775f3b8eaf9d1f70aa3a8c9121295200c636ae338dba72

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.10.9-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.9-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 f94aefa921535ef2a7dad24863e8ee78cd961c5fdf724f1702fb0c06972cc4c0
MD5 fad47bfc781e21022b78881f552e4063
BLAKE2b-256 435ebfc621c69442f090ea11d8ef2e044bc247f9233c3e93c2e6cb6a24354434

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.10.9-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.10.9-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.9-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 b21c84460bc50cd81cf592058e57737945d3ad5f89a3357f9a79d19ea64f3ab9
MD5 bfc33c6b68ad6639f7d468b5d4b4e925
BLAKE2b-256 eac60213f961a108167810e19f35aafbc38d1e1309ef30f2ad8155bb865a3254

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.10.9-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.10.9-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.9-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 1ec2796270ac0d1a1a50e686f119f880912881653af7b64b1c76f3263d697448
MD5 b3b32dd9f57a1c6db71e747ceccbe734
BLAKE2b-256 1cdd22f2b6134bc57999b00242c5250616e7e35f908e0782c5c1ae47691b4f74

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.10.9-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.9-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 08391bae74a0ebae5f2eb207ef552c1d0798f9cffcf7fa6acdc075d753d0576c
MD5 f7b8023345bc5d53d9a6b96fdf3601ec
BLAKE2b-256 5490cd7625a1098153698b564edb8fc1d5c1ccb53bbdc6d14be2d19a66dbf21a

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.10.9-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page