Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.11.0-cp312-cp312-win_amd64.whl (2.0 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.11.0-cp312-cp312-manylinux_2_31_x86_64.whl (3.1 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.0-cp312-cp312-macosx_13_0_arm64.whl (2.4 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.11.0-cp311-cp311-win_amd64.whl (2.1 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.11.0-cp311-cp311-manylinux_2_31_x86_64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.0-cp311-cp311-macosx_13_0_arm64.whl (2.3 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.11.0-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.0-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 c7ba738abd1e7d2d3849f627e1d71d1166252ce4fcd95ab53fc340997aaaeb33
MD5 e2ebd2949c0a32c7aab664b150420fc1
BLAKE2b-256 c1e7137fcaf000e880ca6fa8e860da7999ac957b43fee29048083f84340c91b6

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.0-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.0-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.0-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 a581279762c80383193ac04fe3b9115bce5e73209227efdf6725a826e0c8a745
MD5 450dbcac43d2155c3f279e05da235319
BLAKE2b-256 868f1b1e47eec2cee44bb1cefaa8c294097d0bc0fde699f56f6f8a659ae59928

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.0-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.0-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 c06e7744392a9648ca3e0a6c777b8f555c68bb6f9c6d4eb79ea8142777edd22f
MD5 6fe2e16411cb2754d7d831902be75b05
BLAKE2b-256 ef01f7d28b3a656f2fd2c8cfcedc941e85bca56171f8fdb72002db11f585a633

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.0-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.0-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.0-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 85237633830b3cf763d5be5f5846a1422559fc8049107b976806737ba98df4f2
MD5 0a81b3e0093f664d611668c323044ed1
BLAKE2b-256 78ba9a2aa9e08d0ed85a31b042b6266c628b5347f5441c097ea44ccf72d28ab9

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.0-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.0-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.0-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 707b94c927f93352b10829e6dce64a98cc51e2c41be961d78a85784934e142ac
MD5 fe12ed01eb6e094021b755ecde408a31
BLAKE2b-256 596ed7fc464ce246ded2d522c4aebac5a2bf5dc27d1f5e0d2b65f74b2be5ca96

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.0-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.0-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 4e3318ea8ef795e6bf64b177d5500af9902b84a9ac3141a381eff48da328a27a
MD5 7d20127b79d0051486040a7dbebd0329
BLAKE2b-256 3fc2b71d1a1c2166d869a43734788a0def5cc3422e0c8fe6457a67fe8b15c881

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.0-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page