Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.11.42-cp312-cp312-win_amd64.whl (2.5 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.11.42-cp312-cp312-manylinux_2_31_x86_64.whl (3.9 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.42-cp312-cp312-macosx_13_0_arm64.whl (3.0 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.11.42-cp311-cp311-win_amd64.whl (2.6 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.11.42-cp311-cp311-manylinux_2_31_x86_64.whl (3.6 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.42-cp311-cp311-macosx_13_0_arm64.whl (3.0 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.11.42-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.42-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 2b7e956346299408246c37f3e692492fb88e22fbfecb13e5a0d1e48c9dfb420d
MD5 f68a772121e4850a0c11a6362362862e
BLAKE2b-256 c5d44ab7194f3151fc21f2ca394dd20f0bc621810f64065dc468dc49c58abee1

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.42-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.42-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.42-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 78e813431d8bca03c5dcb8aafabfdff7a3aa6c2e75b4060e79d1fb386ddf53bb
MD5 e8c771210d1d6b8572bae218b0e039da
BLAKE2b-256 60b1198a1ff3ece116a0b917aaf1fb145d2b50eb271044b7f618c0487ff4c0e1

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.42-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.42-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 12329a335104f71c2fa0f8ea8481ee79ab937f73cc873fc772262711307ba36b
MD5 48e0242a42bc0a4af3a994da3ce5a6b2
BLAKE2b-256 e3fbf20967180871e9507f152f55251e07b7d0ae89be24e06c183c642ee47df2

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.42-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.42-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.42-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 7c9d658ec99151390c762e2c572bab697d0635899f79005a4a75e24ed950a94e
MD5 19880ae5c8704ea7cc2dd03733887588
BLAKE2b-256 880e9e320b9018a41dce18cd42bc5874848d15243baa56e02aa7e825d2f24607

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.42-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.42-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.42-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 0082283dc70bc68d041b66914eea2e8df0a9b485a7d0a8ca2d69bb19af848ca4
MD5 8e38008ab6fcfa139cea6f622c472551
BLAKE2b-256 ffd4c23eff8c67ec5f1b22f1425deae3bc874b20e1415488012e3312ba2420ad

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.42-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.42-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 22c46b8fd938b9726d993cf59a58eb113897b1452e42517635c7f000e996c617
MD5 42336ae2f3b0e4c2889a0f12d001bc0f
BLAKE2b-256 cf643f1d8ef6c777f8d27ede2838cb5f4d15a71babfd4918d9f40964ab509625

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.42-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page