Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.11.11-cp312-cp312-win_amd64.whl (2.3 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.11.11-cp312-cp312-manylinux_2_31_x86_64.whl (3.5 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.11-cp312-cp312-macosx_13_0_arm64.whl (2.7 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.11.11-cp311-cp311-win_amd64.whl (2.5 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.11.11-cp311-cp311-manylinux_2_31_x86_64.whl (3.2 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.11-cp311-cp311-macosx_13_0_arm64.whl (2.7 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.11.11-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.11-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 f69aaad603a06f8d9527d108abb687f849b6d8ba86d627c3786eca64f5583a3e
MD5 a2d193443ae1c025b558fe487196699c
BLAKE2b-256 e71b5b7a44c91c2b3dc30bd2afa83a83ead0e3b67b290b40fa456db7683924f4

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.11-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.11-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.11-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 d0dd9025da6b5a7f38318118d6c71ded289356c06f89e8542a16de34bb4dab03
MD5 45b4de7b10b5c5086a36e1b4a35c00bc
BLAKE2b-256 46bfb7a2aedf94a70533833e3247af19906c86869801c61db4667e0e95372e84

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.11-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.11-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 ab265b2b93922eccd8c5e9951980d056be2f63fe1d4e83be94f2f38776a8c0ef
MD5 19b3c369f28c5d712b304dafc8f70f3a
BLAKE2b-256 f7fefd9175aae02f45768beecea89df5eb3b9c5aed45697e467d7ed1d56ccdbf

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.11-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.11-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.11-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 2e66e2f4e3e4210bec172d5e6614ecd293b4090eee3b420b1260af53f4567bf6
MD5 da0a9da9e44dfb386912e851606ce3ae
BLAKE2b-256 105d9fe57c6e83a5198af361555cc5722cf774a43e606034a841ac2a7b033152

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.11-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.11-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.11-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 b4460a1fe4b2e93102f77f8444e3802a178e7cb312a208a74855373a32da3d98
MD5 5599c6851cc36536ff5c3d5de5b3dc57
BLAKE2b-256 3714279fe9e15fa52dcc30365e97e729b03fea1a15503eb9cf5452394cee2402

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.11-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.11-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 3ec56f090ee33be29bd43f3d8b4f07c6fe34a7712c83e20a8110134f98d699bb
MD5 4d75f11d70e68720ca0593cdbb490900
BLAKE2b-256 c6f18709e4edda2e7632cbe69740860736c7789e59c0259dda5db96bff28bde2

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.11-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page