Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.11.27-cp312-cp312-win_amd64.whl (2.4 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.11.27-cp312-cp312-manylinux_2_31_x86_64.whl (3.7 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.27-cp312-cp312-macosx_13_0_arm64.whl (2.9 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.11.27-cp311-cp311-win_amd64.whl (2.5 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.11.27-cp311-cp311-manylinux_2_31_x86_64.whl (3.4 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.27-cp311-cp311-macosx_13_0_arm64.whl (2.8 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.11.27-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.27-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 b27f73671f738837d14522e57de63dcaa9f7cfd4cf1d2b4aa803eb163f5d8b95
MD5 28c09f1e7f49efd429cb3ef7a9cc25a4
BLAKE2b-256 4c9dde28a93e3e074bb594041e297f0ed730e5d435291a035b282489b4087c1b

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.27-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.27-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.27-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 786ab206deb9d7fcf3b46c5a7f4afb617ae1c8351c5d7becdae137c0250cd784
MD5 0cf530f393dc6577a58669710b8e0566
BLAKE2b-256 7706386c2c9154f61b8cb8250c4755f2d6b5b25d4b2531297a116fa7adf6d9b4

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.27-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.27-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 d2387cc7abb1d345b02448c620979183adeccae49785d579c23547729c15a19c
MD5 5a57daffd2521c10b226ea4f864381f8
BLAKE2b-256 78356d41414d5b1d9538f30131a7ec0a40477ead281dd977fb077150fc49d5ea

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.27-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.27-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.27-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 313c3859f8cbfebeb93f35f0f56c8f1b9c9ba519a3b31b0241e6ac7b8f18ef50
MD5 f945599363ec5493c35e78b3f395eccd
BLAKE2b-256 f3bc7fe192dd838bdf434b64984601d7917c201d3f92d715cdffea0e8eaa93bf

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.27-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.27-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.27-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 1cc96bc5ea852515061c033ffcea0fbe60cfddd6e7972178453d6c8792847fec
MD5 dae8690eb4f0ee27a69182c823617732
BLAKE2b-256 f82f902bfaaabb98fe822947c4b22f4bf5bde6ecce59a52bf0f3c53cb3f00597

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.27-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.27-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 cd8e074402cdf1d11e44e7f2700ef426cc609ca2faf23436f4f7a4684986f19a
MD5 9fcc08bf3b5fc96f4b59a73ef502776f
BLAKE2b-256 9fb2663654aa84a138d16c66ca583c27a291a2e991dd61905014e3baaea3f588

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.27-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page