Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.10.2-cp312-cp312-win_amd64.whl (2.0 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.10.2-cp312-cp312-manylinux_2_31_x86_64.whl (3.0 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.10.2-cp312-cp312-macosx_13_0_arm64.whl (2.3 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.10.2-cp311-cp311-win_amd64.whl (2.1 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.10.2-cp311-cp311-manylinux_2_31_x86_64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.10.2-cp311-cp311-macosx_13_0_arm64.whl (2.3 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.10.2-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.2-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 2476ecb13eedd48180a0ca9b2b926b51496e2a9f0cc387788139eb8c5375176e
MD5 591ac757a2a89b6ccf23e4c2e24b69fb
BLAKE2b-256 c7591cd0c8428775bfbd96137983dfc13ce8c51f302218b01fd48fb2c395b49f

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.10.2-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.10.2-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.2-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 31821ffc52646c16f6a36d584004b3a91d3d93212c1d78aaee4992423316cf5e
MD5 dcec5e2533a23a49c0488e3bae729255
BLAKE2b-256 f184da4f8c6c6c263ba10728a076688f8e303d53c67709d0cc047b112027c8a2

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.10.2-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.2-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 aa9e69e4e6a920a49b35b66af17d3958151b4ee74b9ba685360a5135778d1a63
MD5 58a31a8d9c866b550065d828249be322
BLAKE2b-256 532f33120d7b59c0b363510c463efddf86799ec08c2e7e189fb78183579ceed8

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.10.2-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.10.2-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.2-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 14b0b1e710548a94c668ac3a23e7ae1945057cc11201f2cac998c6bc79942162
MD5 207e4d7ccdf116220921868c8606a208
BLAKE2b-256 d71f7f235ce4421d54076c331fd0a59d2169adc8b770323a1214e8cad9007b49

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.10.2-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.10.2-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.2-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 d4ebbbad8f4b6ab85cce50068e3ed373fb37a3c7e15afd99705df5f3ad46a0bf
MD5 2f4c8e630af5e9099990659bb47c382a
BLAKE2b-256 09eda73cf63d68b70cbb40ced85e76fe8f8eafb76db0c776e0cec6a90f4f1396

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.10.2-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.2-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 c8044c7d0e57824d1460c589331f00ccb76ada920dd9221191b1fd7f6ed19995
MD5 3799da74a1d5febd6fe195340ebcf198
BLAKE2b-256 ef482c677ed4f3b44dd3c4ca9f29bc3612dcd3865890ff3eb028b327cfdc1d35

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.10.2-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page