Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.11.29-cp312-cp312-win_amd64.whl (2.4 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.11.29-cp312-cp312-manylinux_2_31_x86_64.whl (3.7 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.29-cp312-cp312-macosx_13_0_arm64.whl (2.9 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.11.29-cp311-cp311-win_amd64.whl (2.5 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.11.29-cp311-cp311-manylinux_2_31_x86_64.whl (3.4 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.29-cp311-cp311-macosx_13_0_arm64.whl (2.8 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.11.29-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.29-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 b781741626d7ccc69fa608df17949473e7572905cf6df7a193a827f71b595fad
MD5 b52c962c7e3bbd1643cdd9ed1ba0d2f2
BLAKE2b-256 5265baf3ec70ddb9ddd468f0f1f4067ba0d79f0a6db5ade86ae08c4fec0e711e

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.29-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.29-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.29-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 03e0fa21e803fb3a3e94def44bcc06b1a934bba64702ffd488994c210062ec38
MD5 bec9a1cc87d14186cd3fd36b39c4d332
BLAKE2b-256 0662522eae206ddcb81c640f9c860cd6bbb13682711eb78c3b3b5700895f15c2

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.29-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.29-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 dc25622245eec42d92c9d4c2fafa8522aceb5b075d4433d42186b6eb6eed29c0
MD5 8283cfc0e103634c411506922a3f66f7
BLAKE2b-256 8879fb757ce9685e548dc221786a0914e9140ac54bdc528ec62e88be62ea2568

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.29-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.29-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.29-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 a50307661cdf7a5ad2c02b115bb9e89e57bf7162611fbe574f303e017797075e
MD5 2e89acc7a8344aabb98e0e9675676ea2
BLAKE2b-256 b26e566fa567d8e4a96face08af17019654ccc41144417cd74690994591d3356

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.29-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.29-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.29-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 2801a7d6f0befda34ace7f8d3c78fdb579e610a142cf78d68437ee4139baa86e
MD5 a5eab1ff5ab309eb19baf7bad3d19a02
BLAKE2b-256 270ca3f2aae1c7eee99d8f2a052511b32352c9c5e45b85d7f1f41982901c21ad

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.29-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.29-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 a3cd5844ceb59d1cdaaf660eb6292fe4f92652c0ecdb6af054ddc64211a80f34
MD5 c3095e893b5fc4d26e5a67033bfb638b
BLAKE2b-256 0590fd68f3a4d4ca4dc684a0573196247dc3cc6e0a07a89233dc44578f825fdf

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.29-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page