Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.10.8-cp312-cp312-win_amd64.whl (2.0 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.10.8-cp312-cp312-manylinux_2_31_x86_64.whl (3.0 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.10.8-cp312-cp312-macosx_13_0_arm64.whl (2.3 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.10.8-cp311-cp311-win_amd64.whl (2.1 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.10.8-cp311-cp311-manylinux_2_31_x86_64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.10.8-cp311-cp311-macosx_13_0_arm64.whl (2.3 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.10.8-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.8-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 c277f88160aa3a0822f83f2759539a4632b84854bb2709ea4fbdf05125733904
MD5 7ca57499d0fa171f1f0fecea2b001c5c
BLAKE2b-256 dc31713e4ebbbcf9dbcf4c862939bf652e56823a58d686de71283cce0d5aa386

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.10.8-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.10.8-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.8-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 213343b7ce237bc39f4e01fada702f92c0a4ad25b47dd341b3981392f3173723
MD5 cf2c0fcb52fb267a8c23c82cb0ce1dce
BLAKE2b-256 1ac197364e7f0c911839bc79b66f6427da29d953a1678a1dac45db8f485d2f23

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.10.8-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.8-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 05707d059865609c7b31ca329c2cee4d2cbe9ddcc90bc104bdf8a949c7775866
MD5 9534fbbb6b0d4c4e15cde6007bef853f
BLAKE2b-256 d7d72c952ded556ad18363651471bea1eac903a7dac71c674481c164640e1a41

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.10.8-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.10.8-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.8-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 7fd1108b0b6e214f4e549d8d3da07c4b6fb736af4bad314124699292fc621cd5
MD5 b4bf3ac22eee562f8fc87e77665b10ea
BLAKE2b-256 b7a5a2e58c11a1595b23778b25d28fd0f49c8b2711a01393426c91c4c0a9b18f

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.10.8-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.10.8-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.8-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 f5ce682e5f4cb6f29c5d1a6bb5a3385ced670d32286606c12cea84d9825013aa
MD5 da3b2ce92d06ee331eb29627b5d6c709
BLAKE2b-256 8201d09dee8f72bd1441316708401d67679a86667b119ad1909424c8519c6fd4

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.10.8-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.10.8-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 443a83ff8df4bb06314f644ec3aa50b1af49dac90900537df32678ed8144e0f8
MD5 70195d442d76272a77d1f5a825eaf744
BLAKE2b-256 0cee87d9ba5c6f1f12225ccca1531c40e8ab7728c22ef5c50459758373c453d1

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.10.8-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page