Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.8.0-cp312-cp312-win_amd64.whl (1.7 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.8.0-cp312-cp312-manylinux_2_31_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.8.0-cp312-cp312-macosx_13_0_arm64.whl (1.9 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.8.0-cp311-cp311-win_amd64.whl (1.8 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.8.0-cp311-cp311-manylinux_2_31_x86_64.whl (2.3 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.8.0-cp311-cp311-macosx_13_0_arm64.whl (1.9 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.8.0-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.0-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 b2e89fb05e03f278df63a396d739df1f9c7f7bfdf693bc1e94e491db86f6b18b
MD5 6c195ade266690fe1594c58082212096
BLAKE2b-256 019ac09e4871a1b7b86ceba7f612b7dde154c168f2ebfeeddb6be0b22914c0b1

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.0-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.8.0-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.0-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 4a8d5a7d31f5aee41f52d244aa486c1ec2f00ace5bd52ddfef7a11e7b58bf982
MD5 a806ba642f10268f5dd53f8eedb3a8b9
BLAKE2b-256 e9493426ce597a97f22ebf8b67169fd9e091c2cfea916c7fe1fd28c594bf63de

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.8.0-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.0-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 ff5fae36220aefcdfb721be10d08ecfc4738a762cb66f6cfbd65a710d61507f3
MD5 81ac10011d4946c23f6eb93335702c09
BLAKE2b-256 004789f9537b10ced4238d4df7fb594a0ea895803a071c2803ca6782c7b3ab7c

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.0-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.8.0-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.0-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 cae949c0c3385e9858c8fd64d7774213d37de2b5a27df1e1fcffda34d8435668
MD5 a204a00819d39939c311a1411fde6cf5
BLAKE2b-256 8b6b1562d34e9b4ff463c600aba2a7f3a968761a246bd01f84c3e8218ed98348

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.0-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.8.0-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.0-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 1e1781b989d0cfdb73277462c1f710010c8fa86970ee437d0265d4f8673b4f16
MD5 f38e7def95f7532e0f7e003136712d9e
BLAKE2b-256 1b3ed7e967cfc3d6628fadeb294e4a8f013ca2fa48de1d04ad0e7d5b7160a4b3

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.8.0-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.0-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 219541fc6a459e12fc857dba4e353182bc23c2cc9bdbc43ea3771a2beeb657f7
MD5 819b886325f13bf359c985bc20385e54
BLAKE2b-256 d9b52d9cfbac766b00af3b9b87c3cf5f619aa3aa89130fd3e18ebc5b41dad4be

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.0-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page