Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.11.16-cp312-cp312-win_amd64.whl (2.4 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.11.16-cp312-cp312-manylinux_2_31_x86_64.whl (3.6 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.16-cp312-cp312-macosx_13_0_arm64.whl (2.8 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.11.16-cp311-cp311-win_amd64.whl (2.5 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.11.16-cp311-cp311-manylinux_2_31_x86_64.whl (3.3 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.16-cp311-cp311-macosx_13_0_arm64.whl (2.7 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.11.16-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.16-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 d44c32a692fe5c57e85e5272265ea42f9e97a8e53d1ca60786b945d597e626c8
MD5 6e08f41977edb0da5758c9f019c9c587
BLAKE2b-256 92f47b8fd84aa889c005b8aba67cdb1277ca1c45c64bf5983f63870369a171aa

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.16-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.16-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.16-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 234c41a468e95146be52ff8608934978782168649a21f2f41839eda50045460f
MD5 5d1cdc4928d8e8efbee3e6f496461421
BLAKE2b-256 28d36658ff6c369994a0ff950f09fc3195db0775109524309317838b71996026

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.16-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.16-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 91472def59d102011ad1f39de58ea7d2a8cad4c9816fbbd30ce2aec16f59a989
MD5 dcf7600b662a24109872450ae5a78fd1
BLAKE2b-256 3f19225ca1e3c769d6d82c103c1293d82054973f80019a42e2d5832eaff3928d

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.16-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.16-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.16-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 b4b3bf0dc3fd0f987e3f6f68efe94c838d49f3102a51a46336a11eb74771805a
MD5 dd446b56f0a73349b6a6fed64b823f9a
BLAKE2b-256 001ae00077fc3604c8d947e5da60c5b1316dff22e105c57dd652ce05deea3902

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.16-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.16-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.16-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 3e50c76d60ab490caaeef06aa38baf613c3e3d894cde98c9e7d5d71e9085f033
MD5 8afe77c27ffce31416fad435050cf083
BLAKE2b-256 3fb187a176d1e00630ae32855a7e6d0ee9f064d3d1b4e0c1492fdb7a19a61617

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.16-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.16-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 4d59db130152bddacbf632c0c4a1c1ec98cc2509ef8e903ab0c7f87a7527fea9
MD5 3ac3a35a55906d9cf3af65023e04aaef
BLAKE2b-256 c6493786446f5270af32376933a2354bb57b659a487438ce8f9d60c0fd7c9fe7

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.16-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page