Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.11.3-cp312-cp312-win_amd64.whl (2.0 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.11.3-cp312-cp312-manylinux_2_31_x86_64.whl (3.1 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.3-cp312-cp312-macosx_13_0_arm64.whl (2.4 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.11.3-cp311-cp311-win_amd64.whl (2.2 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.11.3-cp311-cp311-manylinux_2_31_x86_64.whl (2.9 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.3-cp311-cp311-macosx_13_0_arm64.whl (2.3 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.11.3-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.3-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 59021e48823f02de307f6520eefe01ebb2a012134bc87ce7996b2db1070132fb
MD5 409332251944b6ec3d04f740a723a56c
BLAKE2b-256 aa2ac59761747f8f18e40e234f79a0f38d858eeba71092ec77e54faa0a38a0a9

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.3-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.3-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.3-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 9e8b7e1e1b0cd2d2240d57008d6f81728f4839caf1b80b2cecb1d90af5a9523e
MD5 e41142a599c7c2f47ff518cb42a8bea1
BLAKE2b-256 bf9882eec9654901a44065cff7aec6c4d81fa50baf22a1969b65a603ad5a3a0f

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.3-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.3-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 bae9dc43c6bd851f35ab4e90a1560e8592040697584031d80a298c63c051f245
MD5 e743b3bea080f2001878f2fa66d45f88
BLAKE2b-256 1794f4c598060a45525af67ce6267ac5829eeac88ebd89bba1cbbd3ca2101b00

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.3-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.3-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.3-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 8c7e29cbf3870b63738d71d8b4a9b23b9e0960523698c697b9db84d42dc84d55
MD5 f3998d5e9b1401e3833836836acab25f
BLAKE2b-256 bdb5c33b2aafa20342f66936025ac14f343f062bcc20c872b37046f3806db722

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.3-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.3-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.3-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 52fe1e05c40bf457349795a1ba3372255ac41a5133b48de9ce2404c10230117e
MD5 569ead6333bffb5df65e74451401ec9d
BLAKE2b-256 c32fcde418b6ab28c76826bbbaa303cd63a8b7fb89397d73e2556e915111d004

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.3-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.3-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 c809c06f59ee214096f3b3c99c598a5b0e862f7ff1ffc79b9fb410a86c117fe9
MD5 be4dba25aea85bdd968ca7f0e52b243d
BLAKE2b-256 0cb26118d37da2ab9405049619989ca513aac22f3250854283574fcc9994295b

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.3-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page