Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.7.26-cp312-cp312-win_amd64.whl (1.7 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.7.26-cp312-cp312-manylinux_2_31_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.7.26-cp312-cp312-macosx_13_0_arm64.whl (1.9 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.7.26-cp311-cp311-win_amd64.whl (1.8 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.7.26-cp311-cp311-manylinux_2_31_x86_64.whl (2.3 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.7.26-cp311-cp311-macosx_13_0_arm64.whl (1.9 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.7.26-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.26-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 1214542e98a51e99ac2cc9b1f215d01f1d579fa665cc3892cda645a203cb9ac1
MD5 92e746e1a0a4f23513dcfb4bc60f9a05
BLAKE2b-256 968769d4a795deb71861f30b7b532159ce65c24a3329ae779b377b8718c2ef28

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.7.26-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.7.26-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.26-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 f10d6314cc1c748657796243a0aeef45589cda240d85f3efbc94b36891eab1d2
MD5 f409aea0a53b9c99a2e759be0724e3ba
BLAKE2b-256 d9224ce3199d73bb034ad3a0971cce0b817e1da327cd45c72d5735d81f32ae94

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.7.26-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.26-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 c4f391727110887be6d4ebef88827bfd47577acc06c38071307decc3def009e3
MD5 1c2e2a1655f4163c79c52a256e31102b
BLAKE2b-256 d4b1f820f7b6f311a20fcc64de7f23dd7fb7f2d3577c61c34b8d7c24f12b2b6e

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.7.26-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.7.26-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.26-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 287d2736e5dfb66722347aa22b371e4eca375c41504ec7a56c42a7eb93fec4ca
MD5 9bc33e0856ca034c4cc5ce5b928860c3
BLAKE2b-256 16a68eb65e37ca549b1cf9ec746713a96590795d64a61f0d50fd1935bbe71f61

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.7.26-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.7.26-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.26-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 d900a3cbd63a73435a67d57d962c041d91ec1ae77cd8f34d5689f1c5cd1f7d48
MD5 d317a702ba2a354b8f7c9b9fe7d52cf3
BLAKE2b-256 e6e7f56901b4f6bd07e420f748ab5a30f46c5c516559d521ce0e562a873dbfc9

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.7.26-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.26-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 819e1794a0f5594807fbc621d3d54c4ef4abebc1bee7c2f48940eac6d7bc534b
MD5 329dc1772cef2a8afb87c09910ffb9c3
BLAKE2b-256 86d64662907d6a9e8bacc662a6e8164c6b98869b9b7743a2a8b69d4ae0b55655

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.7.26-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page