Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.11.12-cp312-cp312-win_amd64.whl (2.3 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.11.12-cp312-cp312-manylinux_2_31_x86_64.whl (3.5 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.12-cp312-cp312-macosx_13_0_arm64.whl (2.7 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.11.12-cp311-cp311-win_amd64.whl (2.5 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.11.12-cp311-cp311-manylinux_2_31_x86_64.whl (3.2 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.12-cp311-cp311-macosx_13_0_arm64.whl (2.7 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.11.12-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.12-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 94b65402ef68d6e6ca78a7fa3fdea08b213fa79085f299b085cde256fada6cf2
MD5 a3408c158b49f3886ac567c066b54963
BLAKE2b-256 d3e080f0196d13ec5264ea3fade8d5124fc65866186093af376ac5732f404611

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.12-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.12-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.12-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 e610b5498b3b42dfe2d6f583f4c95ca3943da0735ffcd6ea3e8c7da8c218d236
MD5 9775b27db7b2d26a672952a25f373ed0
BLAKE2b-256 2947d737ed78bd5308fb74631bb4c8ee779a2049780459f38f184184e287f8ce

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.12-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.12-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 9b125a44e6fc6cd92f4e9e1f462567be28dca713f6f245830a7987187ba323fe
MD5 a6e6d801d3a572843bc60d70b2a80fb9
BLAKE2b-256 3e071fed04cc81d0b51e766adfd17b11123689d081c3580c54a33795144936b1

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.12-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.12-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.12-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 2700d4ef11e8160b767b64bc8a9e1165c496ab2993ccabaea05eadce0f7e3f04
MD5 ef827960a20cb566b3e2b82e529b4e16
BLAKE2b-256 814a061bb4914c5885d06ccf478c73121a3d66c0dae4aba417a7af7c29479417

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.12-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.12-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.12-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 a3be4bf67aa8a08bae687151d97a6e82999a502124c15670ee7ae6e782f823c4
MD5 e0b2296ff7338d854e2164929fd44a1c
BLAKE2b-256 24f463436e7c6c8790b19e52ac43643ebaed174c0e72b6670367ae473e693205

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.12-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.12-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 1d878b4a6a4d74d3ad8d9f01af85b0d6471df04d523cef916a31479566e70770
MD5 fe4fe5ff3a8d3b941ffb2e68b4ae53c2
BLAKE2b-256 3e55caba8235bae654268f1734a517d865ef6651b84c1871624e9a2d34d33ab9

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.12-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page