Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.11.40-cp312-cp312-win_amd64.whl (2.5 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.11.40-cp312-cp312-manylinux_2_31_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.40-cp312-cp312-macosx_13_0_arm64.whl (3.0 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.11.40-cp311-cp311-win_amd64.whl (2.6 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.11.40-cp311-cp311-manylinux_2_31_x86_64.whl (3.5 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.40-cp311-cp311-macosx_13_0_arm64.whl (2.9 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.11.40-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.40-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 db3939f67b5be1a696a6764acbccc500b0aac4b779bd44bf24293f73d57809e6
MD5 ee2e3de3924efc8b2c1db9f3625bdbd4
BLAKE2b-256 1b086d3f9e77b524aec3f358cbe5ef18ac865d655090e8cdc647188b67f65ef1

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.40-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.40-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.40-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 a0811ed356461186cb9d179cbbff30358e44191e29e046a7fd04ddf654a79b31
MD5 48402de675d2381fb061ea2f38c2c005
BLAKE2b-256 b61aa7231f39bceacc62d38271bd1f584619f866c0c021e83b84c01d878d94df

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.40-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.40-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 a3accde206644ddeb205ca42eed55327ec68f853509f170b7f75c5c3c403ea93
MD5 4b13bd18f99e4f881414fb28247bc7a5
BLAKE2b-256 817c6ff551c8b795d5e65b645e741a222a3ad27ffc6684a80276cf9d5edff3ea

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.40-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.40-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.40-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 09af2941dbfaef0147d35f1a87820b61486062ab67b63e13533fb43c4f696ccd
MD5 dca6bc859820a3a5e5926a5c7bdf41be
BLAKE2b-256 efbdcf6192ca4dff12992c8d9e83d621d9fa3351fd797e6927a29aff3cc01952

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.40-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.40-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.40-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 829ff8f7fc26a80cd0f998231bd13dc8bef923801d16819db7eb142d35f38370
MD5 c206d8f406cefd97f7ee0aee77b27c4b
BLAKE2b-256 6e223cd636d1d0d014d68695bc96bd414382316a87f3614b27f91763cc92a5a2

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.40-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.40-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 76e1248aad1e133ad904a52b2e29891be5b6beebf0783569eac62dd5fda9b8ad
MD5 8d1f6eab9dbb85c90b082b5c75dc81e2
BLAKE2b-256 6a7d801e9a6e1d934775db4e9d056f6297069c92d8b5ce880ca8def2b625dc4d

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.40-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page