Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.12.2-cp312-cp312-win_amd64.whl (2.6 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.12.2-cp312-cp312-manylinux_2_31_x86_64.whl (4.0 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.12.2-cp312-cp312-macosx_13_0_arm64.whl (3.1 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.12.2-cp311-cp311-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.12.2-cp311-cp311-manylinux_2_31_x86_64.whl (3.7 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.12.2-cp311-cp311-macosx_13_0_arm64.whl (3.1 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.12.2-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.12.2-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 fb8b9268be7e2e2411f476603d1685adc0cf87b875dbda1cdb699d91ebea2896
MD5 9e8f6313daf59495e5128b23da70c4d1
BLAKE2b-256 764c46159f50b9f4230c96ded7ef561506f523aec3f46451e778e19e4dbc37d1

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.12.2-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.12.2-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.12.2-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 f75dd636647a153156c234751822507cd66050bf4bb7fd1268a1b80c74b830f3
MD5 9150cceffdfeb0761ce2133163fd8b0d
BLAKE2b-256 0ab894b908c3982ed0589d3818beb73efd1b64068df434147f8ff0a34b5d7a91

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.12.2-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.12.2-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 102ad7c70c09f45a936fc6db4c2a857022084b7918c781c5c11b5eff9c352cdc
MD5 85e8be1916476969659aabbbef97ca4d
BLAKE2b-256 baa989a8bc8ebc8918837c0a5bd873ee87b51e3b7e4bdd4dec3ff4cf7344f50a

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.12.2-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.12.2-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.12.2-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 8f784b16a3c92976835abd8a05845fdf0f9b21ae82811de6c32f1989cf7b9943
MD5 1edcd64cef10ec2e8c0c9e72302525f8
BLAKE2b-256 d662939297f40244bf3c6a9dbe3e3224f85c94bd1e2245727b4c8c0dd6fb79b4

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.12.2-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.12.2-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.12.2-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 345b0df1af30466d4f9dbe0ce6d579ef9c079459b1dfa4ad4909413ef0846985
MD5 3c87e1d43c0b33a68b40e9e3e3f16077
BLAKE2b-256 16e3a02496aa6352222ad1e5367563b1770ab3917550b86ff807bf25f2663d31

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.12.2-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.12.2-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 4d9d2dcaa70991a5f30b5829321adae37424bbba0fda17707a128fee9372c162
MD5 018ff1587b1ad6695a703503056f6a60
BLAKE2b-256 795814afb29305cd293a66803af227f33fa7337fc4b9c30d25601ba31c734806

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.12.2-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page