Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.7.21-cp312-cp312-win_amd64.whl (1.6 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.7.21-cp312-cp312-manylinux_2_31_x86_64.whl (2.4 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.7.21-cp312-cp312-macosx_13_0_arm64.whl (1.8 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.7.21-cp311-cp311-win_amd64.whl (1.7 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.7.21-cp311-cp311-manylinux_2_31_x86_64.whl (2.2 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.7.21-cp311-cp311-macosx_13_0_arm64.whl (1.8 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.7.21-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.21-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 09010b86efb766d0b7dbf076cc689a038bb93ee5b05b4fc7079f2d8ff886c833
MD5 eea9c46aedd068ebd1060d9c0af19c8c
BLAKE2b-256 fb8a4ea88d977fbf231483b7b0939b2de16690bb1380a3d0454fc113f0e1810e

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.7.21-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.7.21-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.21-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 92b8f3da9351f1b2fb58e9c422b7eef17b1c90f9e60c3e91356ec837c94465c1
MD5 36a0e1227731eb0ce573dac8d4e2fc97
BLAKE2b-256 71104bf2d721e55ba061e0a2027ba170183f0139830ea0bf64945cc41b4c1624

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.7.21-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.21-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 c57a061834cdee87c8591266824cc79d9fc17d40b8c800f446ae25efd90ae9c4
MD5 cdac194e4562346a56cd40e4b4023c94
BLAKE2b-256 3fb2732cbff479e23107a98de10bfbaed3d2df993c3903c235544f24de44e193

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.7.21-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.7.21-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.21-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 305067a1ab19a7626d958798070fd0646e4d008f7d957fb4fa535a7af3059811
MD5 cb49495938d5948ae22a9252bb9db4a6
BLAKE2b-256 312ba4bce81bb83ce2a4e64c6dbf6b85d18edd9dbff610947939ee5c4c533520

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.7.21-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.7.21-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.21-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 02cb6d816cf3b6623d218c746093ef76924521b056fdf006f5d175150b417bbb
MD5 2b9b22637acbf8862ff65a3ba3537432
BLAKE2b-256 db0c3ec426c630a39eb683f7a15a8b30cf4b42d2a1b572867dc82279f823e540

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.7.21-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.21-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 67cfb64d2dc1e67e8f149d3acccc02ed50eec9eeacfb83134260a73333fd6e78
MD5 11f99ed710713b5af649d600db5eba34
BLAKE2b-256 b45a0bb424d6ae3f904d05459d3c82b430afb4ae6bb83a89bec27927bdfa8bb8

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.7.21-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page