Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.12.7-cp312-cp312-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.12.7-cp312-cp312-manylinux_2_31_x86_64.whl (4.1 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.12.7-cp312-cp312-macosx_13_0_arm64.whl (3.2 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.12.7-cp311-cp311-win_amd64.whl (2.8 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.12.7-cp311-cp311-manylinux_2_31_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.12.7-cp311-cp311-macosx_13_0_arm64.whl (3.1 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.12.7-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.12.7-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 b0fb8a51a53b51c66f6ca790b535f67566768f8f97b3f8f3772d68740bf67de0
MD5 56fdaa72d624d0f549bd425a08384ff6
BLAKE2b-256 469ebf41476e9534af3ac30165160db20d63382ad6b31e01cf979ce914d6aa5f

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.12.7-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.12.7-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.12.7-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 110e14305bc03ef1cfa60656c202520161602f0a52ff31741d7a1341b9a13491
MD5 a43b2dd68fe6530699394b3620e5ad2d
BLAKE2b-256 87b1c69e3c193c0fef125450998507a3ba2ea13a30b730d52e05801ee1d67f92

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.12.7-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.12.7-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 ee29c8bb96602daba85e5d944575c83b27be21996cebe7f0514a0ff4090b40b3
MD5 294a7437b7e90f1fa9109025a9a3d86e
BLAKE2b-256 36ec369d6cd50eeb2b8ca7864398627133f92088f9971beedad052bf9c3c0a1f

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.12.7-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.12.7-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.12.7-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 f75b1e85a93fcd0ea53c06b99a50bcb581886eb00b5cb3660e8f8bb34973138e
MD5 3eb6aff9440c74199ad05b0d8d765f80
BLAKE2b-256 0127b8d6888e2a8ff917c0858e2f7f62e542f2cc803174bf8d4180cfa1eea3a1

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.12.7-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.12.7-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.12.7-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 3f5cadf0a3fe6d09668dc5f5522b149bb27e6b87000c97dc3b20815014b45d75
MD5 acc1368d70b76b15569dba7e0e3346e1
BLAKE2b-256 b0c48c6b4cd02c24eafab958feb4763460ad2b79d15329671a5fb676ca6bdf78

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.12.7-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.12.7-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 3ee5a599d9dec960369576f0c68a916798d8ccc269c322d585533417b1812cab
MD5 613692c809cd1baf0cae266322c9e9e9
BLAKE2b-256 1e66b105ba9c6f2ef2f21d0176aa9aab185520abd4a33b5b7e275883621ee37f

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.12.7-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page