Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.8.16-cp312-cp312-win_amd64.whl (2.0 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.8.16-cp312-cp312-manylinux_2_31_x86_64.whl (2.9 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.8.16-cp312-cp312-macosx_13_0_arm64.whl (2.2 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.8.16-cp311-cp311-win_amd64.whl (2.1 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.8.16-cp311-cp311-manylinux_2_31_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.8.16-cp311-cp311-macosx_13_0_arm64.whl (2.2 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.8.16-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.16-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 502edab1f21922efdc94c6a1cc86950d0209a51069fb400a8d87bbd8dacea6b5
MD5 5aa798bbfd5a14472f53f155aa34b02a
BLAKE2b-256 6fa16648ecde4cdf4f1950759dd299981d03a2d3def4a0d6c5ef4b5f882270cd

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.16-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.8.16-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.16-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 83e7b05cd5df570c324fa61bb30780c7419c1c9840095cff875ee88e42fa5e21
MD5 d07ae35dcf02395e0d5358bb604d3e50
BLAKE2b-256 01799f768a847c9eddb469dcb9a4c0fece3bd8b4216b6dd492006ad91d75b8b1

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.8.16-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.16-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 a098cdac98ecf26c4be25244efc035ee3c374d92caa083a1a0d2ebab5c776993
MD5 210086ace1179963e5b55c7092534f15
BLAKE2b-256 8e5ce5c3ef40d315b57ca9572781a22f688bf8e90fc1726872e2ce6c0b3c0f60

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.16-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.8.16-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.16-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 7deefb95b85af634ccd1c1451bca63ff6e96ad29ea09e0d97197a2220a329bd1
MD5 a41abcd7046db5902c586d4100ab60b2
BLAKE2b-256 574f0e64d8eae36c730f8b376564a5050a608c53a4920d63a78edca8ea3a4f52

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.16-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.8.16-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.16-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 60f5ea1b63c5737a1c59e06312b56342a9e9f56e8f63a5ffaf9c094cf6a5b40e
MD5 2d5da54dcf9984ce7615fa976e8abdfa
BLAKE2b-256 10449db4a97caee7ef3a2f9781167e377cfafe929c685689694f630ddfbab4db

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.8.16-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.16-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 b672f31d4c98bc5e46429312a543364d6b7a0e164ad7244477b3870cf9436889
MD5 3181a68ce61dc8b4eb011fc2d5dfc263
BLAKE2b-256 a798519861978d26bbdaa8fe4e21f45b7ead09bfad5f5c4e131fd8ba7905ebd0

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.16-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page