Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.7.23-cp312-cp312-win_amd64.whl (1.7 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.7.23-cp312-cp312-manylinux_2_31_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.7.23-cp312-cp312-macosx_13_0_arm64.whl (1.9 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.7.23-cp311-cp311-win_amd64.whl (1.7 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.7.23-cp311-cp311-manylinux_2_31_x86_64.whl (2.3 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.7.23-cp311-cp311-macosx_13_0_arm64.whl (1.8 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.7.23-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.23-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 42961e2936d34701e87195b92976b1c3010c80789eeeb8180ce02518506a7de7
MD5 3802b275079c3a463ce84e70212371de
BLAKE2b-256 9843ba6353a27fc965013916a29b3e1412c876416556525ed1fa1e0d802b5386

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.7.23-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.7.23-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.23-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 8274a7b6c7cf736124a3ef887631171305512f3750c833b1e04ccbc36caaba5e
MD5 c4ae44cdd547b80ecab623980fa6fd02
BLAKE2b-256 8e3ccefbfbbaf0bc444023ac79a79ea59e50e39e932af3d100b7f16524d0bf04

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.7.23-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.23-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 7f84480254cdd513db6942b962392ce333e9d6748998c01a895fea9554a22c9a
MD5 3a81ab4994e626f5569931388841a97e
BLAKE2b-256 d464ce29a3e9bc8a5e9942f246c067c11ed92579b036d3d9e1015128469e5d5c

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.7.23-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.7.23-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.23-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 13c0663aa098b1593c17708e68a11194b81841da74440b4c83dc5e34fdc347c3
MD5 5ddc973cd53ff8966db2bb6483f0c759
BLAKE2b-256 7f7adc1994a62066e84e6b89c3e9cf2db57ac32fd80bbf7c9878c27a1fa5e22a

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.7.23-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.7.23-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.23-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 ba9ecca3af707111758893e91a93a393a1a7244e98eebeda90f93aa289a5fcfb
MD5 affda1b65045dcd28f55f8c54194d0e3
BLAKE2b-256 71c43a6874acea2e7b770ea3472fc3fbe3dac4ccdf1cdb4229c04a3ca2f96111

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.7.23-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.7.23-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 4c3759292021a4a8c484cf712e8584e66bcbbc7159dcdf5e707af0fb313f8173
MD5 a361d27a4bb4f8298326011c5de6f92a
BLAKE2b-256 df7b0b0fbd9fed1c74c70e1a76ce659c406bf0d96b55dab2c7bcf548df284f8e

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.7.23-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page