Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.11.7-cp312-cp312-win_amd64.whl (2.2 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.11.7-cp312-cp312-manylinux_2_31_x86_64.whl (3.4 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.7-cp312-cp312-macosx_13_0_arm64.whl (2.6 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.11.7-cp311-cp311-win_amd64.whl (2.3 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.11.7-cp311-cp311-manylinux_2_31_x86_64.whl (3.1 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.7-cp311-cp311-macosx_13_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.11.7-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.7-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 d158bed41f4f2969efc8991a90c297be52e0cd3b0cc695c502f59bdb71822ce2
MD5 41b188f653515e777bb8c36aa04dfee6
BLAKE2b-256 a7df0223b08091fb96d03880c72e12460fe6f58d39b01cef207ae3a9cff8450a

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.7-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.7-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.7-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 f1a02008d750b0a1d31db7c509ec5386c5506b74632f26d53e2382e9c1d6c8d4
MD5 258b7b85a844da209ead6570a0b9661a
BLAKE2b-256 61dc33da60469bc55095fab4b57d541cc2413dfe443c82bc2270927fb1969a02

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.7-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.7-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 55fc981b5fe6e6836142a1b677be474180e8e26a3565918530def72a758c1449
MD5 871d814855367efcd6e8c63fcbbfea36
BLAKE2b-256 e17ce93dcdc332ca709d8e920df9474425d155dd252a2cb62e626ffbe4a9e647

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.7-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.7-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.7-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 246b43e07df14b4ef1528877274e512ca297e3e122d0182638ad2006e69f7727
MD5 ad70ea2b68e9b5c85ce75ed6b7beca5c
BLAKE2b-256 53c5c6e810bbd653b5c29c970791b841e487478b8dfde5672afeeecf9e194579

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.7-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.7-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.7-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 2d46922376b7e75b4ec9506cf2afd6dead84616360668c9261df21a444ce2ed8
MD5 6a486d0bb2404b26929abf71782fc671
BLAKE2b-256 b0a6dba2ac5e1e5dfd40e619d5454254755a364b3757bd99a9f1412aa1d67c82

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.7-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.7-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 7ccd92ead0a8fa45006df341f33e22cb7d5d13097b5cd60bcc898fd577d43cc5
MD5 5499526b1c35159d69de078cc323bf1a
BLAKE2b-256 027776e11fc4ee6c30a4e389db79d37b18440e8d806af12fb2eff5020a93b882

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.7-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page