Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.11.5-cp312-cp312-win_amd64.whl (2.2 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.11.5-cp312-cp312-macosx_13_0_arm64.whl (2.6 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.11.5-cp311-cp311-win_amd64.whl (2.3 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.11.5-cp311-cp311-manylinux_2_31_x86_64.whl (3.0 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.5-cp311-cp311-macosx_13_0_arm64.whl (2.5 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.11.5-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.5-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 63a8a10be7ee8954af166b2d6f3b7fa377a5286aa1d5a1fc634406d190d45975
MD5 fb272427cbc70f64a4bac2b123efef98
BLAKE2b-256 35419238806bd89239acc8555ea3f34dd6eb81aabd18310db5f46a762b38ec94

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.5-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.5-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.5-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 7abeaa9c8c23648c5806be6df37169c4ddac5e0db2e9ec058972788e068d2bb2
MD5 53f0b3e980d085ead2f0d2b03ff2c10f
BLAKE2b-256 7915b8e5492f9b45cdc3a5db15527808bd5aee94b7f1682929d2ff602ce45d93

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.5-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.5-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.5-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 1d1f2d5eb5ba67b66c1b4b77d8709a822e313ab968542f8086ab11c1a457b4d1
MD5 a5c77658b603449a9d918b5341daa91c
BLAKE2b-256 b537fae9900db53f1d985f64beb0800369485b455d2125e9f8fdf85874768816

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.5-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.5-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.5-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 c3f7613796c937705f4d1994c83c409aaae55f45503dbd8e7582a019a83187e8
MD5 3055114223e9330f0169873d7dd03810
BLAKE2b-256 d94b4fc3629bad9da9aadc1a9e86138e0702c4830f914a9da53d7343ed544244

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.5-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.5-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 8272e6a23061c4264f325ed67354cf16be75f838357c961843b7b6938565eeab
MD5 168c2c001cdecdcfde24c4e4ee1ea619
BLAKE2b-256 d9b83e0a527adbc3401ce6dc7292da7aea9f8ce8459a84dad7e7913ab02019cb

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.5-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page