Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.8.4-cp312-cp312-win_amd64.whl (1.8 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.8.4-cp312-cp312-manylinux_2_31_x86_64.whl (2.6 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.8.4-cp312-cp312-macosx_13_0_arm64.whl (2.0 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.8.4-cp311-cp311-win_amd64.whl (1.8 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.8.4-cp311-cp311-manylinux_2_31_x86_64.whl (2.4 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.8.4-cp311-cp311-macosx_13_0_arm64.whl (1.9 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.8.4-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.4-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 81b95086d7840498bd293ddcffcd2ef6a6914752277bca0e7a135e6e66e23c51
MD5 47d1ae763a43c29589c0cc04a7792c2c
BLAKE2b-256 56e4bff8e73833985f7c4cf675e2c13cc339d1d05c9bb4e75d057ca62b2ad781

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.4-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.8.4-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.4-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 74e4228371defa658d55edecdd6f1068d4c3f8fb209c1b89a54c1ddf1fdb7bf9
MD5 f0c388eeda60cbf89126b457160ae99e
BLAKE2b-256 5224b5c38d44f88efd6f3e11b42f7f9ce4654edbd73dcf3a7bf3531fca17f4b8

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.8.4-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.4-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 bbfd93c2b0f4e3200940139947f23cecc96f14c3a4b82eea7f6fc113f261be31
MD5 47907e0b9d6f39bb0b10479fa01c3d42
BLAKE2b-256 db308b0fec3e4456f78d8b74dd27c658354931b5fe3dcd113729db1a7a529bf1

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.4-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.8.4-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.4-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 1f0960c46361f879b0e218f0d11be1a2589283608a8f3b109f2c7a6961b41c4f
MD5 da18372fbd6fa3197f1a7232cafc284a
BLAKE2b-256 8c1fe663992966f948b7bd7810834c178b6ea8cd3e401f99ac46ae3e69a48ba1

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.4-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.8.4-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.4-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 4380c8135327f914d9ee2cfa1b4451c7aae250caf52b2ca111ebfd4799a96cbf
MD5 6776f1ec26a889b280623aa488431bf7
BLAKE2b-256 5a383501f4b7f2f8b4a6d8afe9cf50def87788de81005c8438035555836bea1c

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.8.4-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.4-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 4494228a3216abf83e208ca9780bd228f9ff73e9649eb32a66c46cfefc04bc4a
MD5 8abb7e971d297428d1bbce43cf43185a
BLAKE2b-256 7d43c9448f7f2a6b388e35a9198f37c788ac625b12a6cd4d39cbedb9ae8c6760

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.4-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page