Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.11.38-cp312-cp312-win_amd64.whl (2.5 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.11.38-cp312-cp312-manylinux_2_31_x86_64.whl (3.8 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.38-cp312-cp312-macosx_13_0_arm64.whl (2.9 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.11.38-cp311-cp311-win_amd64.whl (2.6 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.11.38-cp311-cp311-manylinux_2_31_x86_64.whl (3.5 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.38-cp311-cp311-macosx_13_0_arm64.whl (2.9 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.11.38-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.38-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 903375c35976c3b517155e595afaf350f3fdabce7d0046666d3a021e36974b38
MD5 44f85a60d84671425dbce69644678c14
BLAKE2b-256 4de934d5bf4f8cf99f5b41fd91b418c3101983dc85f7e241d55441e9db704464

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.38-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.38-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.38-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 7481500637ddd27630483ed86e4d0d92a19de442abe97500292ab85309cc84ce
MD5 029bd9e79a0ec1795906ca3b47f8c48c
BLAKE2b-256 a884fd5b1c5933c56597fcb8bdbea4ca58d91262df1dd0d14323be4b43fc9f6c

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.38-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.38-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 aea35d2e24af62e0b391decb02ff6eec2191645bf7edf09d2fb324b7d9fdb426
MD5 85785b4e90dfefc2bf4783d4bab3c30a
BLAKE2b-256 721d57e7e3e0cece55670e99cd62a7b8c60201500b737934080afa9346e587b8

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.38-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.38-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.38-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 8cf306ae59665bb109f63e70dab7f74bc56e5fddbd7c37ff7b35478355400eac
MD5 e0d44aa7d3d4a1c61d574872e287b6e8
BLAKE2b-256 b3c086398abd36be848287696b67130c7b065aba174a0d5953d850c9ced63a21

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.38-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.38-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.38-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 bb84f423b182582d68be129356126fa4e5b4bc405a336a16f7210c57c188583f
MD5 9776099e3779213387ffdb58e2d75d9f
BLAKE2b-256 01aacdd469655cf6fc1a0f98e22d9f8564a32e24c2127822cfe503e191615eed

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.38-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.38-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 f5303f681e17e814a3c2587c745aebdfef3a2813cea2afc186988d40b6af0681
MD5 cfa3fd75a8975ead8e91e085b0942cbd
BLAKE2b-256 bf39f5b94bfad9107eb6b21a8c0466b1682b3c39607fd0bc8d98a564ae9d76ca

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.38-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page