Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.11.1-cp312-cp312-win_amd64.whl (2.0 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.11.1-cp312-cp312-manylinux_2_31_x86_64.whl (3.1 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.1-cp312-cp312-macosx_13_0_arm64.whl (2.4 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.11.1-cp311-cp311-win_amd64.whl (2.1 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.11.1-cp311-cp311-manylinux_2_31_x86_64.whl (2.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.1-cp311-cp311-macosx_13_0_arm64.whl (2.3 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.11.1-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.1-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 f288a64aa837eeb6a03daa5d3b9da346932ae83d8cf354741de3a84bdc78d534
MD5 4b14d4abce6390a3f336658940b9a2ec
BLAKE2b-256 e3a76b8c86bf0239eb6bf9569f03545f6e04d0ad9b0a9cc5c2de7656815325ff

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.1-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.1-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.1-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 a03ce3058a3b487a0d5fcb9eb4289f360a6f7157172eee7ca71a45301480bd48
MD5 097d4943785299474d91fe092fadec0b
BLAKE2b-256 d33085d94f0a4803d336742a64b74bf87341eacfba6fb264e6d3cb527c7278fd

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.1-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.1-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 f2990c9328c1d8384ec28a7cbd62f585ae21b6fde0b50900b925c238137893e3
MD5 304e98f2efa39d7429fae0d348a2e7e4
BLAKE2b-256 711d90c386591b397c9e0aaabfc65799cc106a954ab53185e065cfa7f0b24683

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.1-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.1-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.1-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 3e098eb717d5ee30ad67114f5287339c9505ebcf2d4083de4fb5d746636c8e41
MD5 47574abcd39d46a0e0a1a9723c292a3e
BLAKE2b-256 5c779ded78f86953f740d14b660f0952df399b8811c8a691dd8b7f4b60ad90a2

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.1-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.1-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.1-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 99851ca48fa069d940dbb4b0e8566e8f740928df6b88220206d12fcb0df9447d
MD5 64df682fa770d49f7479298867d496fb
BLAKE2b-256 f84b279ebc60b574336499df70fc7765d115bd497fddab5f9d29bdf6b4539a20

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.1-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.1-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 b41a57b9bd95c18adcf99f87b68344be440373114ebc97d9a63527dce989cf31
MD5 3d1a32582d6a613d709e70aaddbe03de
BLAKE2b-256 172bf5c9bccdbe6bf7a604fe1e3233077a1b517ff8f83bdc4dd3664bbc533f92

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.1-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page