Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.11.49-cp312-cp312-win_amd64.whl (2.6 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.11.49-cp312-cp312-manylinux_2_31_x86_64.whl (3.9 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.49-cp312-cp312-macosx_13_0_arm64.whl (3.1 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.11.49-cp311-cp311-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.11.49-cp311-cp311-manylinux_2_31_x86_64.whl (3.6 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.49-cp311-cp311-macosx_13_0_arm64.whl (3.0 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.11.49-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.49-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 ca5aad9f48a03f7970d3eb8dcca3b019cbb8460398c357f0ce11bb64947f1406
MD5 3640a70e116eb223ffc49b7860700036
BLAKE2b-256 4d298b353315725219f541f44c2c60fdfe908096b9d7b77a78798f5bd069d3ce

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.49-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.49-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.49-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 ca830bf7abf4dcffbe0114f888755c0a36aacd4445aad4c2aa4a2b66ffdc8b0e
MD5 3784b8be70f1792b9ef04ec93093bdd5
BLAKE2b-256 68b83ce9365f04bbdb070b610ccc0925bb25c735dc35e3114bdfd668b8ebc4fc

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.49-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.49-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 0b4066ce015cfbeca9bdd794eca8b3733eb1c4e1e24a236f53fe37aed3360307
MD5 627cea435c21965f1f0847a038afc7c6
BLAKE2b-256 fb9fe49712e9f346513317ba7507a343fc6a7707da5cf318aad01a5df8730a67

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.49-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.49-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.49-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 9526f0360467935c64c5998f1adc4ce502c1825147b717a2744d2a3e42ed6331
MD5 7ef3f86dd966f2d91bf48a61a69f55d1
BLAKE2b-256 0bb3c09136fc5f2eaafa8fcd4907ae498be69efd21169479ace45bfc213ba415

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.49-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.49-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.49-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 4d7f8f1a9459579ff5d4144797d32f24fa635ea777fc2d318ec8356fbee53b81
MD5 3b2833e1a95740b22fdd73599c64ef75
BLAKE2b-256 b224922605bbb3a976a35e09af17757a488b5e096899a23b5544d344b5455055

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.49-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.49-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 1f6e59ee702d62d5f4894bd9f7e0146d9ddd1fb8c1256f791f73bd1a19247798
MD5 aa6392b483fbcfd18b9089d80d4d25d4
BLAKE2b-256 1efe15c334a6ab7cba0b40d6eb9e232956cb11b5ef450f766704b6c7c48a824b

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.49-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page