Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.11.13-cp312-cp312-win_amd64.whl (2.3 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.11.13-cp312-cp312-manylinux_2_31_x86_64.whl (3.5 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.13-cp312-cp312-macosx_13_0_arm64.whl (2.7 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.11.13-cp311-cp311-win_amd64.whl (2.5 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.11.13-cp311-cp311-manylinux_2_31_x86_64.whl (3.2 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.11.13-cp311-cp311-macosx_13_0_arm64.whl (2.7 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.11.13-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.13-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 0095bc9c95c5d83a1ba9a21864a11e35b9904dcd9d7cdb8c29eadaf85a4ae87e
MD5 147910fe868698eb250b91a1c744e991
BLAKE2b-256 60bec96f5e8e14dbcca9247992b4fd2814f04e8059893f5fad0455b451794e0c

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.13-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.13-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.13-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 1beb0c4dd0536e7fdb6e735a8ff12d771af00a2c04e2ced6dd01edb804115dbf
MD5 b68988467146a53dddeb03a53c25139d
BLAKE2b-256 c8bb567ee108e2fcca5cdbf40dd5fb4d2487c732cdd9b02e8caa12a83784602a

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.13-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.13-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 202915031e8b021d4025e141ce70d7879feea70013dc0fc7c7b30bbe67cef54e
MD5 f8cff0559fd20efc004172d6908a3ba7
BLAKE2b-256 be0cecddc596a7e152ec6bf5d99acaafdf39167b031551d7b772942fc1f68330

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.13-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.13-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.13-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 be36e139594f860e2563d4c30328b0944d3ab1e4c1de77a70ccf677bb55717fa
MD5 ee80df4b141863f243cd265601880819
BLAKE2b-256 adc2867bf2b23bfd29ca88dd2827bc507d5a12fd2e1ce392a49c0f495f1395e9

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.13-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.11.13-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.13-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 dab139cf1db5466ceafee75bcfa5bbc02fc49e2e07f3af53410d43a9a84d6ed8
MD5 5934a03d89ca4cfdae427e8a01577c21
BLAKE2b-256 61a5b6596562e9b4cc50bb2e9b857870dbfcc5ea4ac0dd62234b112389f57ac9

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.11.13-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.11.13-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 5ca0adcf3937e3819c5851cc8519459fa7b5d5f2f0a613b58b2c895322b0d9d1
MD5 3b09d3fb81ecc2e591f7e7dac1f959c7
BLAKE2b-256 2b5e134aa99ae8cb9d2a1907b15a7dbf289021b7ef8613346c3a9b8bd26eaa9e

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.11.13-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page