Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.8.13-cp312-cp312-win_amd64.whl (1.9 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.8.13-cp312-cp312-manylinux_2_31_x86_64.whl (2.9 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.8.13-cp312-cp312-macosx_13_0_arm64.whl (2.2 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.8.13-cp311-cp311-win_amd64.whl (2.0 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.8.13-cp311-cp311-manylinux_2_31_x86_64.whl (2.6 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.8.13-cp311-cp311-macosx_13_0_arm64.whl (2.1 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.8.13-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.13-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 038b0cae37afe595dd4acfdd0fedfb307c3fbf9c23ed136f5cc7d8e3add7b38e
MD5 9b185e23eabb1f136c31bacf2a5a7491
BLAKE2b-256 2c3a106656978c743a62d89108c15892379c6c3cc9436aefc983fba82fd325ed

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.13-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.8.13-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.13-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 3d850f5bd104ff79db901c9cd0cb9ade02e368b4104ee6dcf7230edb18398882
MD5 8d978d1314d8df0688c5498a445f1735
BLAKE2b-256 a4aa3ed8b3a0a173ab2078c0b31da32b491ce3e0e8bc8c3bb775227636452a5b

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.8.13-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.13-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 e1cd1e88a62083dbc3c107250b1089ac5a0aa0f78a9599e4189fe6feeab67304
MD5 2e796a7162a762b689c68ceed409578d
BLAKE2b-256 7b729864a3a043ff94f08e4269c460ae25e4db13f6e1c7ba4347288ca425d754

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.13-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.8.13-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.13-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 3ecd82f6f29b58e156256580a2cdbbb4ce3fa6928a8e22692fdb2a8df47ee382
MD5 cf6531d72d271911711475711e2fc7a5
BLAKE2b-256 60b0811837779fd24b7ce6866cedd5bd981dda78ba95073e1fcc63cd7f793bf4

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.13-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.8.13-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.13-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 925485b6238d0d5478b550cd3e072ff5968245eaa91adcaf77ae755a8e1dd981
MD5 5252f29bf72861a4c519e7a6f3f9374a
BLAKE2b-256 4bd4f437c6151541a8ab5048f04d54088f11f24132776007bd12967117d659d4

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.8.13-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.13-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 eac75b2355995a4f975a6aa3aa476dbdf006cff6a7035be369bb13c3e0ff4b4c
MD5 94ac5569444725aa3394a563423681eb
BLAKE2b-256 561458468492976f1c3546a587662605acf3cbd7c846d0e41e6ce5c2e1c27289

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.13-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page