Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.8.9-cp312-cp312-win_amd64.whl (1.8 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.8.9-cp312-cp312-manylinux_2_31_x86_64.whl (2.7 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.8.9-cp312-cp312-macosx_13_0_arm64.whl (2.1 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.8.9-cp311-cp311-win_amd64.whl (1.9 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.8.9-cp311-cp311-manylinux_2_31_x86_64.whl (2.5 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.8.9-cp311-cp311-macosx_13_0_arm64.whl (2.0 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.8.9-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.9-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 67220ed8156b1c3ef34c18789d3ebad0f9cd17076d056740af6aa9147938db9c
MD5 1877c8e06a3520b6514bedfd80d0fb0c
BLAKE2b-256 bddc62696fb6c159b0fb3233e673eb7aa8c4a83b25e6acabd3effedbf0015a3b

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.9-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.8.9-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.9-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 f7235693c9a0c5054d34660f98767f45951013e51b1e12a2fcb10772a15f3ef0
MD5 61be60c8d34f2092e0cf058e9e3c197d
BLAKE2b-256 f0f4ce0767a193aa2cce26dc9f00c534ce7f02802541658b94b334b5f366deb4

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.8.9-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.9-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 4e82463b93d5f26792cba6967ebead3037903f233bc3a4aee800578265040265
MD5 4b23ecc6f8dedfa2fc513b91a5959e74
BLAKE2b-256 5d890448e8c5f474808d9f73bb516cb4a1004b5403718502fa4ee17360e58b32

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.9-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.8.9-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.9-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 3b5fb4430130fe379d4ca45f8152cdf5701a2dc42b5fa77843b9cfa1cc2d3b92
MD5 bdc9e528ba16cbe17d31295f61009876
BLAKE2b-256 a2e9f57d69756318ca9a774f98ab7fa6b15fee28443a4d34ee026b0fd68f0951

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.9-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.8.9-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.9-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 c886b65639ae36da7e76ae053836ba501ac0faa40525514fee7c7e1412931291
MD5 22391c1f5e596c99a49e59103a56fffa
BLAKE2b-256 f49d3f5b59732e84d8bfa29e718186172ecb6a18dd326fa69c1a1093ce4eb6f2

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.8.9-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.8.9-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 74c8c721433a51aaee66b4f6991d90dc9c58293418cfd9cb50106b2f9e5b1d1c
MD5 76639d8030151e7dd30afaf9964a956a
BLAKE2b-256 b1d481a196f46bfc83d341b598f17983927ae3528e6b67a2539d4816e7668c00

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.8.9-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page