Skip to main content

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).

Project description

GLLM Docproc

Description

A library for orchestrating the processing of document. Typically in a Gen AI applications (but not limited to just Gen AI).


Installation

Prerequisites

Mandatory:

  1. Python 3.11+ — Install here
  2. pip — Install here
  3. uv — Install here
  4. gcloud CLI (for authentication) — Install here, then log in using:
    gcloud auth login
    

Install from Artifact Registry

This requires authentication via the gcloud CLI.

  1. Export token
export GCLOUD_ACCESS_TOKEN="$(gcloud auth print-access-token)"
  1. Configure the index in your pyproject.tom;
[[tool.uv.index]]
name = "gen-ai-internal"
url = "https://oauth2accesstoken:${GCLOUD_ACCESS_TOKEN}@glsdk.gdplabs.id/gen-ai-internal/simple/"
  1. Add the dependency
uv add gllm-docproc

Local Development Setup

Prerequisites

  1. Python 3.11+ — Install here

  2. pip — Install here

  3. uv — Install here

  4. gcloud CLI — Install here, then log in using:

    gcloud auth login
    
  5. Git — Install here

  6. Access to the GDP Labs SDK GitHub repository


1. Clone Repository

git clone git@github.com:GDP-ADMIN/gl-sdk.git
cd gl-sdk/libs/gllm-docproc

2. Setup Authentication

Set the following environment variables to authenticate with internal package indexes:

export UV_INDEX_GEN_AI_INTERNAL_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_INTERNAL_PASSWORD="$(gcloud auth print-access-token)"
export UV_INDEX_GEN_AI_USERNAME=oauth2accesstoken
export UV_INDEX_GEN_AI_PASSWORD="$(gcloud auth print-access-token)"

3. Quick Setup

Run:

make setup

4. Activate Virtual Environment

source .venv/bin/activate

Local Development Utilities

The following Makefile commands are available for quick operations:

Install uv

make install-uv

Install Pre-Commit

make install-pre-commit

Install Dependencies

make install

Update Dependencies

make update

Run Tests

make test

Contributing

Please refer to the Python Style Guide for information about code style, documentation standards, and SCA requirements.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

gllm_docproc_binary-0.9.0-cp312-cp312-win_amd64.whl (2.0 MB view details)

Uploaded CPython 3.12Windows x86-64

gllm_docproc_binary-0.9.0-cp312-cp312-manylinux_2_31_x86_64.whl (2.9 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.9.0-cp312-cp312-macosx_13_0_arm64.whl (2.2 MB view details)

Uploaded CPython 3.12macOS 13.0+ ARM64

gllm_docproc_binary-0.9.0-cp311-cp311-win_amd64.whl (2.1 MB view details)

Uploaded CPython 3.11Windows x86-64

gllm_docproc_binary-0.9.0-cp311-cp311-manylinux_2_31_x86_64.whl (2.6 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

gllm_docproc_binary-0.9.0-cp311-cp311-macosx_13_0_arm64.whl (2.2 MB view details)

Uploaded CPython 3.11macOS 13.0+ ARM64

File details

Details for the file gllm_docproc_binary-0.9.0-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.9.0-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 54b426532e499fef96d9c052922279e7b4813c62c730b2f2bfa84add2106e8d7
MD5 7b7c58fe3d0ee21f6ad19888ebb35e7e
BLAKE2b-256 a1d84f2c0886631c4321333ae969059deb46b24cb68c40d7d704b96efa5dc19f

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.9.0-cp312-cp312-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.9.0-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.9.0-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 1df12ba7317b5bbbc3d5988343734dfcdf1d0b5e5fc5ccfaae7095648de65034
MD5 84650ba893505b1cfb2fe4cae8a9507c
BLAKE2b-256 a250f0528ea834a367b5dbbb3bff40efab067ba65c2f24f3e0a98ade3e882931

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.9.0-cp312-cp312-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.9.0-cp312-cp312-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 77b3bbe0b9dc4f25de6c27c2bd4ac75e38845407f83bd61697127c143d19efc7
MD5 7fb01f1825f513abc0989b40007ff84f
BLAKE2b-256 21065846c1bf26f2b08e96fe0505bc2598a70b92ddb1057500bb69f38bfc7b2a

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.9.0-cp312-cp312-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.9.0-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.9.0-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 9b240ebc9be795c84ec9f0bf5b96c70c5f3abce0bbc19f6d812f0b0d102a45e9
MD5 401764043916d8b47c6802e5c01e2c2b
BLAKE2b-256 8db966a8ce0dc6b20ec37847ab2d34e1f04cdd82713483a1d4f438c46ee434ae

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.9.0-cp311-cp311-win_amd64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file gllm_docproc_binary-0.9.0-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.9.0-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 6b4c3e7e4454ff0cfbafa99f2b5cb358b079a703e6e98f77da35213630e59aa4
MD5 49c72aa2a666ebe1a655665ac6f49460
BLAKE2b-256 07b19d883771b15b3362dde5106950b503104a967546c05e22dd1fbf1b7982eb

See more details on using hashes here.

File details

Details for the file gllm_docproc_binary-0.9.0-cp311-cp311-macosx_13_0_arm64.whl.

File metadata

File hashes

Hashes for gllm_docproc_binary-0.9.0-cp311-cp311-macosx_13_0_arm64.whl
Algorithm Hash digest
SHA256 6473ff7df8ae6d3baf4b563ed2faac42ac9762267d33f6947a136a4e635e3bd0
MD5 d11e929f0ea968daee84d4cade1f7d35
BLAKE2b-256 a9250620c85631144c2945eb94c576c1b41e4bc9add895f9834b4f4b767f2edc

See more details on using hashes here.

Provenance

The following attestation bundles were made for gllm_docproc_binary-0.9.0-cp311-cp311-macosx_13_0_arm64.whl:

Publisher: build-binary.yml on GDP-ADMIN/gl-sdk

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page