Skip to main content

Generate vectorstore for RAG systems using an automated indexing pipeline

Project description

LS ELECTRIC / AX / AX Lab – Indexing Pipeline

이 프로젝트는 RAG(Retrieval-Augmented Generation) 기반 시스템에서 사용할 벡터스토어(Vectorstore)를 생성하는 인덱싱 파이프라인입니다. PDF 문서를 입력으로 받아 이미지 변환, 텍스트 추출, 문서 청킹, 임베딩 처리까지 자동화된 일련의 프로세스를 제공합니다.

주요 기능

  • [PDF -> PNG] PDF 문서의 고해상도 이미지(PNG) 변환
  • OCR 및 Markdown 변환
  • 계층적 문서 청킹 및 메타데이터 태깅
  • 임베딩 및 Vector DB 저장

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lse_indexing_pipeline-0.1.0.tar.gz (4.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

lse_indexing_pipeline-0.1.0-py3-none-any.whl (5.8 kB view details)

Uploaded Python 3

File details

Details for the file lse_indexing_pipeline-0.1.0.tar.gz.

File metadata

  • Download URL: lse_indexing_pipeline-0.1.0.tar.gz
  • Upload date:
  • Size: 4.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.11

File hashes

Hashes for lse_indexing_pipeline-0.1.0.tar.gz
Algorithm Hash digest
SHA256 8dfe86cf33e07f76befc8a10dba7ef127f2f662976f1d386515ab522cc092ef1
MD5 8e0c8d1da0ec746a2a4bdf9e740f14e0
BLAKE2b-256 598cebd71b3e96de700c657b425a5677664bed9bef0bd97d54a40c8e5df34b72

See more details on using hashes here.

File details

Details for the file lse_indexing_pipeline-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for lse_indexing_pipeline-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 da06566a22aacbae91d74d9764978b9954db51e1a309343beb4aee411e42d424
MD5 68fdf4275bb1448e15cec9ffee07bb1a
BLAKE2b-256 0f5423d26ee32dcee9a235dd76c82ac217baac5ec977e6ac97fc57c214e8e6d2

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page