Skip to main content

Pugio

단검. 가장 작고 늘 휴대하는 일상 도구.

수집·전송(ETL) 엔진. REST API·로컬 파일(csv/jsonl/excel)·운영 DB에서 데이터를 읽어 Parquet/DuckDB/Postgres로 적재한다. 재개·멱등·인증 자동 갱신이 기본값 — 중단 후 재실행하면 마지막 완료 지점부터 이어지고, 같은 unit을 다시 적재해도 중복이 생기지 않는다.

설치

pip install pugio
# postgres sink를 쓴다면:
pip install "pugio[postgres]"
# excel 파일을 수집한다면:
pip install "pugio[excel]"

사용 예

# collect.yaml
name: github-issues
source:
  type: rest
  url: https://api.github.com/repos/duckdb/duckdb/issues
  headers: { Authorization: "Bearer ${GITHUB_TOKEN}" }
  pagination: { mode: offset, param: page, size_param: per_page, size: 100 }
sink:
  type: parquet
  path: ./data/issues
pugio run collect.yaml      # 수집. kill -9 후 재실행해도 이어서 진행
pugio status collect.yaml   # unit 상태 요약
pugio dlq list collect.yaml # 검증 위반으로 격리된 unit 조회

문서

Metadata

Release files for pugio 0.2.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pugio 0.2.1
File Size Uploaded Provenance
pugio-0.2.1.tar.gz 67.1 kB With provenance Details

Release files / pugio-0.2.1.tar.gz

Download URL pugio-0.2.1.tar.gz
Size 67.1 kB
Tags Source
SHA-256 checksum
How to use checksums
ab58b71d78af1069e79a8d6b817590850c9abb2788fd28e4595a219c470f327b
BLAKE2b-256 checksum
How to use checksums
10a9351979cfc8ddc3876debcf49b5988e4def97b8ad39930508b0a03fba458f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 13, 2026.

Transparency log

Security for pugio 0.2.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 1 file in this release has been uploaded with provenance metadata.

Attestation for pugio-0.2.1.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 13, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page