Skip to main content

poolin

A local UI package for pooling existing embedding vectors from an embedding zip into grouped higher-level vectors.

Important note

Standard sentence-transformer style pooling usually happens inside the embedding model when token embeddings are converted into one sentence embedding. This package does post-embedding vector pooling over already-created chunk embeddings.

What it does

  • launches with the poolin command
  • reads an embedding zip such as RAG_chunks_recursive_chunks_embeddings.zip
  • auto-groups related chunk embeddings by filename pattern like RAG_chunk_001_rcs_001.md -> RAG_chunk_001
  • pools vectors with one of these methods:
    • auto
    • mean
    • max
    • weighted_char_mean
    • weighted_word_mean
    • mean_sqrt_len
  • exports a zip with:
    • pooling_summary.json
    • pooling_manifest.csv
    • *_pooled_embeddings.jsonl (optional)
    • *_pooled_embeddings.csv (optional)
    • *_pooled_embeddings.npz (optional)

Install

pip install poolin

Run

poolin

Suggested input

Use a zip produced by your embedding step, containing an embeddings .npz or .jsonl payload plus the summary file.

Ownership note

The package metadata and copyright notice are set to Wenxi Wang. You should still verify PyPI package-name availability, trademark questions, and any legal or patent issues yourself before publishing.

Metadata

Release files for poolin 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for poolin 0.1.0
File Size Uploaded
poolin-0.1.0.tar.gz 8.5 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for poolin 0.1.0
File Interpreter ABI Platform
poolin-0.1.0-py3-none-any.whl Python 3 none any Details

Total release size: 17.3 kB

Release files / poolin-0.1.0.tar.gz

Download URL poolin-0.1.0.tar.gz
Size 8.5 kB
Tags Source
SHA-256 checksum
How to use checksums
ba3d1f7ed79261b7899843ef3ee1aa22e3d9a072a2051b33dbdf518091947354
BLAKE2b-256 checksum
How to use checksums
df8b32f01b8c8784e9f35c8b50ac1d80beeb923cc63dfd86e99d80a3943d427c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.10

Release files / poolin-0.1.0-py3-none-any.whl

Download URL poolin-0.1.0-py3-none-any.whl
Size 8.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
87279d79c88871d00b728b3cf30014af2fa8305e5b3408b78e82c6beb36ad646
BLAKE2b-256 checksum
How to use checksums
4d4c82ca88e3f72f106eff05926760f49dda49d4f89016dc893d8ba574f1082a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.10

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page