This release is a pre-release and may not be stable for production use.
everalgo-knowledge
Extracts a flattened topic tree (list[KnowledgeMemory]) from parsed content (ParsedContent) via LLM.
Use
from everalgo.knowledge import KnowledgeExtractor
from everalgo.types import ParsedContent
parsed = ParsedContent(text="...", mime="text/markdown")
memories = await KnowledgeExtractor(llm=client).aextract(parsed, doc_id="doc1", title="My doc")
# memories[0] = synthetic doc root; rest = DFS-ordered topic nodes.
llm: any everalgo.llm.LLMClient, passed at construction. Every call sends a system message of rules and a user message of data, requests a strict reply model as response_format, and raises everalgo.llm.LLMOutputError when the reply does not validate (no retry; the host decides). Sync bridge: extract(...).
custom_instructions= (on aextract and aclassify_category) adds the host's text to the bundled rules, never replacing them: it goes, verbatim and never rendered as a template, in a <custom_instructions> block closing the system message of every LLM call the extraction makes; None or a blank string adds nothing.
Pipeline at a glance
ParsedContent
→ preprocess + atomize (_block_split)
→ topic-tree LLM (per batch) (prompts.en.topic_tree_extract)
→ cross-batch merge (>1 batch) (prompts.en.content_merge + topic_merge)
→ postprocess: split unsplit leaves + assign uncovered blocks
→ tree assembly + DFS flatten → list[KnowledgeMemory]
Install
pip install everalgo-knowledge # pulls everalgo-core + everalgo-parser
For development within the monorepo workspace:
uv sync --package everalgo-knowledge
Live-LLM scripts
Run from the repository root. Put LLM_API_KEY, LLM_BASE_URL, LLM_MODEL in a .env file there first; each command block below sources it inline and is paste-and-run.
Smoke test — 2 fixtures, structural assertions only, no artifacts written:
set -a; source .env; set +a
uv run pytest -m integration packages/everalgo-knowledge/tests/functional/test_extraction_smoke.py
Run one doc — dumps result (JSON + optional HTML viz) under tests/functional/outputs/:
set -a; source .env; set +a
uv run python packages/everalgo-knowledge/examples/run_one_doc.py \
packages/everalgo-knowledge/tests/functional/fixtures/idx_multi_topic.json --html
Related distributions
everalgo-parser— producesParsedContentfrom raw files (fully implemented except video, which is deferred pending ADR)everalgo-core—KnowledgeMemorytype is defined here
Metadata
Release files for everalgo-knowledge 0.3.0rc1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| everalgo_knowledge-0.3.0rc1.tar.gz | 73.7 kB | Without provenance | Details for everalgo_knowledge-0.3.0rc1.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| everalgo_knowledge-0.3.0rc1-py3-none-any.whl | Python 3 | none | any | Details for everalgo_knowledge-0.3.0rc1-py3-none-any.whl |
Total release size: 116.1 kB
Release files / everalgo_knowledge-0.3.0rc1.tar.gz
| Download URL | everalgo_knowledge-0.3.0rc1.tar.gz |
|---|---|
| Size | 73.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
687d6545892c0868e891d0d037be1622b6c9a8bbf6d92c026561995f3e097922
|
|
BLAKE2b-256 checksum How to use checksums |
bbd80206d4c50b35ff8a3b01efdadec16c74955f2d3763e49c7841829d2b2bbb
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.12.12
|
Release files / everalgo_knowledge-0.3.0rc1-py3-none-any.whl
| Download URL | everalgo_knowledge-0.3.0rc1-py3-none-any.whl |
|---|---|
| Size | 42.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
bb1b28766a6d5f1916249ac00c6cf565ed238b783f0bb82079b1e0bc90ae34d3
|
|
BLAKE2b-256 checksum How to use checksums |
b9fac8a148c8299cbea73dfe30661f58f0785e5a55697cfd34ff1e356d3abd5b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.12.12
|
Security for everalgo-knowledge 0.3.0rc1
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.