Pack your codebase into a single markdown file for LLM context, with comment stripping, secret masking, and dependency trees.
Project description
Yoink
Yoink is a command-line tool and FastAPI backend designed to bundle, sanitize, and visualize codebases for Large Language Model (LLM) contexts. It converts raw project directories into structured Markdown documents, optimizing token consumption and preventing compliance and security leaks.
Features
- Token Shredder: Safely strips comments, docstrings, and excess whitespace to reduce prompt size.
- Secret Shield: Programmatically redacts credentials, private keys, emails, and IP addresses.
- Compliance Stripper: Replaces corporate endpoints or proprietary trademarks with generic labels.
- Dependency Trees: Automatically generates AST-based ASCII dependency trees and Mermaid flowcharts.
Installation
Install from PyPI:
pip install yoinky
Or install locally in editable mode:
git clone https://github.com/Asifdotexe/yoink.git
cd yoink
pip install -e .
Documentation
For detailed instructions and references, please refer to the dedicated guides:
- CLI Usage Guide: Complete reference of CLI commands, flags (
--raw,--max-size,--no-visualize, etc.), and usage examples. - REST API Guide: Detailed guide to API endpoints, schema structures, and Render blueprint web service deployment.
- Token Reduction Learnings: Technical reference on how BPE tokenizers handle whitespace, license header stripping, and performance tuning.
Running Tests
Verify your local installation:
pytest
License
This project is licensed under the GNU AGPLv3 License.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file yoinky-1.2.1.tar.gz.
File metadata
- Download URL: yoinky-1.2.1.tar.gz
- Upload date:
- Size: 739.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2b795cde57976b9eaf2dec8db57b22f1f7329cfa314019c644d5cd015879a1ab
|
|
| MD5 |
bc17e60cadc5c4fbbb1079ed8f32a8c9
|
|
| BLAKE2b-256 |
8978cb861ad5732ccf8fce5e5efffa48eca495d91e21c4601c4b7ab96b1c3808
|
Provenance
The following attestation bundles were made for yoinky-1.2.1.tar.gz:
Publisher:
release.yml on Asifdotexe/yoink
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
yoinky-1.2.1.tar.gz -
Subject digest:
2b795cde57976b9eaf2dec8db57b22f1f7329cfa314019c644d5cd015879a1ab - Sigstore transparency entry: 1852039795
- Sigstore integration time:
-
Permalink:
Asifdotexe/yoink@1cce846a50fd20eb7cd6b9ba65727a23c5a753c9 -
Branch / Tag:
refs/tags/v1.2.1 - Owner: https://github.com/Asifdotexe
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@1cce846a50fd20eb7cd6b9ba65727a23c5a753c9 -
Trigger Event:
push
-
Statement type:
File details
Details for the file yoinky-1.2.1-py3-none-any.whl.
File metadata
- Download URL: yoinky-1.2.1-py3-none-any.whl
- Upload date:
- Size: 31.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
fc0b7f50f5bf38f5bf48a01a0cd4484ff60615b93ab8b4010852b5111fcd343e
|
|
| MD5 |
37d274f08dcc3c261795644191c0698e
|
|
| BLAKE2b-256 |
31561cde463698c28d5e134fb4472fd6be92cf1c6af92847357dbe8d8036210b
|
Provenance
The following attestation bundles were made for yoinky-1.2.1-py3-none-any.whl:
Publisher:
release.yml on Asifdotexe/yoink
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
yoinky-1.2.1-py3-none-any.whl -
Subject digest:
fc0b7f50f5bf38f5bf48a01a0cd4484ff60615b93ab8b4010852b5111fcd343e - Sigstore transparency entry: 1852040324
- Sigstore integration time:
-
Permalink:
Asifdotexe/yoink@1cce846a50fd20eb7cd6b9ba65727a23c5a753c9 -
Branch / Tag:
refs/tags/v1.2.1 - Owner: https://github.com/Asifdotexe
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@1cce846a50fd20eb7cd6b9ba65727a23c5a753c9 -
Trigger Event:
push
-
Statement type: