bocconcini
Use it for: documents and prompts on local LLMs with a genuinely small context - Android/Termux, Raspberry Pi, old laptops, air-gapped machines.
Zero runtime dependencies. A Python client for local LLMs whose usable window is smaller than the advertised one. Born on a Samsung S20 Ultra in Termux, built to never lie about what it did.
Why "bocconcini"? A child, a huge cake, a small mouth: STORIA.md. Italian edition: README.it.md.
Verification status
- Verified live: KoboldCpp, Samsung S20 Ultra, smol-tools-4b.
- Implemented but NOT verified live: llama.cpp native, Ollama, cloud.
- 43 checks:
python test_bocconcini.pyandpython test_regressioni.py.
What it does
- Chunks text / Python / JSON, never inside a string or an escape sequence.
- Output budget from the context window, not from generation speed.
- Cognitive window:
client.calibra()measures how much the model actually understands, not how much the server can hold. Only a passed probe is stored. - Detects silent prompt truncation, and only near the window: far from it a shortfall is our own estimate, not a cut.
- Continues answers cut by the token limit, stitching without duplicates.
- Disk-backed tree:
DocTree,naviga,albero_codice(lossless AST partition). trova_fatti: deterministic scan for codes / IDs / measurements / keys, each with its surrounding sentence.
Some public names are Italian (trova_fatti, contesto, invia_adattivo).
They are kept as-is for compatibility.
Install
Python 3.7+. No runtime dependencies. Not on PyPI yet.
pip install git+https://github.com/MalgTruevero/bocconcini_crunch.git
Offline / Termux — no pip, no build, two files:
curl -O https://raw.githubusercontent.com/MalgTruevero/bocconcini_crunch/main/bocconcini.py
curl -O https://raw.githubusercontent.com/MalgTruevero/bocconcini_crunch/main/bocconcini_tree.py
First result — no model, no server
from bocconcini_tree import trova_fatti
doc = "filler " * 4000 + "The unlock code is ALFA-1." + "filler " * 4000
print(trova_fatti(doc))
Python reads every character and returns the code with its sentence. This is the mechanism that found 4/4 hidden codes in 52 s where blind compression found 0/4 in 42 min, on a Samsung S20 Ultra with a 4B model.
Reproduce it:
python benchmark_tank.py --no-model # scan only, no server, milliseconds
python benchmark_tank.py # scan + one model call
Exits 1 if a needle is missed.
Reproduce it:
python benchmark_tank.py --no-model # scan only, no server, milliseconds
python benchmark_tank.py # scan + one model call
Exits 1 if a needle is missed.
With a local server
Needs a running llama.cpp / KoboldCpp server. Verified live: KoboldCpp only.
from bocconcini import LlamaCppClient
cl = LlamaCppClient("http://127.0.0.1:5001")
print(cl.chat("Answer with one word: ok"))
Ollama and OpenAI-compatible cloud paths are implemented but not verified live.
Finding facts without blind compression
from bocconcini_tree import trova_fatti
facts = trova_fatti(document) # reads every character, no model call
context = "\n".join(f["contesto"] for f in facts)
Measured on the reference phone, 4 codes hidden in 32,000 characters: blind compression 0/4 in 2562 s; trova_fatti 4/4 in 52 s, ~265 prompt tokens instead of ~10923.
auto_reduce=True is lossy: it can discard the middle of a document.
To find facts, use trova_fatti or explicit chunking.
License
MIT. Keeping the name and the story is a courtesy, not a requirement.
The name
"BOCCONCINI" reads like mozzarella to an English speaker. It is not: it means small bites. If you fork and republish, please carry STORIA.md along — a courtesy, not a licence requirement.
Metadata
Release files for bocconcini 4.3.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| bocconcini-4.3.0.tar.gz | 52.3 kB | With provenance | Details for bocconcini-4.3.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| bocconcini-4.3.0-py3-none-any.whl | Python 3 | none | any | Details for bocconcini-4.3.0-py3-none-any.whl |
Total release size: 105.7 kB
Release files / bocconcini-4.3.0.tar.gz
| Download URL | bocconcini-4.3.0.tar.gz |
|---|---|
| Size | 52.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
aaba38073a6692f62f65a4a775bd734e6c095e8a2a54a8862f5b08588151fcf6
|
|
BLAKE2b-256 checksum How to use checksums |
3aba1fb5dce8a0ed7a8f1634728db800525d8237b7605af803024866acc8321c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Nov 17, 2026.
Transparency logRelease files / bocconcini-4.3.0-py3-none-any.whl
| Download URL | bocconcini-4.3.0-py3-none-any.whl |
|---|---|
| Size | 53.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
dcf8d06ad5d9a27fdec83bb0100689ccfa61093ecef0a9d2cf5b4f6af855f473
|
|
BLAKE2b-256 checksum How to use checksums |
3245f586c91247f0b6abd6dbee1d715fcff27ba97679f55c7b969ac9f627a11d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/7.0.0 CPython/3.13.16
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Nov 17, 2026.
Transparency logSecurity for bocconcini 4.3.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
Full provenance
Both files in this release have been uploaded with provenance metadata.
Attestation for bocconcini-4.3.0.tar.gz
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Nov 17, 2026.
Transparency logA note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.