pyrecall

Forgetting detection and skill rollback for fine-tuned LLMs.

Fine-tune on new data and your model quietly loses what it already knew — coding ability, reasoning, safety guardrails. pyrecall catches it before it ships.

Install

pip install pyrecall   # Python 3.11–3.14 · CUDA, MPS, and CPU

Quickstart

from pyrecall import Model

model = Model("meta-llama/Llama-3.2-1B")
model.snapshot("before")
model.learn("data.jsonl", epochs=3)

if not model.check().is_healthy:
    model.rollback(to="before")

pyrecall init --model meta-llama/Llama-3.2-1B
pyrecall snapshot before_v1
pyrecall learn train.jsonl --snapshot-after after_v1
pyrecall check --before before_v1 --after after_v1
# exit 0 → ship   exit 2 → pyrecall rollback before_v1

How it works

Benchmarks 180 prompts across 9 skill categories (reasoning, coding, safety, math, multilingual, and more) using log-likelihood scoring. After training, check diffs the scores and flags any category that drops past your threshold (default 10%). Only the LoRA adapter is stored per snapshot — a few hundred MB, not the full model.

Any causal LM on HuggingFace Hub is supported — Llama, Mistral, Phi, Gemma, Qwen, Falcon, GPT-2/Neo/J, and more. LoRA targets are auto-detected.

Docs

Full CLI reference, Python API, experiment tracker integrations (W&B, MLflow, Neptune), custom benchmarks, per-category thresholds, and more:

pyrecall.github.io/Pyrecall

Contributing

git clone https://github.com/Arths17/Pyrecall
pip install -e ".[dev]"
pytest

Open an issue before large changes. MIT — LICENSE.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pyrecall-0.11.11.tar.gz (153.3 kB view details)

Uploaded Jun 18, 2026 Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

pyrecall-0.11.11-py3-none-any.whl (88.5 kB view details)

Uploaded Jun 18, 2026 Python 3

File details

Details for the file pyrecall-0.11.11.tar.gz.

File metadata

Download URL: pyrecall-0.11.11.tar.gz
Upload date: Jun 18, 2026
Size: 153.3 kB
Tags: Source
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for pyrecall-0.11.11.tar.gz
Algorithm	Hash digest
SHA256	`7ef841c2b1a6b95c58721e8366fe342a8241df281ac8455a602835618107dc15`
MD5	`9fce300b017b167b68ae2aabfbd0bcdc`
BLAKE2b-256	`a7b443e5102882bce58d86579f49693cf72cfc62ab1a0376fe35c73bd2ace0a0`

See more details on using hashes here.

Provenance

The following attestation bundles were made for pyrecall-0.11.11.tar.gz:

Publisher: publish.yml on Pyrecall/Pyrecall

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: pyrecall-0.11.11.tar.gz
- Subject digest: 7ef841c2b1a6b95c58721e8366fe342a8241df281ac8455a602835618107dc15
- Sigstore transparency entry: 1855210258
- Sigstore integration time: Jun 18, 2026
Source repository:
- Permalink: Pyrecall/Pyrecall@7ffbb9f02ee2298f51c621b0bcf992269588d2a4
- Branch / Tag: refs/tags/v0.11.11
- Owner: https://github.com/Pyrecall
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: publish.yml@7ffbb9f02ee2298f51c621b0bcf992269588d2a4
- Trigger Event: push