Skip to main content

decontaminate

Fast contamination detection for ML training data. Python bindings for decon.

Installation

pip install decontaminate

Usage

import decon

config = decon.Config(
    training_dir="/path/to/training/data",
    evals_dir="/path/to/eval/references",
    report_output_dir="/path/to/output",
)
report_dir = decon.detect(config)

API

The Python API is a thin PyO3 wrapper over the Rust implementation. See src/lib.rs for all Config parameters and available functions:

  • detect(), review(), compare(), evals(), server()
  • Tokenizer (encode/decode with cl100k, o200k, etc.)
  • clean_text() (text normalization)

Documentation

Full documentation: https://github.com/vincentzed/decon

Metadata

Release files for decontaminate 0.3.0.post4

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for decontaminate 0.3.0.post4
File Size Uploaded Provenance Actions
decontaminate-0.3.0.post4.tar.gz 132.0 kB With provenance Details for decontaminate-0.3.0.post4.tar.gz

Built distributions (wheels)

Table of built distributions (wheels) for decontaminate 0.3.0.post4
File Actions
decontaminate-0.3.0.post4-cp314-cp314-manylinux_2_17_x86_64.manylinux2014_x86_64.whl CPython 3.14 CPython 3.14 Linux glibc 2.17+ x86-64 Details for decontaminate-0.3.0.post4-cp314-cp314-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
decontaminate-0.3.0.post4-cp314-cp314-manylinux_2_17_aarch64.manylinux2014_aarch64.whl CPython 3.14 CPython 3.14 Linux glibc 2.17+ ARM64 Details for decontaminate-0.3.0.post4-cp314-cp314-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
decontaminate-0.3.0.post4-cp314-cp314-macosx_11_0_arm64.whl CPython 3.14 CPython 3.14 macOS 11.0+ ARM64 Details for decontaminate-0.3.0.post4-cp314-cp314-macosx_11_0_arm64.whl
decontaminate-0.3.0.post4-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl CPython 3.13 CPython 3.13 Linux glibc 2.17+ x86-64 Details for decontaminate-0.3.0.post4-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
decontaminate-0.3.0.post4-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl CPython 3.13 CPython 3.13 Linux glibc 2.17+ ARM64 Details for decontaminate-0.3.0.post4-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
decontaminate-0.3.0.post4-cp313-cp313-macosx_11_0_arm64.whl CPython 3.13 CPython 3.13 macOS 11.0+ ARM64 Details for decontaminate-0.3.0.post4-cp313-cp313-macosx_11_0_arm64.whl
decontaminate-0.3.0.post4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl CPython 3.12 CPython 3.12 Linux glibc 2.17+ x86-64 Details for decontaminate-0.3.0.post4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
decontaminate-0.3.0.post4-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl CPython 3.12 CPython 3.12 Linux glibc 2.17+ ARM64 Details for decontaminate-0.3.0.post4-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
decontaminate-0.3.0.post4-cp312-cp312-macosx_11_0_arm64.whl CPython 3.12 CPython 3.12 macOS 11.0+ ARM64 Details for decontaminate-0.3.0.post4-cp312-cp312-macosx_11_0_arm64.whl

Total release size: 51.9 MB

Release files / decontaminate-0.3.0.post4.tar.gz

Download URL decontaminate-0.3.0.post4.tar.gz
Size 132.0 kB
Tags Source
SHA-256 checksum
How to use checksums
881e1ad05cd493b8f68665479d126cb9fec728e71bd26c105bdb8ba8142127e4
BLAKE2b-256 checksum
How to use checksums
0c48ad970b46cf4f7e738753f3c8a998c7e512b0e16f44123ef4f2cbfd041138
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jan 9, 2026.

Transparency log

Release files / decontaminate-0.3.0.post4-cp314-cp314-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL decontaminate-0.3.0.post4-cp314-cp314-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 5.9 MB
Tags CPython 3.14 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums
06435c6e1ff9333c1e4d49de9d30c0f9e5586ed95a6b03a68453c9af92fe290d
BLAKE2b-256 checksum
How to use checksums
28a927926e37f1bf70f60379c868adc3bba5953148f2d4ebf495fdfe66bfcb7f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jan 9, 2026.

Transparency log

Release files / decontaminate-0.3.0.post4-cp314-cp314-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL decontaminate-0.3.0.post4-cp314-cp314-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 5.8 MB
Tags CPython 3.14 Linux glibc 2.17+ ARM64
SHA-256 checksum
How to use checksums
b65d36c2e94528ef2955c1af9015d2c206a29c914125473c2a0c995438d65eab
BLAKE2b-256 checksum
How to use checksums
f8779e86aa4072b5c20c804d7cf3d217cf16597fec5decb84a93c83b1f271559
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jan 9, 2026.

Transparency log

Release files / decontaminate-0.3.0.post4-cp314-cp314-macosx_11_0_arm64.whl

Download URL decontaminate-0.3.0.post4-cp314-cp314-macosx_11_0_arm64.whl
Size 5.5 MB
Tags CPython 3.14 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
679c25d5b3aa34047c29df5fc050483b4d8fc48f1390538dbacdba0a1393e6e2
BLAKE2b-256 checksum
How to use checksums
be35e744abd9c80a961fcdfca921378125516b3f286470e4559051f8e6fd86ca
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jan 9, 2026.

Transparency log

Release files / decontaminate-0.3.0.post4-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL decontaminate-0.3.0.post4-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 6.0 MB
Tags CPython 3.13 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums
893066a1a89f5e91469740271215ca1d5d1d014ad21d13a3ac705db0f10ce6d9
BLAKE2b-256 checksum
How to use checksums
4b4d97c6d87625595f3ece6ef0b0ab25584998eb50c092e02bc324e3dbe8a4ba
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jan 9, 2026.

Transparency log

Release files / decontaminate-0.3.0.post4-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL decontaminate-0.3.0.post4-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 5.8 MB
Tags CPython 3.13 Linux glibc 2.17+ ARM64
SHA-256 checksum
How to use checksums
5163d5b8d96f3413100a3cdc2a8f9ac15f74ddfd33bb12979a8b60a087195981
BLAKE2b-256 checksum
How to use checksums
912b99cde38d9a7fcd77d2675381ccf0639ba588cc7e3bcddaae27e669ccb184
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jan 9, 2026.

Transparency log

Release files / decontaminate-0.3.0.post4-cp313-cp313-macosx_11_0_arm64.whl

Download URL decontaminate-0.3.0.post4-cp313-cp313-macosx_11_0_arm64.whl
Size 5.5 MB
Tags CPython 3.13 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
4e135fd7d1683a22e63dc4969cb0a808a44e4dd9e3abf807e0571bc77ec1d9fd
BLAKE2b-256 checksum
How to use checksums
19a90cca8c9504db8b4284e05572ffecc12f26cb9afdc86debde08a98256139f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jan 9, 2026.

Transparency log

Release files / decontaminate-0.3.0.post4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL decontaminate-0.3.0.post4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 6.0 MB
Tags CPython 3.12 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums
ef1e93525ecca844479fa701619cf4c69c77485abb79223339c7c6675f496507
BLAKE2b-256 checksum
How to use checksums
44572f39b5b06af3f558a3bd7ed61e361f59ca2eec3cde061cc5b99f03b5acca
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jan 9, 2026.

Transparency log

Release files / decontaminate-0.3.0.post4-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL decontaminate-0.3.0.post4-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 5.8 MB
Tags CPython 3.12 Linux glibc 2.17+ ARM64
SHA-256 checksum
How to use checksums
b1f2bf73285b679d01c6c81769a078396eab1bb767bb3bf1e0ab7a3cea82c3af
BLAKE2b-256 checksum
How to use checksums
55390e7fccef5e519f472646d1ddf05fa3cacfdb0ebd271be54cc01462c9a59c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jan 9, 2026.

Transparency log

Release files / decontaminate-0.3.0.post4-cp312-cp312-macosx_11_0_arm64.whl

Download URL decontaminate-0.3.0.post4-cp312-cp312-macosx_11_0_arm64.whl
Size 5.5 MB
Tags CPython 3.12 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
5b399d072e2c08125cdc59fde8957cb5d94f9c717c7a595684374073d5208444
BLAKE2b-256 checksum
How to use checksums
b8206eb3297e667a2c2d1e95d3b5b8286ec738a6c6c8b7fc8b41128d227ffadd
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jan 9, 2026.

Transparency log

Security for decontaminate 0.3.0.post4

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 10 files in this release have been uploaded with provenance metadata.

Select from 10 files

Attestation for decontaminate-0.3.0.post4.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jan 9, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page