DataFog Core
Fast structured PII detection implemented in Rust, with Python, Node.js, and browser/WASM bindings.
Supported entities
EMAIL, PHONE, SSN, CREDIT_CARD, IP_ADDRESS, DATE, and ZIP_CODE.
All bindings use the same Rust implementation and return the matched text with zero-based Unicode code-point offsets.
Repository layout
crates/core/ Rust scanning library
bindings/python/ Python extension: datafog-core / datafog_core
bindings/node/ Node package: @datafog/node
bindings/wasm/ Browser package: @datafog/wasm
fixtures/ Shared conformance fixtures
Development
cargo test --workspace
Python
python3 -m pip install maturin
maturin build --manifest-path bindings/python/Cargo.toml --release
python3 -m venv .venv
.venv/bin/python -m pip install target/wheels/datafog_core_python-*.whl
.venv/bin/python bindings/python/tests/test_installed.py
Node.js
npm ci --prefix bindings/node
npm run test:package --prefix bindings/node
Browser/WASM
rustup target add wasm32-unknown-unknown
cargo install wasm-bindgen-cli --version 0.2.127 --locked
npm ci --prefix bindings/wasm
npx --prefix bindings/wasm playwright install chromium
npm run test:package --prefix bindings/wasm
import { init, scan } from "@datafog/wasm";
await init();
console.log(scan("Email jane@example.com"));
Package status
The repository builds the following packages locally:
datafog-corefor Rust consumersdatafog-corefor Python consumers, imported asdatafog_core@datafog/nodefor Node.js consumers@datafog/wasmfor browser and bundler consumers
Publishing and cross-platform release automation are the next production steps.
License
MIT
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file datafog_core-0.1.0.tar.gz.
File metadata
- Download URL: datafog_core-0.1.0.tar.gz
- Upload date:
- Size: 12.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1747152e2dec8de769ccd6dd9c8fc31e068baaefd0fa4b082921375f5199c4c7
|
|
| MD5 |
c930a1e059c26e2cd7a23e524e9943b7
|
|
| BLAKE2b-256 |
7e784e7a37826724ffbfdfa2b260e14181f49f5999d1e256fb0337eaf8deaec7
|
Provenance
The following attestation bundles were made for datafog_core-0.1.0.tar.gz:
Publisher:
publish-python.yml on DataFog/datafog-core
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
datafog_core-0.1.0.tar.gz -
Subject digest:
1747152e2dec8de769ccd6dd9c8fc31e068baaefd0fa4b082921375f5199c4c7 - Sigstore transparency entry: 2588721706
- Sigstore integration time:
-
Permalink:
DataFog/datafog-core@c5bd8b598af6f9665f84ad3ff2ae8924718da15a -
Branch / Tag:
refs/tags/python-v0.1.0 - Owner: https://github.com/DataFog
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish-python.yml@c5bd8b598af6f9665f84ad3ff2ae8924718da15a -
Trigger Event:
push
-
Statement type:
File details
Details for the file datafog_core-0.1.0-cp310-abi3-win_amd64.whl.
File metadata
- Download URL: datafog_core-0.1.0-cp310-abi3-win_amd64.whl
- Upload date:
- Size: 740.5 kB
- Tags: CPython 3.10+, Windows x86-64
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
9d14013fbd62a333d07e2aa0b66106e1cf0b0016f662dd511da7719ec8e725de
|
|
| MD5 |
a57b20d23d43d2c180070dbd4f77c244
|
|
| BLAKE2b-256 |
2a7386bf3584c805c088a996e751a34d6fd1e9a0c92e07f398d3937f8192f440
|
Provenance
The following attestation bundles were made for datafog_core-0.1.0-cp310-abi3-win_amd64.whl:
Publisher:
publish-python.yml on DataFog/datafog-core
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
datafog_core-0.1.0-cp310-abi3-win_amd64.whl -
Subject digest:
9d14013fbd62a333d07e2aa0b66106e1cf0b0016f662dd511da7719ec8e725de - Sigstore transparency entry: 2588722540
- Sigstore integration time:
-
Permalink:
DataFog/datafog-core@c5bd8b598af6f9665f84ad3ff2ae8924718da15a -
Branch / Tag:
refs/tags/python-v0.1.0 - Owner: https://github.com/DataFog
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish-python.yml@c5bd8b598af6f9665f84ad3ff2ae8924718da15a -
Trigger Event:
push
-
Statement type:
File details
Details for the file datafog_core-0.1.0-cp310-abi3-manylinux_2_28_x86_64.whl.
File metadata
- Download URL: datafog_core-0.1.0-cp310-abi3-manylinux_2_28_x86_64.whl
- Upload date:
- Size: 966.5 kB
- Tags: CPython 3.10+, manylinux: glibc 2.28+ x86-64
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7bf66cea5df4ff3a47765ddc4b58aca78068b54d19c1f04827be31cfeefc8f0d
|
|
| MD5 |
bf6f39789cce64a6f45565b4f5facd5e
|
|
| BLAKE2b-256 |
87e2b36c9fd98cf68021616ffd030bb6ebff61d88d8331b92abce9274e0ecdf3
|
Provenance
The following attestation bundles were made for datafog_core-0.1.0-cp310-abi3-manylinux_2_28_x86_64.whl:
Publisher:
publish-python.yml on DataFog/datafog-core
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
datafog_core-0.1.0-cp310-abi3-manylinux_2_28_x86_64.whl -
Subject digest:
7bf66cea5df4ff3a47765ddc4b58aca78068b54d19c1f04827be31cfeefc8f0d - Sigstore transparency entry: 2588725424
- Sigstore integration time:
-
Permalink:
DataFog/datafog-core@c5bd8b598af6f9665f84ad3ff2ae8924718da15a -
Branch / Tag:
refs/tags/python-v0.1.0 - Owner: https://github.com/DataFog
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish-python.yml@c5bd8b598af6f9665f84ad3ff2ae8924718da15a -
Trigger Event:
push
-
Statement type:
File details
Details for the file datafog_core-0.1.0-cp310-abi3-manylinux_2_28_aarch64.whl.
File metadata
- Download URL: datafog_core-0.1.0-cp310-abi3-manylinux_2_28_aarch64.whl
- Upload date:
- Size: 946.5 kB
- Tags: CPython 3.10+, manylinux: glibc 2.28+ ARM64
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
976323f7ae1428dbe579d6ce70b224d0a7a4bc0a6b6ea25a80795821ab2990ad
|
|
| MD5 |
9a944309cf051b81e68bb055a633c5a9
|
|
| BLAKE2b-256 |
0aa1fcd3ee0e587e5aecb4672baef031607bea57f4b48f6f6351b2b0f35cc023
|
Provenance
The following attestation bundles were made for datafog_core-0.1.0-cp310-abi3-manylinux_2_28_aarch64.whl:
Publisher:
publish-python.yml on DataFog/datafog-core
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
datafog_core-0.1.0-cp310-abi3-manylinux_2_28_aarch64.whl -
Subject digest:
976323f7ae1428dbe579d6ce70b224d0a7a4bc0a6b6ea25a80795821ab2990ad - Sigstore transparency entry: 2588722080
- Sigstore integration time:
-
Permalink:
DataFog/datafog-core@c5bd8b598af6f9665f84ad3ff2ae8924718da15a -
Branch / Tag:
refs/tags/python-v0.1.0 - Owner: https://github.com/DataFog
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish-python.yml@c5bd8b598af6f9665f84ad3ff2ae8924718da15a -
Trigger Event:
push
-
Statement type:
File details
Details for the file datafog_core-0.1.0-cp310-abi3-macosx_11_0_arm64.whl.
File metadata
- Download URL: datafog_core-0.1.0-cp310-abi3-macosx_11_0_arm64.whl
- Upload date:
- Size: 839.3 kB
- Tags: CPython 3.10+, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8dc90209d0f2456328f9d3fbfea2a353130a0011979e6ec4aad7b26824fc99b1
|
|
| MD5 |
1322e3b426ff44237e08252ae9315e13
|
|
| BLAKE2b-256 |
e152cc3959c52f553298577c53c8fc7a870ca557a4f2dfecc5fbbd59ee547e39
|
Provenance
The following attestation bundles were made for datafog_core-0.1.0-cp310-abi3-macosx_11_0_arm64.whl:
Publisher:
publish-python.yml on DataFog/datafog-core
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
datafog_core-0.1.0-cp310-abi3-macosx_11_0_arm64.whl -
Subject digest:
8dc90209d0f2456328f9d3fbfea2a353130a0011979e6ec4aad7b26824fc99b1 - Sigstore transparency entry: 2588723987
- Sigstore integration time:
-
Permalink:
DataFog/datafog-core@c5bd8b598af6f9665f84ad3ff2ae8924718da15a -
Branch / Tag:
refs/tags/python-v0.1.0 - Owner: https://github.com/DataFog
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish-python.yml@c5bd8b598af6f9665f84ad3ff2ae8924718da15a -
Trigger Event:
push
-
Statement type:
File details
Details for the file datafog_core-0.1.0-cp310-abi3-macosx_10_12_x86_64.whl.
File metadata
- Download URL: datafog_core-0.1.0-cp310-abi3-macosx_10_12_x86_64.whl
- Upload date:
- Size: 860.6 kB
- Tags: CPython 3.10+, macOS 10.12+ x86-64
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e25ad89afa15f0641b75928f9629a94a9945db5dedd0db3fbe71a245aa28a8b9
|
|
| MD5 |
bb6e18ac9f8b2921d6683efb5ae7168b
|
|
| BLAKE2b-256 |
f0eb9c0395c1c491cca1875f130243a37c9f3ab5e584859ae18d8b0723e1b880
|
Provenance
The following attestation bundles were made for datafog_core-0.1.0-cp310-abi3-macosx_10_12_x86_64.whl:
Publisher:
publish-python.yml on DataFog/datafog-core
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
datafog_core-0.1.0-cp310-abi3-macosx_10_12_x86_64.whl -
Subject digest:
e25ad89afa15f0641b75928f9629a94a9945db5dedd0db3fbe71a245aa28a8b9 - Sigstore transparency entry: 2588724704
- Sigstore integration time:
-
Permalink:
DataFog/datafog-core@c5bd8b598af6f9665f84ad3ff2ae8924718da15a -
Branch / Tag:
refs/tags/python-v0.1.0 - Owner: https://github.com/DataFog
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish-python.yml@c5bd8b598af6f9665f84ad3ff2ae8924718da15a -
Trigger Event:
push
-
Statement type: