Skip to main content

DataFog Core

Fast structured PII detection implemented in Rust, with Python, Node.js, and browser/WASM bindings.

Supported entities

EMAIL, PHONE, SSN, CREDIT_CARD, IP_ADDRESS, DATE, and ZIP_CODE.

All bindings use the same Rust implementation and return the matched text with zero-based Unicode code-point offsets.

Repository layout

crates/core/        Rust scanning library
bindings/python/    Python extension: datafog-core / datafog_core
bindings/node/      Node package: @datafog/node
bindings/wasm/      Browser package: @datafog/wasm
fixtures/           Shared conformance fixtures

Development

cargo test --workspace

Python

python3 -m pip install maturin
maturin build --manifest-path bindings/python/Cargo.toml --release
python3 -m venv .venv
.venv/bin/python -m pip install target/wheels/datafog_core_python-*.whl
.venv/bin/python bindings/python/tests/test_installed.py

Node.js

npm ci --prefix bindings/node
npm run test:package --prefix bindings/node

Browser/WASM

rustup target add wasm32-unknown-unknown
cargo install wasm-bindgen-cli --version 0.2.127 --locked
npm ci --prefix bindings/wasm
npx --prefix bindings/wasm playwright install chromium
npm run test:package --prefix bindings/wasm
import { init, scan } from "@datafog/wasm";

await init();
console.log(scan("Email jane@example.com"));

Package status

The repository builds the following packages locally:

  • datafog-core for Rust consumers
  • datafog-core for Python consumers, imported as datafog_core
  • @datafog/node for Node.js consumers
  • @datafog/wasm for browser and bundler consumers

Publishing and cross-platform release automation are the next production steps.

License

MIT

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

datafog_core-0.1.0.tar.gz (12.1 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

datafog_core-0.1.0-cp310-abi3-win_amd64.whl (740.5 kB view details)

Uploaded CPython 3.10+Windows x86-64

datafog_core-0.1.0-cp310-abi3-manylinux_2_28_x86_64.whl (966.5 kB view details)

Uploaded CPython 3.10+manylinux: glibc 2.28+ x86-64

datafog_core-0.1.0-cp310-abi3-manylinux_2_28_aarch64.whl (946.5 kB view details)

Uploaded CPython 3.10+manylinux: glibc 2.28+ ARM64

datafog_core-0.1.0-cp310-abi3-macosx_11_0_arm64.whl (839.3 kB view details)

Uploaded CPython 3.10+macOS 11.0+ ARM64

datafog_core-0.1.0-cp310-abi3-macosx_10_12_x86_64.whl (860.6 kB view details)

Uploaded CPython 3.10+macOS 10.12+ x86-64

File details

Details for the file datafog_core-0.1.0.tar.gz.

File metadata

  • Download URL: datafog_core-0.1.0.tar.gz
  • Upload date:
  • Size: 12.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for datafog_core-0.1.0.tar.gz
Algorithm Hash digest
SHA256 1747152e2dec8de769ccd6dd9c8fc31e068baaefd0fa4b082921375f5199c4c7
MD5 c930a1e059c26e2cd7a23e524e9943b7
BLAKE2b-256 7e784e7a37826724ffbfdfa2b260e14181f49f5999d1e256fb0337eaf8deaec7

See more details on using hashes here.

Provenance

The following attestation bundles were made for datafog_core-0.1.0.tar.gz:

Publisher: publish-python.yml on DataFog/datafog-core

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file datafog_core-0.1.0-cp310-abi3-win_amd64.whl.

File metadata

  • Download URL: datafog_core-0.1.0-cp310-abi3-win_amd64.whl
  • Upload date:
  • Size: 740.5 kB
  • Tags: CPython 3.10+, Windows x86-64
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for datafog_core-0.1.0-cp310-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 9d14013fbd62a333d07e2aa0b66106e1cf0b0016f662dd511da7719ec8e725de
MD5 a57b20d23d43d2c180070dbd4f77c244
BLAKE2b-256 2a7386bf3584c805c088a996e751a34d6fd1e9a0c92e07f398d3937f8192f440

See more details on using hashes here.

Provenance

The following attestation bundles were made for datafog_core-0.1.0-cp310-abi3-win_amd64.whl:

Publisher: publish-python.yml on DataFog/datafog-core

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file datafog_core-0.1.0-cp310-abi3-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for datafog_core-0.1.0-cp310-abi3-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 7bf66cea5df4ff3a47765ddc4b58aca78068b54d19c1f04827be31cfeefc8f0d
MD5 bf6f39789cce64a6f45565b4f5facd5e
BLAKE2b-256 87e2b36c9fd98cf68021616ffd030bb6ebff61d88d8331b92abce9274e0ecdf3

See more details on using hashes here.

Provenance

The following attestation bundles were made for datafog_core-0.1.0-cp310-abi3-manylinux_2_28_x86_64.whl:

Publisher: publish-python.yml on DataFog/datafog-core

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file datafog_core-0.1.0-cp310-abi3-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for datafog_core-0.1.0-cp310-abi3-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 976323f7ae1428dbe579d6ce70b224d0a7a4bc0a6b6ea25a80795821ab2990ad
MD5 9a944309cf051b81e68bb055a633c5a9
BLAKE2b-256 0aa1fcd3ee0e587e5aecb4672baef031607bea57f4b48f6f6351b2b0f35cc023

See more details on using hashes here.

Provenance

The following attestation bundles were made for datafog_core-0.1.0-cp310-abi3-manylinux_2_28_aarch64.whl:

Publisher: publish-python.yml on DataFog/datafog-core

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file datafog_core-0.1.0-cp310-abi3-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for datafog_core-0.1.0-cp310-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 8dc90209d0f2456328f9d3fbfea2a353130a0011979e6ec4aad7b26824fc99b1
MD5 1322e3b426ff44237e08252ae9315e13
BLAKE2b-256 e152cc3959c52f553298577c53c8fc7a870ca557a4f2dfecc5fbbd59ee547e39

See more details on using hashes here.

Provenance

The following attestation bundles were made for datafog_core-0.1.0-cp310-abi3-macosx_11_0_arm64.whl:

Publisher: publish-python.yml on DataFog/datafog-core

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file datafog_core-0.1.0-cp310-abi3-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for datafog_core-0.1.0-cp310-abi3-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 e25ad89afa15f0641b75928f9629a94a9945db5dedd0db3fbe71a245aa28a8b9
MD5 bb6e18ac9f8b2921d6683efb5ae7168b
BLAKE2b-256 f0eb9c0395c1c491cca1875f130243a37c9f3ab5e584859ae18d8b0723e1b880

See more details on using hashes here.

Provenance

The following attestation bundles were made for datafog_core-0.1.0-cp310-abi3-macosx_10_12_x86_64.whl:

Publisher: publish-python.yml on DataFog/datafog-core

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.1.0 This release

6 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page