Skip to main content

A Bloom filter implementation in Python 3

Project description

bloomfilter3

Python bloom-filter library with a focus on ease of use and high performance.

Motivation

This library was heavily inspired from the excellent bloom-filter2 library, however I decided to make some changes that enhanced functionality and ease of use.

Unfortunatly these changes makes the library non-backwards compatible, hence bloomfilter3 was born.

Credits and links can be found in AUTHORS.md.

Changes from bloom-filter2:

  • mmap only and by default
  • bloom filter parameters are stored WITH the bloom filter itself on disk, no need to keep track of parameters (max_elements, error_rate) seperatly
  • Simpler persistence

Using

from bloom_filter3 import BloomFilter

# instantiate BloomFilter with custom settings,
# max_elements is how many elements you expect the filter to hold.
# error_rate defines accuracy; You can use defaults with
# `BloomFilter()` without any arguments. Following example
# is same as defaults:

bloom = BloomFilter(
  max_elements=10_000,
  error_rate=0.1
)

# Test whether the bloom-filter has seen a key:
assert "test-key" not in bloom

# Mark the key as seen
bloom.add("test-key")

# Now check again
assert "test-key" in bloom

Contributing

  • Please review CODE_OF_CONDUCT.md
  • Please make sure you do make tests and make lint before submitting a PR
  • Please make sure you add tests for any new functionality

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bloomfilter3-1.0.2.tar.gz (10.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

bloomfilter3-1.0.2-py3-none-any.whl (8.3 kB view details)

Uploaded Python 3

File details

Details for the file bloomfilter3-1.0.2.tar.gz.

File metadata

  • Download URL: bloomfilter3-1.0.2.tar.gz
  • Upload date:
  • Size: 10.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.9.2

File hashes

Hashes for bloomfilter3-1.0.2.tar.gz
Algorithm Hash digest
SHA256 3a274c191fe350fe9b45ba4cc622b1a7449a8f1585a408659e6eddcb370f9e88
MD5 984e5410995af1304a3f7ff94e2544c8
BLAKE2b-256 c61edb03d5a67df3e121a7b1e206d3def5af3541c6149fd3783f16d50c8a98da

See more details on using hashes here.

File details

Details for the file bloomfilter3-1.0.2-py3-none-any.whl.

File metadata

  • Download URL: bloomfilter3-1.0.2-py3-none-any.whl
  • Upload date:
  • Size: 8.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.9.2

File hashes

Hashes for bloomfilter3-1.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 5085efedb824323a152ddcd73d50204463b183ca3cb30b1eca373f7fb3db1fe2
MD5 db40cc33356dda173c5d39b3d06846d0
BLAKE2b-256 5107dde128df8041ea1b15619b4cb814226d3e9b139243a69b1247d8ad1171ab

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page