fastbloom-rs 0.2.1

A fast bloom filter implemented by Rust for Python and Rust!

fastbloom

A fast bloom filter implemented by Rust for Python and Rust!

• fastbloom
  • setup
    • Python
      • requirements
      • install
    • Rust
  • Examples
    • Python
    • Rust
  • benchmark
    • computer info
    • bloom add
    • bloom add one million

setup

Python

requirements

Python >= 3.7

install

Install the latest fastbloom version with:

pip install fastbloom-rs

Rust

fastbloom-rs = "0.2.1"

Examples

Python

basic usage

from fastbloom_rs import BloomFilter

bloom = BloomFilter(100_000_000, 0.01)

bloom.add_str('hello')
bloom.add_bytes(b'world')
bloom.add_int(9527)

assert bloom.contains('hello')
assert bloom.contains(b'world')
assert bloom.contains(9527)

assert not bloom.contains('hello world')

build bloom filter from bytes or list

from fastbloom_rs import BloomFilter

bloom = BloomFilter(100_000_000, 0.01)
bloom.add_str('hello')
assert bloom.contains('hello')

bloom2 = BloomFilter.from_bytes(bloom.get_bytes(), bloom.hashes())
assert bloom2.contains('hello')

bloom3 = BloomFilter.from_int_array(bloom.get_int_array(), bloom.hashes())
assert bloom3.contains('hello')

Rust

use fastbloom_rs::{BloomFilter, FilterBuilder};

let mut bloom = FilterBuilder::new(100_000_000, 0.01).build_bloom_filter();

bloom.add(b"helloworld");
assert_eq!(bloom.contains(b"helloworld"), true);
assert_eq!(bloom.contains(b"helloworld!"), false);

more examples at docs.rs

benchmark

computer info

CPU	Memory	OS
AMD Ryzen 7 5800U with Radeon Graphics	16G	Windows 10

bloom add

Benchmark insert str to bloom filter:

Additional Statistics:

	Lower bound	Estimate	Upper bound
Slope	41.095 ns	41.146 ns	41.203 ns
R²	0.9959495	0.9961648	0.9959083
Mean	41.157 ns	41.207 ns	41.257 ns
Std. Dev.	226.07 ps	261.59 ps	294.01 ps
Median	41.132 ns	41.184 ns	41.247 ns
MAD	201.13 ps	277.13 ps	335.05 ps

bloom add one million

Benchmark loop insert (1..1_000_000).map(|n| { n.to_string() }) to bloom filter:

Additional Statistics:

	Lower bound	Estimate	Upper bound
R²	0.0002895	0.0002964	0.0002822
Mean	237.57 ms	240.25 ms	244.15 ms
Std. Dev.	2.4341 ms	17.400 ms	28.072 ms
Median	236.83 ms	237.27 ms	237.75 ms
MAD	1.5867 ms	2.2701 ms	2.8268 ms