Skip to main content

Validation and data pipelines made easy!

Project description


The Filters library provides an easy and readable way to create complex data validation and processing pipelines, including:

  • Validating complex JSON structures in API requests or config files.
  • Parsing timestamps and converting to UTC.
  • Converting Unicode strings to NFC, normalizing line endings and removing unprintable characters.
  • Decoding Base64, including URL-safe variants.

And much more!

The output from one filter can be “piped” into the input of another, enabling you to “chain” filters together to quickly and easily create complex data pipelines.


Validate a latitude position and round to manageable precision:

  | f.Decimal
  | f.Min(Decimal(-90))
  | f.Max(Decimal(90))
  | f.Round(to_nearest='0.000001')

Parse an incoming value as a datetime, convert to UTC and strip tzinfo:


Convert every value in an iterable (e.g., list) to unicode and strip leading/trailing whitespace. This also applies Unicode normalization, strips unprintable characters and normalizes line endings automatically.

f.FilterRepeater(f.Unicode | f.Strip).apply([
  b'\xe2\x99\xaa ',
  b'\xe2\x94\x8f(\xc2\xb0.\xc2\xb0)\xe2\x94\x9b ',
  b'\xe2\x94\x97(\xc2\xb0.\xc2\xb0)\xe2\x94\x93 ',
  b'\xe2\x99\xaa ',

Parse a JSON string and check that it has correct structure:

  | f.FilterMapper(
        'birthday':  f.Date,
        'gender':    f.CaseFold | f.Choice(choices={'m', 'f', 'x'}),

          | f.Min(Decimal('-15'))
          | f.Max(Decimal('+15'))
          | f.Round(to_nearest='0.25'),

      allow_extra_keys   = False,
      allow_missing_keys = False,
).apply('{"birthday":"1879-03-14", "gender":"M", "utcOffset":"1"}')


Filters is compatible with Python versions 3.6, 3.5 and 2.7.


Install the latest stable version via pip:

pip install filters


The following extensions are available:

  • Django Filters: Adds filters designed to work with Django applications. To install:

    pip install filters[django]
  • ISO Filters: Adds filters for interpreting standard codes and identifiers. To install:

    pip install filters[iso]

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for filters, version 1.3.2
Filename, size File type Python version Upload date Hashes
Filename, size filters-1.3.2.tar.gz (57.6 kB) File type Source Python version None Upload date Hashes View
Filename, size filters-1.3.2-py2.py3-none-any.whl (37.1 kB) File type Wheel Python version py2.py3 Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page