Skip to main content

datapan filters (big) files.

Project description


Build Lifecycle PyPI

This is still a test bed. It is not useful

datapan sifts through enormous files in parallelized Rust to only grab the data you want as quickly and memory-efficiently as possilbe.


## create/activate venv
# sudo apt-get install python3-venv
# python3 -m venv datapan_env
# source datapan_env/bin/activate
# python -m pip install --upgrade pip

## install datapan
pip install datapan


import datapan

some_dir = ""

test = datapan.hello_rust(some_dir)


Developer Version

  • Rust (nightly)
curl -sSf | sh
# rustup default nightly
rustup update nightly
  • Poetry
pip install poetry
make install
make test

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

datapan-0.1.1-cp38-none-win_amd64.whl (149.7 kB view hashes)

Uploaded CPython 3.8 Windows x86-64

datapan-0.1.1-cp37-none-win_amd64.whl (149.7 kB view hashes)

Uploaded CPython 3.7 Windows x86-64

datapan-0.1.1-cp37-cp37m-macosx_10_7_x86_64.whl (146.9 kB view hashes)

Uploaded CPython 3.7m macOS 10.7+ x86-64

datapan-0.1.1-cp36-none-win_amd64.whl (149.9 kB view hashes)

Uploaded CPython 3.6 Windows x86-64

datapan-0.1.1-cp36-cp36m-manylinux1_x86_64.whl (176.6 kB view hashes)

Uploaded CPython 3.6m

datapan-0.1.1-cp36-cp36m-macosx_10_7_x86_64.whl (147.0 kB view hashes)

Uploaded CPython 3.6m macOS 10.7+ x86-64

datapan-0.1.1-cp35-none-win_amd64.whl (150.0 kB view hashes)

Uploaded CPython 3.5 Windows x86-64

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page