Skip to main content

datapan filters (big) files.

Project description

datapan

Build Lifecycle PyPI Crates.io


This is still a test bed. It is not useful

datapan sifts through enormous files in parallelized Rust to only grab the data you want as quickly and memory-efficiently as possilbe.


Installation

## create/activate venv
# sudo apt-get install python3-venv
# python3 -m venv datapan_env
# source datapan_env/bin/activate
# python -m pip install --upgrade pip

## install datapan
pip install datapan

Usage

import datapan

some_dir = ""

test = datapan.hello_rust(some_dir)

print(test)

Developer Version

  • Rust (nightly)
curl https://sh.rustup.rs -sSf | sh
# rustup default nightly
rustup update nightly
  • Poetry
pip install poetry
make install
make test

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for datapan, version 0.1.1
Filename, size File type Python version Upload date Hashes
Filename, size datapan-0.1.1-cp35-none-win_amd64.whl (150.0 kB) File type Wheel Python version cp35 Upload date Hashes View hashes
Filename, size datapan-0.1.1-cp36-cp36m-macosx_10_7_x86_64.whl (147.0 kB) File type Wheel Python version cp36 Upload date Hashes View hashes
Filename, size datapan-0.1.1-cp36-cp36m-manylinux1_x86_64.whl (176.6 kB) File type Wheel Python version cp36 Upload date Hashes View hashes
Filename, size datapan-0.1.1-cp36-none-win_amd64.whl (149.9 kB) File type Wheel Python version cp36 Upload date Hashes View hashes
Filename, size datapan-0.1.1-cp37-cp37m-macosx_10_7_x86_64.whl (146.9 kB) File type Wheel Python version cp37 Upload date Hashes View hashes
Filename, size datapan-0.1.1-cp37-none-win_amd64.whl (149.7 kB) File type Wheel Python version cp37 Upload date Hashes View hashes
Filename, size datapan-0.1.1-cp38-none-win_amd64.whl (149.7 kB) File type Wheel Python version cp38 Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page