datapan filters (big) files.
Project description
datapan
This is still a test bed. It is not useful
datapan
sifts through enormous files in parallelized Rust to only grab the data you want as quickly and memory-efficiently as possilbe.
Installation
## create/activate venv
# sudo apt-get install python3-venv
# python3 -m venv datapan_env
# source datapan_env/bin/activate
# python -m pip install --upgrade pip
## install datapan
pip install datapan
Usage
import datapan
some_dir = ""
test = datapan.hello_rust(some_dir)
print(test)
Developer Version
- Rust (nightly)
curl https://sh.rustup.rs -sSf | sh
# rustup default nightly
rustup update nightly
- Poetry
pip install poetry
make install
make test
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distributions
datapan-0.1.1-cp38-none-win_amd64.whl
(149.7 kB
view hashes)
datapan-0.1.1-cp37-none-win_amd64.whl
(149.7 kB
view hashes)
datapan-0.1.1-cp36-none-win_amd64.whl
(149.9 kB
view hashes)
datapan-0.1.1-cp35-none-win_amd64.whl
(150.0 kB
view hashes)
Close
Hashes for datapan-0.1.1-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d268da6da0b8679f53298ba598363056b2ac842a0d66f367dfe5da9fc6500a36 |
|
MD5 | 948bf89512a2b1f8f5f9bb9186322874 |
|
BLAKE2b-256 | a8e80c15d1852e25c47d82c34987b4ef94136fd7995d8ef05400c15e6c4cdb15 |
Close
Hashes for datapan-0.1.1-cp37-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7ba6d2023fc451635bdcb1dfdca5aa3cd6bd4f58de749487f48febe6d8924942 |
|
MD5 | a7d975b4c474aab2860c053e140d975a |
|
BLAKE2b-256 | c11cb1d238ad4f3ed37105f337b858e50f72de78b01709704bb1fceb6968d064 |
Close
Hashes for datapan-0.1.1-cp37-cp37m-macosx_10_7_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b8b15df341ac193b113ebedea123b23890bc57a7fe605d78e8e497cd5ae2c467 |
|
MD5 | 63946508593872cad128be06dab00c07 |
|
BLAKE2b-256 | 1c076fd193c259001f1c755e7b7775738b1a64a8a943c3186f00b11dcbcf009f |
Close
Hashes for datapan-0.1.1-cp36-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 85b524fbc21e003c0af1f7d14a24782bc3bafa2be18c68b34459f541068a38ea |
|
MD5 | 743b4a05db6a0a94ae8c1faccd35cb59 |
|
BLAKE2b-256 | 0e79200e07a5c37e8e35bfc51bd76222d854ce41c03bb2411cbfc8b1179e75a4 |
Close
Hashes for datapan-0.1.1-cp36-cp36m-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e7b810326daa8e6da23ea1983da4d98e00df12f5db5810ad35644aa566339a72 |
|
MD5 | 14454852c6ae393244b8d3ceaface7a3 |
|
BLAKE2b-256 | c0d364accc76c54a11fcd71b2d6832560ef46b35a0c10566f58cea4f5b9f8c30 |
Close
Hashes for datapan-0.1.1-cp36-cp36m-macosx_10_7_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e8b04c0ca0ba97d3a94eaa70545b2faa3f7b4daed2588fd67cd8eb3566f7c47d |
|
MD5 | 8d8cfc3814696657b41c965231dd7c26 |
|
BLAKE2b-256 | 862bac363e8bd629217f71e28227c328dd497bc5208dcae447c1ba9fbc80f7b4 |
Close
Hashes for datapan-0.1.1-cp35-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b7cff3379bc6eca49af237ca8747182fa98b460ab140fd5ab5f8c46729f4f807 |
|
MD5 | 4c09f4fa6804726a0359b1392b0ed570 |
|
BLAKE2b-256 | 0b48c1f132c6d6c477484963509f5c88ce724b256cf50f6455a473c02ef8aa1c |