Python interface for reading and appending tar files, while keeping a fast index for finding and reading files in the archive.
This interface has been successfully used to store and manage over one billion files in one of the Pilot-2 simulation campaigns.
Written by Tomas Oppelstrup as part of the DOE/NCI Pilot-2 project, based on an initial (simpler) index implementation by Tomas Oppelstrup, December 11, 2018. Updated to support Python 3 as a module by Francesco DiNatale.
A script for correctness checking and examples of use can be found in tests/indextest.py. The simplest way to run the tests is by e.g.: cd test ./testscript.sh
This software is distributed under the MIT license; see the file "LICENSE" for details. This software was developed at the Lawrence Livermore National Laboratory and has the release number LLNL-CODE-826782; see the file "NOTICE" for details.
1 maintainer
Metadata
1 maintainer
Release files for pytaridx 1.0.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| pytaridx-1.0.2.tar.gz | 16.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| pytaridx-1.0.2-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 35.1 kB
Release files / pytaridx-1.0.2.tar.gz
| Download URL | pytaridx-1.0.2.tar.gz |
|---|---|
| Size | 16.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
702c42ade13ae8688a56a8edfcd7e0e7512a489a22796c6cfdbcef677010ee47
|
|
BLAKE2b-256 checksum How to use checksums |
1c3f4649da2154d386fa4dc8ee1de5eb408ccae4db9423fdfbb8c39a0f1b5452
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.6.0 importlib_metadata/4.8.2 pkginfo/1.7.1 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.9.5
|
Release files / pytaridx-1.0.2-py3-none-any.whl
| Download URL | pytaridx-1.0.2-py3-none-any.whl |
|---|---|
| Size | 18.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
7a41b3adc398e8c0cafe8981d0690daa03d51cfd0bd41a6748f73f703a997ef7
|
|
BLAKE2b-256 checksum How to use checksums |
9b0560e76cb53b13a2b52bcfa21284845dc8b5a35e7d292a159d0ad48d4644cb
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.6.0 importlib_metadata/4.8.2 pkginfo/1.7.1 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.2 CPython/3.9.5
|
