Binary Table File format
Binary Table File - efficient binary file format to store and retrieve tabular data
This library is written in Cython for speed efficiency.
- is basically a typed CSV, but binary and indexed,
supporting only a subset of the types:
int, float, bool, Decimal. - The table is backed by a file on disk, and is NOT memory-mapped.
This class just interfaces the reading/writing of the file through a
listinterface. - All the data is indexed and can be accessed as the list of records, where each record is a tuple of values.
- It's main purpose are big files that don't fit into memory, or the files that are read partially. Ex. a few records from the middle of the file.
- It can efficiently slice through the file and read just last N records, or just the first N records.
- The footprint of the file is quite small as the data is binary encoded.
- It can be used with a seek-able compression format without losing efficiency on indexing, like idzip
Installation
pip install bintablefile
The library can be found on PyPi: https://pypi.org/project/bintablefile/
Note: We release directly v2.0 as v1.0 was used just internally and was not released to PyPI. The major improvement of V2 is a full-featured header, that allows to store metadata about the table, as well as store the number of records for ReadOnly compression formats like idzip.
Local development build
pip install -e ".[dev]"
Metadata
Release files for bintablefile 2.2.5
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| bintablefile-2.2.5.tar.gz | 225.3 kB | Without provenance | Details for bintablefile-2.2.5.tar.gz |
Release files / bintablefile-2.2.5.tar.gz
| Download URL | bintablefile-2.2.5.tar.gz |
|---|---|
| Size | 225.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
44aa78a8e971c2f29e0024fa72cbfde6e97b1a04e0f3dc95cf2ba4cce569c881
|
|
BLAKE2b-256 checksum How to use checksums |
8674a8e8995f3aee299ab04155537da308131674db8616f17a72ab34079dc986
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.12.9
|
Security for bintablefile 2.2.5
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.