Skip to main content

Binary Table File format

Build Status

Binary Table File - efficient binary file format to store and retrieve tabular data

This library is written in Cython for speed efficiency.

  • is basically a typed CSV, but binary and indexed, supporting only a subset of the types: int, float, bool, Decimal.
  • The table is backed by a file on disk, and is NOT memory-mapped. This class just interfaces the reading/writing of the file through a list interface.
  • All the data is indexed and can be accessed as the list of records, where each record is a tuple of values.
  • It's main purpose are big files that don't fit into memory, or the files that are read partially. Ex. a few records from the middle of the file.
  • It can efficiently slice through the file and read just last N records, or just the first N records.
  • The footprint of the file is quite small as the data is binary encoded.
  • It can be used with a seek-able compression format without losing efficiency on indexing, like idzip

Installation

pip install bintablefile

The library can be found on PyPi: https://pypi.org/project/bintablefile/

Note: We release directly v2.0 as v1.0 was used just internally and was not released to PyPI. The major improvement of V2 is a full-featured header, that allows to store metadata about the table, as well as store the number of records for ReadOnly compression formats like idzip.

Local development build

pip install -e ".[dev]"

Metadata

Release files for bintablefile 2.2.5

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for bintablefile 2.2.5
File Size Uploaded Provenance Actions
bintablefile-2.2.5.tar.gz 225.3 kB Without provenance Details for bintablefile-2.2.5.tar.gz

Release files / bintablefile-2.2.5.tar.gz

Download URL bintablefile-2.2.5.tar.gz
Size 225.3 kB
Tags Source
SHA-256 checksum
How to use checksums
44aa78a8e971c2f29e0024fa72cbfde6e97b1a04e0f3dc95cf2ba4cce569c881
BLAKE2b-256 checksum
How to use checksums
8674a8e8995f3aee299ab04155537da308131674db8616f17a72ab34079dc986
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.12.9

Security for bintablefile 2.2.5

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page