Skip to main content

Storage Engine

Project description

Hadro

Hadro is a database storage engine for Opteryx.

PyPI Latest Release codecov Downloads

License

License Notices

Status

Status

Hadro is in alpha. Alpha means different things to different people, to us, being alpha means:

  • Interfaces may be significantly changed
  • The data file format is unstable
  • Expected functionality is missing
  • Things that worked yesterday, don't work today
  • The results of the system may be unreliable

As such, we really don't recommend using HadroDB anywhere where your data matters.

File Format

Magic Bytes

HADRO

Version

001

Header

Section table - Type, Offset, Size, Compression Algo

Record Count

Values Hash

Flags (bytes) Value Store Compression Algo (0 = none, 1 = LZ4, 2 = zSTD)

Column Names (not every record has every column)

PK column name

Statistics

Column, Count, Min, Max, unique values

Indexes

Key, Version, Offset, Length

  • used for the PK index (mandatory) and other values (optional)

Key is binary encoded and limited to 64 bytes, if the value is longer, it needs to be filtered from the value

OR

number of entries value, bitmap

Values

Entries of MsgPack bytes

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hadro-0.5.0a6.tar.gz (76.6 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

hadro-0.5.0a6-cp311-cp311-win_amd64.whl (44.5 kB view details)

Uploaded CPython 3.11Windows x86-64

hadro-0.5.0a6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (244.6 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

hadro-0.5.0a6-cp311-cp311-macosx_10_15_universal2.whl (75.4 kB view details)

Uploaded CPython 3.11macOS 10.15+ universal2 (ARM64, x86-64)

hadro-0.5.0a6-cp310-cp310-win_amd64.whl (44.5 kB view details)

Uploaded CPython 3.10Windows x86-64

hadro-0.5.0a6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (234.2 kB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

hadro-0.5.0a6-cp310-cp310-macosx_11_0_x86_64.whl (75.4 kB view details)

Uploaded CPython 3.10macOS 11.0+ x86-64

hadro-0.5.0a6-cp39-cp39-win_amd64.whl (44.7 kB view details)

Uploaded CPython 3.9Windows x86-64

hadro-0.5.0a6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (234.6 kB view details)

Uploaded CPython 3.9manylinux: glibc 2.17+ x86-64

hadro-0.5.0a6-cp39-cp39-macosx_11_0_x86_64.whl (76.0 kB view details)

Uploaded CPython 3.9macOS 11.0+ x86-64

File details

Details for the file hadro-0.5.0a6.tar.gz.

File metadata

  • Download URL: hadro-0.5.0a6.tar.gz
  • Upload date:
  • Size: 76.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.12.3

File hashes

Hashes for hadro-0.5.0a6.tar.gz
Algorithm Hash digest
SHA256 f13e5a6fddbf90d1ce51dfa534499a5e50cb3f97b0757912ee83adc60e972b53
MD5 b196367fe8220cf233094972bc3df86c
BLAKE2b-256 1fac228ffd25998bcce449ca8e56b1d40d5a50ac3418ae65c5ab42b959a698ba

See more details on using hashes here.

File details

Details for the file hadro-0.5.0a6-cp311-cp311-win_amd64.whl.

File metadata

  • Download URL: hadro-0.5.0a6-cp311-cp311-win_amd64.whl
  • Upload date:
  • Size: 44.5 kB
  • Tags: CPython 3.11, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.12.3

File hashes

Hashes for hadro-0.5.0a6-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 4bad6d5ca25fa3bba3a5d6f89a47f4d03fb9184a6d204a082c6265269f17dd9e
MD5 cda3efb45e6f077f91923cddb3a6fba1
BLAKE2b-256 f6292e5420ddd782a575b29b2ad7cfdd6a81fdd87c8271ded1f3f69469c3844c

See more details on using hashes here.

File details

Details for the file hadro-0.5.0a6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for hadro-0.5.0a6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 e798110f919987a5458de9e94c4f8214034fc09d221b03649259f82d732357f5
MD5 47d23bfe2503a07dfc9664c02cd0cf9e
BLAKE2b-256 2465297ffc1bf15fec1359516b7cee2f6f2526287d6519f297fe553bb82bfb2e

See more details on using hashes here.

File details

Details for the file hadro-0.5.0a6-cp311-cp311-macosx_10_15_universal2.whl.

File metadata

File hashes

Hashes for hadro-0.5.0a6-cp311-cp311-macosx_10_15_universal2.whl
Algorithm Hash digest
SHA256 3801f12e9308833a6272d3515ca348d806c81c8c332d8eed21b20785c7e24604
MD5 5ffa93db9b65d0a1308145ef7ec8687e
BLAKE2b-256 4508149ecb444136329cb0a9bd60ab8be33cdb22764514b861f345c3e9b6e7d4

See more details on using hashes here.

File details

Details for the file hadro-0.5.0a6-cp310-cp310-win_amd64.whl.

File metadata

  • Download URL: hadro-0.5.0a6-cp310-cp310-win_amd64.whl
  • Upload date:
  • Size: 44.5 kB
  • Tags: CPython 3.10, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.12.3

File hashes

Hashes for hadro-0.5.0a6-cp310-cp310-win_amd64.whl
Algorithm Hash digest
SHA256 454279bc4866da0e30f15215f76931bbfcd8a2a3376788e638fbd7d15c51f38e
MD5 17b47609a47747f10d9b48b218b3cc68
BLAKE2b-256 94c77a0f1b2abbbfd9c7e5b3d2628a2e14fcea4042d43532d405d4da78c482d5

See more details on using hashes here.

File details

Details for the file hadro-0.5.0a6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for hadro-0.5.0a6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 9be9d34b6b3cfe41c5937cbb4f6e5b399beaad5957f1a079979acdf99783ff39
MD5 3100b805c083e911c77844f43a901116
BLAKE2b-256 f4f74fa69d7c9cb9a1ed3364db2dcd5b096c0f62825d9d1429e34e071c63ff5a

See more details on using hashes here.

File details

Details for the file hadro-0.5.0a6-cp310-cp310-macosx_11_0_x86_64.whl.

File metadata

File hashes

Hashes for hadro-0.5.0a6-cp310-cp310-macosx_11_0_x86_64.whl
Algorithm Hash digest
SHA256 25667dfc21e4facd7881a054244b9605d596280acb2cc796c28a3c71bf2561ea
MD5 9b310fe10ee7e47b22dcb6676bfb5a4c
BLAKE2b-256 7183159fef6d2346bc76d37072f9e8cdfc6f611557d3f7f735278574beffa7e1

See more details on using hashes here.

File details

Details for the file hadro-0.5.0a6-cp39-cp39-win_amd64.whl.

File metadata

  • Download URL: hadro-0.5.0a6-cp39-cp39-win_amd64.whl
  • Upload date:
  • Size: 44.7 kB
  • Tags: CPython 3.9, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.12.3

File hashes

Hashes for hadro-0.5.0a6-cp39-cp39-win_amd64.whl
Algorithm Hash digest
SHA256 f6e813d27711cb2ba2fbc215615dc7317c920b10361efee97a931b92a91dfed5
MD5 22404e90cebb8e91b54e31ab72cc036a
BLAKE2b-256 bd2bb00fcefdbbefdd104d68be8de38a5141ee32709d533687ba063832222151

See more details on using hashes here.

File details

Details for the file hadro-0.5.0a6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for hadro-0.5.0a6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 ba70108485ba33ce0578a11ffe5b26df8e20563c61a6785b5b7aefcde9468d7d
MD5 2a5480d604cd26f3096c756be2c3268a
BLAKE2b-256 d2ca3c2142ff8362a96d562f420274748c04629c61623c97ea6068f528ee83ef

See more details on using hashes here.

File details

Details for the file hadro-0.5.0a6-cp39-cp39-macosx_11_0_x86_64.whl.

File metadata

File hashes

Hashes for hadro-0.5.0a6-cp39-cp39-macosx_11_0_x86_64.whl
Algorithm Hash digest
SHA256 e6a3a3ac600c78201cef70619f54b983217243587531c22fcef901ec69b035e0
MD5 9c07d0babaae5d8e54101489742def11
BLAKE2b-256 bb43aaca0b1ba889adbbf94dd90673896bb4dc895bd4302aad74a103f172dd7b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page