Fast python conversion from protobuf to arrow using rust
Project description
ptars
Protobuf to Arrow, using Rust
Example
Take a protobuf:
message SearchRequest {
string query = 1;
int32 page_number = 2;
int32 result_per_page = 3;
}
And convert serialized messages directly to pyarrow.RecordBatch
:
messages = [
SearchRequest(
query="protobuf to arrow",
page_number=0,
result_per_page=10,
),
SearchRequest(
query="protobuf to arrow",
page_number=1,
result_per_page=10,
),
]
payloads = [message.SerializeToString() for message in messages]
pool = HandlerPool()
handler = pool.get_for_message(SearchRequest.DESCRIPTOR)
record_batch = handler.list_to_record_batch(payloads)
query | page_number | result_per_page |
---|---|---|
protobuf to arrow | 0 | 10 |
protobuf to arrow | 1 | 10 |
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ptars-0.0.2rc2.tar.gz
(79.0 kB
view hashes)
Built Distributions
Close
Hashes for ptars-0.0.2rc2-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 01c475e70e2ca44667b47e9e84972769fa852c774e58fccebce348d91f295eb3 |
|
MD5 | b6f8ef900c85c0c66b75764ffaa93835 |
|
BLAKE2b-256 | 63af83b1b0c65458b50a9ba7a56437d67b2b8178c921d1380c1fc4ddbb0749fe |
Close
Hashes for ptars-0.0.2rc2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2fff92e4fef58a764cff4d96deae17996c7e9c696d77fc7e1a839f4b72f63843 |
|
MD5 | 142ad85215383fd327ef5578453df231 |
|
BLAKE2b-256 | 53186ce8738394c0a7f405b63973f7290da2bbd175fa0b912c870efeaa00e174 |
Close
Hashes for ptars-0.0.2rc2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 84b5940dcb3fc0671fb4281f51cd7bed616bbf35671141ced95ca2e2eb1f2bca |
|
MD5 | d52465465c5fafdd0708efb80ed0c424 |
|
BLAKE2b-256 | 54070a3d9e4b1cf4005c7e3a79dd724d416abdb94bf751a6089094433e0ace32 |
Close
Hashes for ptars-0.0.2rc2-cp311-cp311-manylinux_2_5_i686.manylinux1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c08caa462c7fbbd6a1f26b4ea37466bf534c7cd3d0e7a2224937f18c710f584f |
|
MD5 | 38c94eb1fca7f170712943419011d526 |
|
BLAKE2b-256 | e21d79ac0e709fca2a0ec396eba8a7b9bb419be4fed71ae48195c98f7d291ea0 |
Close
Hashes for ptars-0.0.2rc2-cp311-cp311-macosx_10_12_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f0e33bd188fdd98cc594ed632eb7f3e330d10bcbad3677b221e94cd0b7a89796 |
|
MD5 | bd8a7f09ecc4690c4b767f0ffba27b39 |
|
BLAKE2b-256 | ffadc932da3a784941c133a867799325c6b54faec3550c444ac28610d0b16e4c |
Close
Hashes for ptars-0.0.2rc2-cp311-cp311-macosx_10_12_x86_64.macosx_11_0_arm64.macosx_10_12_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2c849748f038709453cc0797ce691ada525e9ea6eaf196730715e72422bc703e |
|
MD5 | 533c9028a258409d8778c07a1f0f9abd |
|
BLAKE2b-256 | 09ebcb46e88304096e3244f4db890358d55a6577705b47afb73d1f85f42a7103 |