Quadtree tiling from CSV/Apache Arrow for use with deepscatter in the browser.
Project description
Quadfeather
Quickly create deep quadtree structures from CSV or feather files to allow serving over HTTP or quicker access to random portions of spatial data.
Each node in the quadtree is a single feather file containing some number of rows (default 2**16) and arrow metadata indicating the existence of children.
From the command line (basic):
WORK IN PROGRESS BELOW.
python -m pip install git+https://github.com/bmschmidt/quadfeather
quadfeather-test-data 255000 # populates a csv at tmp.csv with 255000 items
quadfeather --files tmp.csv --destination tiles
From a python iterable of Arrow record batches (advanced)
Todo
- Allow splitting off of some columns.
- Explain JS integration.
- Octtree for 3-d data.
Optional todo
- Other partition strategies? Quadtree is easy to understand.,
- Linked-open data standards.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file quadfeather-2.3.0rc1.tar.gz.
File metadata
- Download URL: quadfeather-2.3.0rc1.tar.gz
- Upload date:
- Size: 39.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.6.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a8a4e1daff8e36dad8539f3c7956acb46334ff1c16cbf5442f33cb9b096e13e4
|
|
| MD5 |
e5d05daf2d190b6e89f7f65f3a39e312
|
|
| BLAKE2b-256 |
5e04ce78049a61a8cb2ce58753de68d6d605fded96229d433f16c1ae66e5c520
|
File details
Details for the file quadfeather-2.3.0rc1-py3-none-any.whl.
File metadata
- Download URL: quadfeather-2.3.0rc1-py3-none-any.whl
- Upload date:
- Size: 22.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.6.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
04b7a088f40ef5688e7eb9380e28f7f223e405d78336653c0cfa84cffe218df6
|
|
| MD5 |
2cdc7b721d54cf3775462a6b340068b9
|
|
| BLAKE2b-256 |
d63ab71eb0829aaeac46f2914ee5e9e08f0f365dee3868e7a36892bb3a892324
|
