Skip to main content

A library for rapid computation of Neuroglancer Precomputed shard hashes.

Project description

Automated Tests PyPI version

shard-computer

Perform accelerated shard hash computation for Neuroglancer Precomputed shards.

import shardcomputer

preshift_bits = 0
shard_bits = 11
minishard_bits = 8

label = 12949142

shard_no = shardcomputer.shard_number(label, preshift_bits, shard_bits, minishard_bits)

# let labels be a uint64 numpy array of labels
# e.g. set(['4d2'])
shard_no_set = shardcomputer.unique_shard_numbers(
	labels, preshift_bits, shard_bits, minishard_bits
)

# Returns shard number -> label list dict
# e.g. {'4d2': [12949142]}
shard_no_to_labels = shardcomputer.assign_labels_to_shards(
	label, preshift_bits, shard_bits, minishard_bits
)

Install

pip install shard-computer

Credits

Thank you to Austin Appleby for placing MurMurhash3 into the public domain.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

shard-computer-1.1.1.tar.gz (15.5 kB view hashes)

Uploaded Source

Built Distributions

shard_computer-1.1.1-cp312-cp312-win_amd64.whl (69.8 kB view hashes)

Uploaded CPython 3.12 Windows x86-64

shard_computer-1.1.1-cp312-cp312-win32.whl (64.1 kB view hashes)

Uploaded CPython 3.12 Windows x86

shard_computer-1.1.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (107.9 kB view hashes)

Uploaded CPython 3.12 manylinux: glibc 2.17+ x86-64

shard_computer-1.1.1-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl (113.8 kB view hashes)

Uploaded CPython 3.12 manylinux: glibc 2.17+ i686

shard_computer-1.1.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (105.3 kB view hashes)

Uploaded CPython 3.12 manylinux: glibc 2.17+ ARM64

shard_computer-1.1.1-cp312-cp312-macosx_11_0_arm64.whl (73.2 kB view hashes)

Uploaded CPython 3.12 macOS 11.0+ ARM64

shard_computer-1.1.1-cp312-cp312-macosx_10_9_x86_64.whl (75.9 kB view hashes)

Uploaded CPython 3.12 macOS 10.9+ x86-64

shard_computer-1.1.1-cp311-cp311-win_amd64.whl (70.0 kB view hashes)

Uploaded CPython 3.11 Windows x86-64

shard_computer-1.1.1-cp311-cp311-win32.whl (64.3 kB view hashes)

Uploaded CPython 3.11 Windows x86

shard_computer-1.1.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (107.9 kB view hashes)

Uploaded CPython 3.11 manylinux: glibc 2.17+ x86-64

shard_computer-1.1.1-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl (113.5 kB view hashes)

Uploaded CPython 3.11 manylinux: glibc 2.17+ i686

shard_computer-1.1.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (105.6 kB view hashes)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ARM64

shard_computer-1.1.1-cp311-cp311-macosx_11_0_arm64.whl (74.2 kB view hashes)

Uploaded CPython 3.11 macOS 11.0+ ARM64

shard_computer-1.1.1-cp311-cp311-macosx_10_9_x86_64.whl (76.6 kB view hashes)

Uploaded CPython 3.11 macOS 10.9+ x86-64

shard_computer-1.1.1-cp310-cp310-win_amd64.whl (69.2 kB view hashes)

Uploaded CPython 3.10 Windows x86-64

shard_computer-1.1.1-cp310-cp310-win32.whl (63.4 kB view hashes)

Uploaded CPython 3.10 Windows x86

shard_computer-1.1.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (106.6 kB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

shard_computer-1.1.1-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl (112.0 kB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ i686

shard_computer-1.1.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (104.5 kB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ARM64

shard_computer-1.1.1-cp310-cp310-macosx_11_0_arm64.whl (72.8 kB view hashes)

Uploaded CPython 3.10 macOS 11.0+ ARM64

shard_computer-1.1.1-cp310-cp310-macosx_10_9_x86_64.whl (75.1 kB view hashes)

Uploaded CPython 3.10 macOS 10.9+ x86-64

shard_computer-1.1.1-cp39-cp39-win_amd64.whl (68.9 kB view hashes)

Uploaded CPython 3.9 Windows x86-64

shard_computer-1.1.1-cp39-cp39-win32.whl (63.5 kB view hashes)

Uploaded CPython 3.9 Windows x86

shard_computer-1.1.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (106.8 kB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

shard_computer-1.1.1-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl (112.2 kB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ i686

shard_computer-1.1.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (104.5 kB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ARM64

shard_computer-1.1.1-cp39-cp39-macosx_11_0_arm64.whl (72.9 kB view hashes)

Uploaded CPython 3.9 macOS 11.0+ ARM64

shard_computer-1.1.1-cp39-cp39-macosx_10_9_x86_64.whl (75.3 kB view hashes)

Uploaded CPython 3.9 macOS 10.9+ x86-64

shard_computer-1.1.1-cp38-cp38-win_amd64.whl (69.2 kB view hashes)

Uploaded CPython 3.8 Windows x86-64

shard_computer-1.1.1-cp38-cp38-win32.whl (63.4 kB view hashes)

Uploaded CPython 3.8 Windows x86

shard_computer-1.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (106.4 kB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

shard_computer-1.1.1-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl (111.8 kB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.17+ i686

shard_computer-1.1.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (104.2 kB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.17+ ARM64

shard_computer-1.1.1-cp38-cp38-macosx_11_0_arm64.whl (72.7 kB view hashes)

Uploaded CPython 3.8 macOS 11.0+ ARM64

shard_computer-1.1.1-cp38-cp38-macosx_10_9_x86_64.whl (75.1 kB view hashes)

Uploaded CPython 3.8 macOS 10.9+ x86-64

shard_computer-1.1.1-cp37-cp37m-win_amd64.whl (69.7 kB view hashes)

Uploaded CPython 3.7m Windows x86-64

shard_computer-1.1.1-cp37-cp37m-win32.whl (64.5 kB view hashes)

Uploaded CPython 3.7m Windows x86

shard_computer-1.1.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (107.7 kB view hashes)

Uploaded CPython 3.7m manylinux: glibc 2.17+ x86-64

shard_computer-1.1.1-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whl (114.1 kB view hashes)

Uploaded CPython 3.7m manylinux: glibc 2.17+ i686

shard_computer-1.1.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (105.9 kB view hashes)

Uploaded CPython 3.7m manylinux: glibc 2.17+ ARM64

shard_computer-1.1.1-cp37-cp37m-macosx_10_9_x86_64.whl (75.2 kB view hashes)

Uploaded CPython 3.7m macOS 10.9+ x86-64

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page