An attempt to speed-up access to large NWB (Neurodata Without Borders) files stored in the cloud.
Project description
lazynwb
Usage
conda create -n lazynwb python>=3.9
conda activate lazynwb
pip install lazynwb
Python
>>> import lazynwb
Development
See instructions in https://github.com/AllenInstitute/lazynwb/CONTRIBUTING.md and the original template: https://github.com/AllenInstitute/copier-pdm-npc/blob/main/README.md
notes
- hdf5 access seems to have a mutex lock that threads spend a long time waiting to acquire (with remfile)
- seems to slow down over time in single-threaded loop
- on laptop, first 5 are fast (2-3 s per iteration) - successive iterations are much slower (>60 s)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
lazynwb-0.1.0.tar.gz
(21.9 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
lazynwb-0.1.0-py3-none-any.whl
(21.8 kB
view details)
File details
Details for the file lazynwb-0.1.0.tar.gz.
File metadata
- Download URL: lazynwb-0.1.0.tar.gz
- Upload date:
- Size: 21.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.6.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
9f1d1b91c9f5bc769f1879be3946a29866b865e1e3084091cbc5b236e029a77d
|
|
| MD5 |
c3b645b2bde1a3844b97424aeb31133c
|
|
| BLAKE2b-256 |
ad09594f9ae2e2f97261766dd8b52b6107f5e6668f1b4b04be618b06cec7ee0e
|
File details
Details for the file lazynwb-0.1.0-py3-none-any.whl.
File metadata
- Download URL: lazynwb-0.1.0-py3-none-any.whl
- Upload date:
- Size: 21.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.6.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
5ba4ca1de655a0a4c8fb23daaf392a3bdfd2d8844c0b744e42c3796560cd3b75
|
|
| MD5 |
5b31218624a1f888fcf6774fcf2f3446
|
|
| BLAKE2b-256 |
e9fb950df76d600886f4bc107685e20dff8f59daf0c12a2c1b327a704905945f
|