labdata
Tools to copy data and manage data analysis in an experimental neuroscience lab.
This is built after labdata-tools and integrates with S3 and a database through datajoint.
Concepts
Experiments often involve many computers in the lab and data has to be copied to a server(and sometimes backed up). In this process files can be corrupted, data loss and so on, specially if manually copying files. Further, in some cases, tasks have to be performed on the files (those might involve compressing, formatting, etc).
What labdata does to copy files:
1. After data are acquired, labdata performs a md5 checksum of the file to be copied and copies the file to a server.
2. After the copy, the checksum and datapath are placed on the Upload database table.
3. The computer/server that manages the copy to the permanent storage server will read the database table. The server will perform a checksum on the file to ensure the copy from the acquisition computer was ok.
4. If needed it will compress data or do whatever is specified in the preference file rules (see upload_rules)
5. Data will be put in S3 and added to the Files
Instalation
Clone the repository to a folder in your computer and do:
pip install . or pip install -e . to if you want that the source code follows git.
1 maintainer
Release files for labdata 0.1.21
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| labdata-0.1.21.tar.gz | 377.3 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| labdata-0.1.21-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 781.7 kB
Release files / labdata-0.1.21.tar.gz
| Download URL | labdata-0.1.21.tar.gz |
|---|---|
| Size | 377.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
9b691692996ab2d8a87b9259ad149b5519d917fb4818631b4f592c1954a07c0f
|
|
BLAKE2b-256 checksum How to use checksums |
310820c419a58f2df82491718db4e4754e5d715b376af14215adf768e5d167e3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.11.6
|
Release files / labdata-0.1.21-py3-none-any.whl
| Download URL | labdata-0.1.21-py3-none-any.whl |
|---|---|
| Size | 404.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
f2dc98cbf3b6d507f40573ffb917c16daec300f57267ddfb5b0b36f3c84b2410
|
|
BLAKE2b-256 checksum How to use checksums |
d80a58b1ac17d8d5f154102ce441c5308c8c27de67c45e7e6d358f1c085b0a82
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.11.6
|
